CN110738254A - microscopic image target detection method and system based on depth geometric characteristic spectrum - Google Patents
microscopic image target detection method and system based on depth geometric characteristic spectrum Download PDFInfo
- Publication number
- CN110738254A CN110738254A CN201910977216.6A CN201910977216A CN110738254A CN 110738254 A CN110738254 A CN 110738254A CN 201910977216 A CN201910977216 A CN 201910977216A CN 110738254 A CN110738254 A CN 110738254A
- Authority
- CN
- China
- Prior art keywords
- target
- determining
- heat map
- detection target
- microscopic image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 98
- 238000001228 spectrum Methods 0.000 title claims abstract description 63
- 238000012549 training Methods 0.000 claims abstract description 48
- 238000000034 method Methods 0.000 claims abstract description 25
- 239000011159 matrix material Substances 0.000 claims description 17
- 238000012937 correction Methods 0.000 claims description 7
- 238000010276 construction Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000001000 micrograph Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 9
- 241000223836 Babesia Species 0.000 description 4
- 201000008680 babesiosis Diseases 0.000 description 4
- 210000004027 cell Anatomy 0.000 description 4
- 241000223997 Toxoplasma gondii Species 0.000 description 3
- 244000045947 parasite Species 0.000 description 3
- 208000030852 Parasitic disease Diseases 0.000 description 2
- 210000003855 cell nucleus Anatomy 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 241000223996 Toxoplasma Species 0.000 description 1
- 241000223104 Trypanosoma Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- 210000004940 nucleus Anatomy 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000005180 public health Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/29—Graphical models, e.g. Bayesian networks
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Probability & Statistics with Applications (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
本发明公开了一种基于深度几何特征谱的显微图像目标检测方法及系统,所述方法包括:首先构建训练集,其次根据所述训练集训练得到带有参数的漏斗网络;再次将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;然后根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;最后根据所述待选检测目标和所述邻接特征谱确定检测目标。本发明采用深度几何特征谱进行检测,提高检测目标的准确性。
The invention discloses a microscopic image target detection method and system based on a deep geometric feature spectrum. The method includes: firstly constructing a training set, secondly training a funnel network with parameters according to the training set; The microscopic image is input into the funnel network with parameters, and four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected are output; then according to the four extreme point heatmaps and all The center point heat map is used to determine the candidate detection target and the adjacent characteristic spectrum; finally, the detection target is determined according to the candidate detection target and the adjacent characteristic spectrum. The invention adopts the depth geometric feature spectrum for detection, and improves the accuracy of the detection target.
Description
技术领域technical field
本发明涉及显微图像分析中的目标检测技术领域,特别是涉及一种基于深度几何特征谱的显微图像目标检测方法及系统。The invention relates to the technical field of target detection in microscopic image analysis, in particular to a microscopic image target detection method and system based on depth geometric characteristic spectrum.
背景技术Background technique
寄生虫是一种具有各种形态的细胞,并且寄生虫病是大多贫穷国家面临地困难的公共卫生问题,由于医疗条件和技术的落后使这些国家的人民长期遭受着寄生虫病的侵害。根据应用价值和对象特征,本发明选取弓形虫、锥虫、巴贝斯虫和正常细胞作为研究对象。对微观生物分析大都依靠显微镜图像进行辅助,因此,显微镜图像为细胞检测和统计带来了便利。然而,人工显微镜观察的方法耗时且研究人员知识存在差异,此外,涂片颜色、光照强度、目标尺寸在不同实验场景下存在较大差异,因此本发明试图寻找一种计算机辅助的方法对显微镜下的寄生虫图像进行自动地分析。Parasites are cells with various forms, and parasitic diseases are a difficult public health problem faced by most poor countries. Due to the backward medical conditions and technology, the people of these countries have suffered from parasitic diseases for a long time. According to the application value and object characteristics, the present invention selects Toxoplasma, Trypanosoma, Babesia and normal cells as research objects. Most of the microscopic biological analysis relies on the assistance of microscope images, therefore, the microscope images bring convenience for cell detection and statistics. However, the method of manual microscope observation is time-consuming and there are differences in the knowledge of researchers. In addition, the color of the smear, the intensity of light, and the size of the target are quite different in different experimental scenarios. Therefore, the present invention attempts to find a computer-aided method for the microscope. The parasite images below are automatically analyzed.
深度学习技术被大量用于目标检测领域,但主要都是基于候选区域。最近,基于关键点的检测方法被提出,有基于角点、中心点、极值点等的算法,这些方法在目标检测中取得较好的效果,但它们都忽略了关键点之间的密切联系,特别是在目标形态复杂、数量繁多的显微图像中,细胞几何形态对于检测过程至关重要。Deep learning techniques are widely used in the field of object detection, but they are mainly based on candidate regions. Recently, detection methods based on key points have been proposed. There are algorithms based on corner points, center points, extreme points, etc. These methods achieve good results in target detection, but they all ignore the close relationship between key points. , especially in microscopic images with complex and numerous target morphology, the cell geometry is crucial to the detection process.
现有提出的基于点的目标检测算法不能直接迁移到显微目标检测中,它们大都忽略了每两个关键点之间的几何关联性,导致在关键点组合过程中异目标的点组合在一起从而形成错误的组合结果,影响目标检测的正确结果。The existing proposed point-based target detection algorithms cannot be directly transferred to microscopic target detection, and most of them ignore the geometric correlation between each two key points, resulting in the combination of different target points in the key point combination process. Thus, a wrong combination result is formed, which affects the correct result of target detection.
发明内容SUMMARY OF THE INVENTION
本发明的目的是提供一种基于深度几何特征谱的显微图像目标检测方法及系统,采用深度几何特征谱进行检查,提高检测目标的准确性。The purpose of the present invention is to provide a microscopic image target detection method and system based on the depth geometric characteristic spectrum, which adopts the deep geometric characteristic spectrum for inspection and improves the accuracy of the detection target.
为实现上述目的,本发明提供了一种基于深度几何特征谱的显微图像目标检测方法,所述方法包括:In order to achieve the above objects, the present invention provides a method for detecting objects in microscopic images based on depth geometric feature spectrum, the method comprising:
步骤S1:构建训练集,所述训练集包括多张带有标记的显微图像;Step S1: constructing a training set, the training set includes a plurality of labeled microscopic images;
步骤S2:根据所述训练集训练得到带有参数的漏斗网络;Step S2: obtain a funnel network with parameters according to the training set;
步骤S3:将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;Step S3: Input the microscopic image to be detected into the funnel network with parameters, and output four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; The heatmaps are up, down, left and right direction heatmaps respectively;
步骤S4:根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;Step S4: Determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;
步骤S5:根据所述待选检测目标和所述邻接特征谱确定检测目标。Step S5: Determine a detection target according to the candidate detection target and the adjacent feature spectrum.
可选的,所述根据所述训练集训练得到带有参数的漏斗网络,具体包括:Optionally, the funnel network with parameters obtained by training according to the training set specifically includes:
步骤S21:基于全卷积网络构建漏斗网络;Step S21: constructing a funnel network based on a fully convolutional network;
步骤S22:从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;Step S22: Select a set number of labeled microscopic images from the training set and input them into the funnel network for training. Under the supervision of local loss and correction loss, use the back-propagation algorithm to update the data in the funnel network. parameter;
步骤S23:判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回步骤S22。Step S23: Determine whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return to step S22.
可选的,所述根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱,具体包括:Optionally, determining the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap specifically includes:
步骤S41:提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;Step S41: extracting all extreme points in each extreme point heat map, and placing them in the set corresponding to each extreme point heat map;
步骤S42:从各集合中任选一个极值点组成关键点;Step S42: Choose an extreme point from each set to form a key point;
步骤S43:根据所述关键点计算中心点;Step S43: Calculate the center point according to the key point;
步骤S44:在所述中心点热图上确定所述中心点对应的像素值;Step S44: determining the pixel value corresponding to the center point on the center point heat map;
步骤S45:判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回步骤S42;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;Step S45: determine whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to step S42; if the pixel value is greater than or equal to the pixel setting threshold, then the key point and the center point are used as the detection target to be selected;
步骤S46:根据所述关键点构建加权图;Step S46: constructing a weighted graph according to the key points;
步骤S47:根据所述加权图确定邻接矩阵;Step S47: determining an adjacency matrix according to the weighted graph;
步骤S48:根据所述邻接矩阵确定邻接特征谱。Step S48: Determine the adjacency feature spectrum according to the adjacency matrix.
可选的,所述根据所述待选检测目标和所述邻接特征谱确定检测目标,具体包括:Optionally, determining the detection target according to the to-be-selected detection target and the adjacent feature spectrum specifically includes:
步骤S51:根据所述邻接特征谱确定欧式距离;Step S51: Determine the Euclidean distance according to the adjacent feature spectrum;
步骤S52:判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。Step S52: judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, then the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is not within the distance Within the set threshold, the key point corresponding to the candidate detection target is released.
可选的,所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。Optionally, the extreme point is a maximum value in an n×n sliding window, where n is the selected window width pixel value.
本发明还提供一种基于深度几何特征谱的显微图像目标检测系统,所述系统包括:The present invention also provides a microscopic image target detection system based on the depth geometric characteristic spectrum, the system comprising:
训练集构建模块,用于构建训练集,所述训练集包括多张带有标记的显微图像;a training set building module for constructing a training set, the training set including a plurality of labeled microscopic images;
漏斗网络确定模块,用于根据所述训练集训练得到带有参数的漏斗网络;a funnel network determination module, used for obtaining a funnel network with parameters according to the training set;
热图输出模块,用于将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;The heat map output module is used to input the microscopic image to be detected into the funnel network with parameters, and output four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; The extreme point heat map is the heat map in four directions: up, down, left, and right;
参数确定模块,用于根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;a parameter determination module, configured to determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;
检测目标确定模块,用于根据所述待选检测目标和所述邻接特征谱确定检测目标。A detection target determination module, configured to determine the detection target according to the candidate detection target and the adjacent feature spectrum.
可选的,所述漏斗网络确定模块,具体包括:Optionally, the funnel network determination module specifically includes:
漏斗网络构建单元,用于基于全卷积网络构建漏斗网络;The funnel network construction unit is used to build a funnel network based on a fully convolutional network;
参数更新单元,用于从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;A parameter updating unit, for selecting a set number of labeled microscopic images from the training set and inputting them to the funnel network for training, and under the supervision of local loss and correction loss, the back propagation algorithm is used to update the funnel parameters in the network;
第一判断单元,用于判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回“参数更新单元”。The first judgment unit is used to judge whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return "Parameter Update Unit".
可选的,所述参数确定模块,具体包括:Optionally, the parameter determination module specifically includes:
提取单元,用于提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;The extraction unit is used to extract all extreme points in each extreme point heat map, and place them in the set corresponding to each extreme point heat map;
关键点确定单元,用于从各集合中任选一个极值点组成关键点;The key point determination unit is used to select an extreme point from each set to form a key point;
中心点确定单元,用于根据所述关键点计算中心点;a center point determination unit, used for calculating the center point according to the key point;
像素值确定单元,用于在所述中心点热图上确定所述中心点对应的像素值;a pixel value determination unit, configured to determine the pixel value corresponding to the center point on the center point heat map;
第二判断单元,用于判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回“关键点确定单元”;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;The second judgment unit is used to judge whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to the "key point determination unit"; If the pixel value is greater than or equal to the pixel setting threshold, the key point and the center point are used as the detection target to be selected;
加权图构建单元,用于根据所述关键点构建加权图;a weighted graph construction unit for constructing a weighted graph according to the key points;
邻接矩阵确定单元,用于根据所述加权图确定邻接矩阵;an adjacency matrix determining unit for determining an adjacency matrix according to the weighted graph;
邻接特征谱确定单元,用于根据所述邻接矩阵确定邻接特征谱。An adjacency feature spectrum determining unit, configured to determine an adjacency feature spectrum according to the adjacency matrix.
可选的,所述检测目标确定模块,具体包括:Optionally, the detection target determination module specifically includes:
欧式距离确定单元,用于根据所述邻接特征谱确定欧式距离;an Euclidean distance determining unit for determining the Euclidean distance according to the adjacent feature spectrum;
第三判断单元,用于判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。The third judging unit is used to judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is within the distance setting threshold If the Euclidean distance is not within the distance setting threshold, the key point corresponding to the candidate detection target is released.
可选的,所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。Optionally, the extreme point is a maximum value in an n×n sliding window, where n is the selected window width pixel value.
根据本发明提供的具体实施例,本发明公开了以下技术效果:According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects:
本发明公开了一种基于深度几何特征谱的显微图像目标检测方法及系统,所述方法包括:首先构建训练集,其次根据所述训练集训练得到带有参数的漏斗网络;再次将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;然后根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;最后根据所述待选检测目标和所述邻接特征谱确定检测目标。本发明采用深度几何特征谱进行检测,提高检测目标的准确性。The invention discloses a microscopic image target detection method and system based on a deep geometric feature spectrum. The method includes: firstly constructing a training set, secondly training a funnel network with parameters according to the training set; The microscopic image is input into the funnel network with parameters, and four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected are output; then according to the four extreme point heatmaps and all The center point heat map is used to determine the candidate detection target and the adjacent characteristic spectrum; finally, the detection target is determined according to the candidate detection target and the adjacent characteristic spectrum. The invention adopts the depth geometric feature spectrum for detection, and improves the accuracy of the detection target.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.
图1为本发明实施例显微图像目标检测方法流程图;1 is a flow chart of a method for detecting a target in a microscopic image according to an embodiment of the present invention;
图2为本发明实施例显微图像目标检测系统结构图;2 is a structural diagram of a microscopic image target detection system according to an embodiment of the present invention;
图3为本发明实施例检测目标为细胞核的检测图;FIG. 3 is a detection diagram in which the detection target is the nucleus according to the embodiment of the present invention;
图4为本发明实施例检测目标为锥虫的检测图;Fig. 4 is the detection diagram that the detection target of the embodiment of the present invention is trypanosome;
图5为本发明实施例检测目标为弓形虫的检测图;Fig. 5 is the detection diagram that the detection target of the embodiment of the present invention is Toxoplasma gondii;
图6为本发明实施例检测目标为巴贝斯虫的检测图。FIG. 6 is a detection diagram of Babesia as a detection target according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
本发明的目的是提供一种基于深度几何特征谱的显微图像目标检测方法及系统,采用深度几何特征谱进行检测,提高检测目标的准确性。The purpose of the present invention is to provide a microscopic image target detection method and system based on the depth geometric feature spectrum, which adopts the depth geometric feature spectrum for detection and improves the accuracy of the detection target.
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本发明作进一步详细的说明。In order to make the above objects, features and advantages of the present invention more clearly understood, the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.
图1为本发明实施例显微图像目标检测方法流程图,如图1所示,本发明提供了一种基于深度几何特征谱的显微图像目标检测方法,其特征在于,所述方法包括:FIG. 1 is a flowchart of a method for detecting objects in a microscopic image according to an embodiment of the present invention. As shown in FIG. 1 , the present invention provides a method for detecting objects in a microscopic image based on a depth geometric characteristic spectrum, characterized in that the method includes:
步骤S1:构建训练集,所述训练集包括多张带有标记的显微图像;Step S1: constructing a training set, the training set includes a plurality of labeled microscopic images;
步骤S2:根据所述训练集训练得到带有参数的漏斗网络;Step S2: obtain a funnel network with parameters according to the training set;
步骤S3:将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;Step S3: Input the microscopic image to be detected into the funnel network with parameters, and output four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; The heatmaps are up, down, left and right direction heatmaps respectively;
步骤S4:根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;Step S4: Determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;
步骤S5:根据所述待选检测目标和所述邻接特征谱确定检测目标。Step S5: Determine a detection target according to the candidate detection target and the adjacent feature spectrum.
下面对各个步骤进行详细论述:Each step is discussed in detail below:
步骤S2:根据所述训练集训练得到带有参数的漏斗网络,具体包括:Step S2: Train a funnel network with parameters according to the training set, which specifically includes:
步骤S21:基于全卷积网络构建漏斗网络;Step S21: constructing a funnel network based on a fully convolutional network;
步骤S22:从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;本发明实施例所述设定数目为28,共使用4块图形处理器GPU训练漏斗网络。Step S22: Select a set number of labeled microscopic images from the training set and input them into the funnel network for training. Under the supervision of local loss and correction loss, use the back-propagation algorithm to update the data in the funnel network. parameters; the set number in the embodiment of the present invention is 28, and a total of 4 graphics processing units (GPUs) are used to train the funnel network.
本发明设置的局部损失Ldet是对每张热图进行加权逐点逻辑回归,加权的目的是为了减少真值周围的虚警惩罚;偏移修正损失Loff是为了提高目标检测的准确性而提出的,它用来弥补在下采样过程中引起的分辨率损失。The local loss L det set by the present invention is to perform weighted point-by-point logistic regression on each heat map. The purpose of weighting is to reduce the false alarm penalty around the true value; the offset correction loss L off is to improve the accuracy of target detection. proposed to compensate for the resolution loss caused during downsampling.
所述局部损失的公式为:The formula for the local loss is:
其中,H为显微图像的长的像素,W为显微图像的宽的像素,N为显微图像中目标的个数,α、β分别为超参数,Yij为训练集中显微图像的真实像素值,为通过网络计算输出热图中位置(i,j)的预测得分;本实施例中α为2、β为4。Among them, H is the long pixel of the microscopic image, W is the wide pixel of the microscopic image, N is the number of objects in the microscopic image, α and β are hyperparameters respectively, and Y ij is the value of the microscopic image in the training set. true pixel value, is the prediction score of the position (i, j) in the output heat map through the network calculation; in this embodiment, α is 2, and β is 4.
其中,N为显微图像中目标的个数,SL1为平滑损失,ok和分别表示偏移量的实际值和预测值。where N is the number of objects in the microscopic image, SL 1 is the smoothing loss, ok and represent the actual and predicted values of the offset, respectively.
步骤S23:判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回步骤S22。本发明实施例所述迭代次数阈值为100000。Step S23: Determine whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return to step S22. The threshold for the number of iterations in the embodiment of the present invention is 100,000.
步骤S4:所述根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱,具体包括:Step S4: determining the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap, specifically including:
步骤S41:提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。Step S41 : extract all extreme points in each extreme point heat map, and place them in the set corresponding to each extreme point heat map; the extreme point is the maximum value in the n×n sliding window, where n is the selected window width pixel value.
步骤S42:从各集合中任选一个极值点组成关键点K;具体公式为:Step S42: Choose an extreme point from each set to form a key point K; the specific formula is:
K={(x(t),y(t)),(x(l),y(l)),(x(b),y(b)),(x(r),y(r))},其中,(x(t),y(t))为顶端极值点的坐标位置,(x(l),y(l))为左端极值点的坐标位置,(x(b),y(b))为底端极值点的坐标位置,(x(r),y(r))为右端极值点的坐标位置。K={(x (t) ,y (t) ),(x (l) ,y (l) ),(x (b) ,y (b) ),(x (r) ,y (r) ) }, where (x (t) , y (t) ) is the coordinate position of the top extreme point, (x (l) , y (l) ) is the coordinate position of the left extreme point, (x (b) , y (b) ) is the coordinate position of the bottom extreme point, (x (r) , y (r) ) is the coordinate position of the right extreme point.
步骤S43:根据所述关键点计算中心点,具体公式为:Step S43: Calculate the center point according to the key point, and the specific formula is:
其中,x(l)为左端极值点横坐标、x(r)为右端极值点横坐标、y(t)为顶端极值点纵坐标、y(b)为底端极值点纵坐标。 Among them, x (l) is the abscissa of the left extreme point, x (r) is the abscissa of the right extreme point, y (t) is the ordinate of the top extreme point, and y (b) is the ordinate of the bottom extreme point .
步骤S44:在所述中心点热图上确定所述中心点对应的像素值;Step S44: determining the pixel value corresponding to the center point on the center point heat map;
步骤S45:判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回步骤S42;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;Step S45: determine whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to step S42; if the pixel value is greater than or equal to the pixel setting threshold, then the key point and the center point are used as the detection target to be selected;
步骤S46:根据所述关键点构建加权图G=(V,E),其中,V={v1,v2,...vn}为加权图G中的节点,E={e1,e2,...em}为V中的任意两个节点连接形成的边集合。Step S46: Construct a weighted graph G=(V, E) according to the key points, wherein V={v 1 , v 2 ,...v n } are nodes in the weighted graph G, E={e 1 , e 2 ,...e m } is the set of edges formed by connecting any two nodes in V.
步骤S47:根据所述加权图确定邻接矩阵A(G),具体公式为:Step S47: Determine the adjacency matrix A(G) according to the weighted graph, and the specific formula is:
其中:n为节点的总数,权重ωij用两点间的欧式距离d(vi,vj)表示,即ωij=d(vi,vj)=|vi-vj|。in: n is the total number of nodes, and the weight ω ij is represented by the Euclidean distance d(v i ,v j ) between two points, that is, ω ij =d(vi ,v j ) =|v i -v j | .
步骤S48:根据所述邻接矩阵确定邻接特征谱。邻接矩阵A(G)的特征多项式为:f(G,λ)=|λE-A|,求f(G,λ)的特征值λ就是加权图G的邻接特征谱Spec(A),其过程转化为求特征方程|λE-A|x=0的解。即Step S48: Determine the adjacency feature spectrum according to the adjacency matrix. The characteristic polynomial of the adjacency matrix A(G) is: f(G,λ)=|λE-A|, and finding the eigenvalue λ of f(G,λ) is the adjacency eigenspectrum Spec(A) of the weighted graph G, and its process Converted to find the solution of the characteristic equation |λE-A|x=0. which is
求解n个复根λ1,λ2,...,λn,为邻接矩阵的n个特征根,即邻接特征谱Spec(A)=[λ1,λ2,...,λn]。Solve n complex roots λ 1 ,λ 2 ,...,λ n , which are the n eigenvalues of the adjacency matrix, that is, the adjacency eigenspectrum Spec(A)=[λ 1 ,λ 2 ,...,λ n ] .
步骤S5:根据所述待选检测目标和所述邻接特征谱确定检测目标,具体包括:Step S5: Determine the detection target according to the to-be-selected detection target and the adjacent feature spectrum, specifically including:
步骤S51:根据所述邻接特征谱确定欧式距离,具体公式为:Step S51: Determine the Euclidean distance according to the adjacent feature spectrum, and the specific formula is:
Ds=|Spec(A)-Spec(0)|;D s = |Spec(A)-Spec(0)|;
其中,Spec(A)为邻接特征谱,Spec(0)为训练得到的初始特征谱,所述初始特征谱是根据标定的参数确定得出的。Wherein, Spec(A) is the adjacent feature spectrum, and Spec(0) is the initial feature spectrum obtained by training, and the initial feature spectrum is determined according to the calibrated parameters.
步骤S52:判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。Step S52: judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, then the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is not within the distance Within the set threshold, the key point corresponding to the candidate detection target is released.
图2为本发明实施例显微图像目标检测系统结构图,如图2所示,本发明还提供一种基于深度几何特征谱的显微图像目标检测系统,所述系统包括:FIG. 2 is a structural diagram of a microscopic image target detection system according to an embodiment of the present invention. As shown in FIG. 2 , the present invention also provides a microscopic image target detection system based on depth geometric feature spectrum, and the system includes:
训练集构建模块1,用于构建训练集,所述训练集包括多张带有标记的显微图像;A training set
漏斗网络确定模块2,用于根据所述训练集训练得到带有参数的漏斗网络;The funnel
热图输出模块3,用于将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;The heat
参数确定模块4,用于根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;A parameter determination module 4, configured to determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;
检测目标确定模块5,用于根据所述待选检测目标和所述邻接特征谱确定检测目标。The detection
下面对各个模块进行详细论述:Each module is discussed in detail below:
所述漏斗网络确定模块2,具体包括:The funnel
漏斗网络构建单元,用于基于全卷积网络构建漏斗网络;The funnel network construction unit is used to build a funnel network based on a fully convolutional network;
参数更新单元,用于从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;A parameter updating unit, used for selecting a set number of labeled microscopic images from the training set and inputting them to the funnel network for training, and under the supervision of local loss and correction loss, the funnel is updated by back-propagation algorithm parameters in the network;
第一判断单元,用于判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回“参数更新单元”。The first judgment unit is used to judge whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return "Parameter Update Unit".
参数确定模块4,具体包括:Parameter determination module 4, which specifically includes:
提取单元,用于提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。The extraction unit is used to extract all extreme points in each extreme point heat map, and place them in the set corresponding to each extreme point heat map; the extreme point is the maximum value in the n×n sliding window , where n is the selected window width pixel value.
关键点确定单元,用于从各集合中任选一个极值点组成关键点;The key point determination unit is used to select an extreme point from each set to form a key point;
中心点确定单元,用于根据所述关键点计算中心点;a center point determination unit for calculating the center point according to the key point;
像素值确定单元,用于在所述中心点热图上确定所述中心点对应的像素值;a pixel value determination unit, configured to determine the pixel value corresponding to the center point on the center point heat map;
第二判断单元,用于判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回“关键点确定单元”;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;The second judgment unit is used to judge whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to the "key point determination unit"; If the pixel value is greater than or equal to the pixel setting threshold, the key point and the center point are used as the detection target to be selected;
加权图构建单元,用于根据所述关键点构建加权图;a weighted graph construction unit for constructing a weighted graph according to the key points;
邻接矩阵确定单元,用于根据所述加权图确定邻接矩阵;an adjacency matrix determining unit for determining an adjacency matrix according to the weighted graph;
邻接特征谱确定单元,用于根据所述邻接矩阵确定邻接特征谱。An adjacency feature spectrum determining unit, configured to determine an adjacency feature spectrum according to the adjacency matrix.
检测目标确定模块5,具体包括:The detection
欧式距离确定单元,用于根据所述邻接特征谱确定欧式距离;an Euclidean distance determining unit for determining the Euclidean distance according to the adjacent feature spectrum;
第三判断单元,用于判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。The third judging unit is used to judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is within the distance setting threshold If the Euclidean distance is not within the distance setting threshold, the key point corresponding to the candidate detection target is released.
本发明使用Olympus IX53型号显微镜采集的弓形虫、锥虫、巴贝斯虫三种寄生虫和一种细胞核,共四个数据集,即四个训练集,利用本发明设定的方法分别对四种显微图像进行测试,得到测试结果如下:图3为本发明实施例检测目标为细胞核的检测图,图4为本发明实施例检测目标为锥虫的检测图,图5为本发明实施例检测目标为弓形虫的检测图,图6为本发明实施例检测目标为巴贝斯虫的检测图,在细胞核、巴贝虫、弓形虫和锥虫四种数据集上分别取得90.2%、69.3%、70.2%和95.9%的识别精度,平均测试耗时为11.5秒,达到了显微图像自动化识别的要求。The present invention uses the three kinds of parasites and one kind of cell nucleus of Toxoplasma gondii, trypanosome and Babesia collected by Olympus IX53 microscope, there are four data sets in total, namely four training sets. The microscopic images are tested, and the test results are as follows: FIG. 3 is a detection diagram of an embodiment of the present invention in which the detection target is a cell nucleus, FIG. 4 is a detection diagram of a trypanosome as the detection target in an embodiment of the present invention, and FIG. 5 is a detection diagram of an embodiment of the present invention. The detection map of the target is Toxoplasma gondii, and FIG. 6 is the detection map of the detection target of Babesia according to the embodiment of the present invention, and obtained 90.2%, 69.3%, 90.2%, 69.3%, The recognition accuracy is 70.2% and 95.9%, and the average test time is 11.5 seconds, which meets the requirements of automatic recognition of microscopic images.
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的系统而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method.
本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处。综上所述,本说明书内容不应理解为对本发明的限制。The principles and implementations of the present invention are described herein using specific examples. The descriptions of the above embodiments are only used to help understand the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the present invention There will be changes in the specific implementation and application scope. In conclusion, the contents of this specification should not be construed as limiting the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910977216.6A CN110738254B (en) | 2019-10-15 | 2019-10-15 | A method and system for microscopic image target detection based on depth geometric feature spectrum |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910977216.6A CN110738254B (en) | 2019-10-15 | 2019-10-15 | A method and system for microscopic image target detection based on depth geometric feature spectrum |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110738254A true CN110738254A (en) | 2020-01-31 |
CN110738254B CN110738254B (en) | 2022-03-25 |
Family
ID=69269331
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910977216.6A Active CN110738254B (en) | 2019-10-15 | 2019-10-15 | A method and system for microscopic image target detection based on depth geometric feature spectrum |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110738254B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111311601A (en) * | 2020-03-26 | 2020-06-19 | 深圳极视角科技有限公司 | Segmentation method and device for spliced image |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109800631A (en) * | 2018-12-07 | 2019-05-24 | 天津大学 | Fluorescence-encoded micro-beads image detecting method based on masked areas convolutional neural networks |
CN109858333A (en) * | 2018-12-20 | 2019-06-07 | 腾讯科技(深圳)有限公司 | Image processing method, device, electronic equipment and computer-readable medium |
CN109858386A (en) * | 2019-01-09 | 2019-06-07 | 深圳市趣方科技有限公司 | A kind of microalgae cell recognition methods based on fluorescence microscope images |
WO2019110567A1 (en) * | 2017-12-05 | 2019-06-13 | Ventana Medical Systems, Inc. | Method of computing tumor spatial and inter-marker heterogeneity |
-
2019
- 2019-10-15 CN CN201910977216.6A patent/CN110738254B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019110567A1 (en) * | 2017-12-05 | 2019-06-13 | Ventana Medical Systems, Inc. | Method of computing tumor spatial and inter-marker heterogeneity |
CN109800631A (en) * | 2018-12-07 | 2019-05-24 | 天津大学 | Fluorescence-encoded micro-beads image detecting method based on masked areas convolutional neural networks |
CN109858333A (en) * | 2018-12-20 | 2019-06-07 | 腾讯科技(深圳)有限公司 | Image processing method, device, electronic equipment and computer-readable medium |
CN109858386A (en) * | 2019-01-09 | 2019-06-07 | 深圳市趣方科技有限公司 | A kind of microalgae cell recognition methods based on fluorescence microscope images |
Non-Patent Citations (1)
Title |
---|
XINGYI ZHOU ET AL.: "Bottom-up Object Detection by Grouping Extreme and Center Points", 《ARXIV:1901.08043V3》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111311601A (en) * | 2020-03-26 | 2020-06-19 | 深圳极视角科技有限公司 | Segmentation method and device for spliced image |
CN111311601B (en) * | 2020-03-26 | 2023-10-13 | 山东极视角科技股份有限公司 | Segmentation method and device for spliced image |
Also Published As
Publication number | Publication date |
---|---|
CN110738254B (en) | 2022-03-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110599448B (en) | Migratory learning lung lesion tissue detection system based on MaskScoring R-CNN network | |
Zhao et al. | A deep learning-based approach for refined crack evaluation from shield tunnel lining images | |
CN107092870B (en) | A kind of high resolution image Semantic features extraction method | |
CN107506761B (en) | Brain image segmentation method and system based on saliency learning convolutional neural network | |
CN111325750B (en) | Medical image segmentation method based on multi-scale fusion U-shaped chain neural network | |
WO2023015743A1 (en) | Lesion detection model training method, and method for recognizing lesion in image | |
CN104244802B (en) | Image processing apparatus, image processing method and image processing program | |
CN109559320A (en) | Realize that vision SLAM semanteme builds the method and system of figure function based on empty convolution deep neural network | |
CN112700434B (en) | Medical image classification method and classification device thereof | |
CN107680678A (en) | Based on multiple dimensioned convolutional neural networks Thyroid ultrasound image tubercle auto-check system | |
CN107743225B (en) | A Method for No-Reference Image Quality Prediction Using Multi-Layer Depth Representations | |
CN110135354A (en) | A Change Detection Method Based on Real-Scene 3D Model | |
Mountrakis et al. | Enhancing and replacing spectral information with intermediate structural inputs: A case study on impervious surface detection | |
CN113569724A (en) | Road extraction method and system based on attention mechanism and dilated convolution | |
CN111209918A (en) | Image saliency target detection method | |
CN117437201A (en) | A road crack detection method based on improved YOLOv7 | |
CN113516771B (en) | A method for extracting building change features based on real-life 3D models | |
CN109858451A (en) | A kind of non-cooperation hand detection method | |
CN112862860B (en) | Object perception image fusion method for multi-mode target tracking | |
CN116884623A (en) | Medical rehabilitation prediction system based on laser scanning imaging | |
CN112465821A (en) | Multi-scale pest image detection method based on boundary key point perception | |
CN112419306A (en) | Lung nodule detection method based on NAS-FPN | |
Long et al. | Depth completion towards different sensor configurations via relative depth map estimation and scale recovery | |
CN111968147A (en) | Breast cancer pathological image comprehensive analysis system based on key point detection | |
CN112258495A (en) | Building wood crack identification method based on convolutional neural network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |