[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN110738254A - microscopic image target detection method and system based on depth geometric characteristic spectrum - Google Patents

microscopic image target detection method and system based on depth geometric characteristic spectrum Download PDF

Info

Publication number
CN110738254A
CN110738254A CN201910977216.6A CN201910977216A CN110738254A CN 110738254 A CN110738254 A CN 110738254A CN 201910977216 A CN201910977216 A CN 201910977216A CN 110738254 A CN110738254 A CN 110738254A
Authority
CN
China
Prior art keywords
target
determining
heat map
detection target
microscopic image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910977216.6A
Other languages
Chinese (zh)
Other versions
CN110738254B (en
Inventor
张阳
江浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology Shenzhen
Original Assignee
Harbin Institute of Technology Shenzhen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology Shenzhen filed Critical Harbin Institute of Technology Shenzhen
Priority to CN201910977216.6A priority Critical patent/CN110738254B/en
Publication of CN110738254A publication Critical patent/CN110738254A/en
Application granted granted Critical
Publication of CN110738254B publication Critical patent/CN110738254B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/29Graphical models, e.g. Bayesian networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

本发明公开了一种基于深度几何特征谱的显微图像目标检测方法及系统,所述方法包括:首先构建训练集,其次根据所述训练集训练得到带有参数的漏斗网络;再次将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;然后根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;最后根据所述待选检测目标和所述邻接特征谱确定检测目标。本发明采用深度几何特征谱进行检测,提高检测目标的准确性。

Figure 201910977216

The invention discloses a microscopic image target detection method and system based on a deep geometric feature spectrum. The method includes: firstly constructing a training set, secondly training a funnel network with parameters according to the training set; The microscopic image is input into the funnel network with parameters, and four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected are output; then according to the four extreme point heatmaps and all The center point heat map is used to determine the candidate detection target and the adjacent characteristic spectrum; finally, the detection target is determined according to the candidate detection target and the adjacent characteristic spectrum. The invention adopts the depth geometric feature spectrum for detection, and improves the accuracy of the detection target.

Figure 201910977216

Description

一种基于深度几何特征谱的显微图像目标检测方法及系统A method and system for microscopic image target detection based on depth geometric feature spectrum

技术领域technical field

本发明涉及显微图像分析中的目标检测技术领域,特别是涉及一种基于深度几何特征谱的显微图像目标检测方法及系统。The invention relates to the technical field of target detection in microscopic image analysis, in particular to a microscopic image target detection method and system based on depth geometric characteristic spectrum.

背景技术Background technique

寄生虫是一种具有各种形态的细胞,并且寄生虫病是大多贫穷国家面临地困难的公共卫生问题,由于医疗条件和技术的落后使这些国家的人民长期遭受着寄生虫病的侵害。根据应用价值和对象特征,本发明选取弓形虫、锥虫、巴贝斯虫和正常细胞作为研究对象。对微观生物分析大都依靠显微镜图像进行辅助,因此,显微镜图像为细胞检测和统计带来了便利。然而,人工显微镜观察的方法耗时且研究人员知识存在差异,此外,涂片颜色、光照强度、目标尺寸在不同实验场景下存在较大差异,因此本发明试图寻找一种计算机辅助的方法对显微镜下的寄生虫图像进行自动地分析。Parasites are cells with various forms, and parasitic diseases are a difficult public health problem faced by most poor countries. Due to the backward medical conditions and technology, the people of these countries have suffered from parasitic diseases for a long time. According to the application value and object characteristics, the present invention selects Toxoplasma, Trypanosoma, Babesia and normal cells as research objects. Most of the microscopic biological analysis relies on the assistance of microscope images, therefore, the microscope images bring convenience for cell detection and statistics. However, the method of manual microscope observation is time-consuming and there are differences in the knowledge of researchers. In addition, the color of the smear, the intensity of light, and the size of the target are quite different in different experimental scenarios. Therefore, the present invention attempts to find a computer-aided method for the microscope. The parasite images below are automatically analyzed.

深度学习技术被大量用于目标检测领域,但主要都是基于候选区域。最近,基于关键点的检测方法被提出,有基于角点、中心点、极值点等的算法,这些方法在目标检测中取得较好的效果,但它们都忽略了关键点之间的密切联系,特别是在目标形态复杂、数量繁多的显微图像中,细胞几何形态对于检测过程至关重要。Deep learning techniques are widely used in the field of object detection, but they are mainly based on candidate regions. Recently, detection methods based on key points have been proposed. There are algorithms based on corner points, center points, extreme points, etc. These methods achieve good results in target detection, but they all ignore the close relationship between key points. , especially in microscopic images with complex and numerous target morphology, the cell geometry is crucial to the detection process.

现有提出的基于点的目标检测算法不能直接迁移到显微目标检测中,它们大都忽略了每两个关键点之间的几何关联性,导致在关键点组合过程中异目标的点组合在一起从而形成错误的组合结果,影响目标检测的正确结果。The existing proposed point-based target detection algorithms cannot be directly transferred to microscopic target detection, and most of them ignore the geometric correlation between each two key points, resulting in the combination of different target points in the key point combination process. Thus, a wrong combination result is formed, which affects the correct result of target detection.

发明内容SUMMARY OF THE INVENTION

本发明的目的是提供一种基于深度几何特征谱的显微图像目标检测方法及系统,采用深度几何特征谱进行检查,提高检测目标的准确性。The purpose of the present invention is to provide a microscopic image target detection method and system based on the depth geometric characteristic spectrum, which adopts the deep geometric characteristic spectrum for inspection and improves the accuracy of the detection target.

为实现上述目的,本发明提供了一种基于深度几何特征谱的显微图像目标检测方法,所述方法包括:In order to achieve the above objects, the present invention provides a method for detecting objects in microscopic images based on depth geometric feature spectrum, the method comprising:

步骤S1:构建训练集,所述训练集包括多张带有标记的显微图像;Step S1: constructing a training set, the training set includes a plurality of labeled microscopic images;

步骤S2:根据所述训练集训练得到带有参数的漏斗网络;Step S2: obtain a funnel network with parameters according to the training set;

步骤S3:将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;Step S3: Input the microscopic image to be detected into the funnel network with parameters, and output four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; The heatmaps are up, down, left and right direction heatmaps respectively;

步骤S4:根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;Step S4: Determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;

步骤S5:根据所述待选检测目标和所述邻接特征谱确定检测目标。Step S5: Determine a detection target according to the candidate detection target and the adjacent feature spectrum.

可选的,所述根据所述训练集训练得到带有参数的漏斗网络,具体包括:Optionally, the funnel network with parameters obtained by training according to the training set specifically includes:

步骤S21:基于全卷积网络构建漏斗网络;Step S21: constructing a funnel network based on a fully convolutional network;

步骤S22:从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;Step S22: Select a set number of labeled microscopic images from the training set and input them into the funnel network for training. Under the supervision of local loss and correction loss, use the back-propagation algorithm to update the data in the funnel network. parameter;

步骤S23:判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回步骤S22。Step S23: Determine whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return to step S22.

可选的,所述根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱,具体包括:Optionally, determining the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap specifically includes:

步骤S41:提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;Step S41: extracting all extreme points in each extreme point heat map, and placing them in the set corresponding to each extreme point heat map;

步骤S42:从各集合中任选一个极值点组成关键点;Step S42: Choose an extreme point from each set to form a key point;

步骤S43:根据所述关键点计算中心点;Step S43: Calculate the center point according to the key point;

步骤S44:在所述中心点热图上确定所述中心点对应的像素值;Step S44: determining the pixel value corresponding to the center point on the center point heat map;

步骤S45:判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回步骤S42;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;Step S45: determine whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to step S42; if the pixel value is greater than or equal to the pixel setting threshold, then the key point and the center point are used as the detection target to be selected;

步骤S46:根据所述关键点构建加权图;Step S46: constructing a weighted graph according to the key points;

步骤S47:根据所述加权图确定邻接矩阵;Step S47: determining an adjacency matrix according to the weighted graph;

步骤S48:根据所述邻接矩阵确定邻接特征谱。Step S48: Determine the adjacency feature spectrum according to the adjacency matrix.

可选的,所述根据所述待选检测目标和所述邻接特征谱确定检测目标,具体包括:Optionally, determining the detection target according to the to-be-selected detection target and the adjacent feature spectrum specifically includes:

步骤S51:根据所述邻接特征谱确定欧式距离;Step S51: Determine the Euclidean distance according to the adjacent feature spectrum;

步骤S52:判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。Step S52: judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, then the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is not within the distance Within the set threshold, the key point corresponding to the candidate detection target is released.

可选的,所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。Optionally, the extreme point is a maximum value in an n×n sliding window, where n is the selected window width pixel value.

本发明还提供一种基于深度几何特征谱的显微图像目标检测系统,所述系统包括:The present invention also provides a microscopic image target detection system based on the depth geometric characteristic spectrum, the system comprising:

训练集构建模块,用于构建训练集,所述训练集包括多张带有标记的显微图像;a training set building module for constructing a training set, the training set including a plurality of labeled microscopic images;

漏斗网络确定模块,用于根据所述训练集训练得到带有参数的漏斗网络;a funnel network determination module, used for obtaining a funnel network with parameters according to the training set;

热图输出模块,用于将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;The heat map output module is used to input the microscopic image to be detected into the funnel network with parameters, and output four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; The extreme point heat map is the heat map in four directions: up, down, left, and right;

参数确定模块,用于根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;a parameter determination module, configured to determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;

检测目标确定模块,用于根据所述待选检测目标和所述邻接特征谱确定检测目标。A detection target determination module, configured to determine the detection target according to the candidate detection target and the adjacent feature spectrum.

可选的,所述漏斗网络确定模块,具体包括:Optionally, the funnel network determination module specifically includes:

漏斗网络构建单元,用于基于全卷积网络构建漏斗网络;The funnel network construction unit is used to build a funnel network based on a fully convolutional network;

参数更新单元,用于从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;A parameter updating unit, for selecting a set number of labeled microscopic images from the training set and inputting them to the funnel network for training, and under the supervision of local loss and correction loss, the back propagation algorithm is used to update the funnel parameters in the network;

第一判断单元,用于判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回“参数更新单元”。The first judgment unit is used to judge whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return "Parameter Update Unit".

可选的,所述参数确定模块,具体包括:Optionally, the parameter determination module specifically includes:

提取单元,用于提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;The extraction unit is used to extract all extreme points in each extreme point heat map, and place them in the set corresponding to each extreme point heat map;

关键点确定单元,用于从各集合中任选一个极值点组成关键点;The key point determination unit is used to select an extreme point from each set to form a key point;

中心点确定单元,用于根据所述关键点计算中心点;a center point determination unit, used for calculating the center point according to the key point;

像素值确定单元,用于在所述中心点热图上确定所述中心点对应的像素值;a pixel value determination unit, configured to determine the pixel value corresponding to the center point on the center point heat map;

第二判断单元,用于判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回“关键点确定单元”;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;The second judgment unit is used to judge whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to the "key point determination unit"; If the pixel value is greater than or equal to the pixel setting threshold, the key point and the center point are used as the detection target to be selected;

加权图构建单元,用于根据所述关键点构建加权图;a weighted graph construction unit for constructing a weighted graph according to the key points;

邻接矩阵确定单元,用于根据所述加权图确定邻接矩阵;an adjacency matrix determining unit for determining an adjacency matrix according to the weighted graph;

邻接特征谱确定单元,用于根据所述邻接矩阵确定邻接特征谱。An adjacency feature spectrum determining unit, configured to determine an adjacency feature spectrum according to the adjacency matrix.

可选的,所述检测目标确定模块,具体包括:Optionally, the detection target determination module specifically includes:

欧式距离确定单元,用于根据所述邻接特征谱确定欧式距离;an Euclidean distance determining unit for determining the Euclidean distance according to the adjacent feature spectrum;

第三判断单元,用于判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。The third judging unit is used to judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is within the distance setting threshold If the Euclidean distance is not within the distance setting threshold, the key point corresponding to the candidate detection target is released.

可选的,所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。Optionally, the extreme point is a maximum value in an n×n sliding window, where n is the selected window width pixel value.

根据本发明提供的具体实施例,本发明公开了以下技术效果:According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects:

本发明公开了一种基于深度几何特征谱的显微图像目标检测方法及系统,所述方法包括:首先构建训练集,其次根据所述训练集训练得到带有参数的漏斗网络;再次将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;然后根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;最后根据所述待选检测目标和所述邻接特征谱确定检测目标。本发明采用深度几何特征谱进行检测,提高检测目标的准确性。The invention discloses a microscopic image target detection method and system based on a deep geometric feature spectrum. The method includes: firstly constructing a training set, secondly training a funnel network with parameters according to the training set; The microscopic image is input into the funnel network with parameters, and four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected are output; then according to the four extreme point heatmaps and all The center point heat map is used to determine the candidate detection target and the adjacent characteristic spectrum; finally, the detection target is determined according to the candidate detection target and the adjacent characteristic spectrum. The invention adopts the depth geometric feature spectrum for detection, and improves the accuracy of the detection target.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

图1为本发明实施例显微图像目标检测方法流程图;1 is a flow chart of a method for detecting a target in a microscopic image according to an embodiment of the present invention;

图2为本发明实施例显微图像目标检测系统结构图;2 is a structural diagram of a microscopic image target detection system according to an embodiment of the present invention;

图3为本发明实施例检测目标为细胞核的检测图;FIG. 3 is a detection diagram in which the detection target is the nucleus according to the embodiment of the present invention;

图4为本发明实施例检测目标为锥虫的检测图;Fig. 4 is the detection diagram that the detection target of the embodiment of the present invention is trypanosome;

图5为本发明实施例检测目标为弓形虫的检测图;Fig. 5 is the detection diagram that the detection target of the embodiment of the present invention is Toxoplasma gondii;

图6为本发明实施例检测目标为巴贝斯虫的检测图。FIG. 6 is a detection diagram of Babesia as a detection target according to an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

本发明的目的是提供一种基于深度几何特征谱的显微图像目标检测方法及系统,采用深度几何特征谱进行检测,提高检测目标的准确性。The purpose of the present invention is to provide a microscopic image target detection method and system based on the depth geometric feature spectrum, which adopts the depth geometric feature spectrum for detection and improves the accuracy of the detection target.

为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本发明作进一步详细的说明。In order to make the above objects, features and advantages of the present invention more clearly understood, the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.

图1为本发明实施例显微图像目标检测方法流程图,如图1所示,本发明提供了一种基于深度几何特征谱的显微图像目标检测方法,其特征在于,所述方法包括:FIG. 1 is a flowchart of a method for detecting objects in a microscopic image according to an embodiment of the present invention. As shown in FIG. 1 , the present invention provides a method for detecting objects in a microscopic image based on a depth geometric characteristic spectrum, characterized in that the method includes:

步骤S1:构建训练集,所述训练集包括多张带有标记的显微图像;Step S1: constructing a training set, the training set includes a plurality of labeled microscopic images;

步骤S2:根据所述训练集训练得到带有参数的漏斗网络;Step S2: obtain a funnel network with parameters according to the training set;

步骤S3:将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;Step S3: Input the microscopic image to be detected into the funnel network with parameters, and output four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; The heatmaps are up, down, left and right direction heatmaps respectively;

步骤S4:根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;Step S4: Determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;

步骤S5:根据所述待选检测目标和所述邻接特征谱确定检测目标。Step S5: Determine a detection target according to the candidate detection target and the adjacent feature spectrum.

下面对各个步骤进行详细论述:Each step is discussed in detail below:

步骤S2:根据所述训练集训练得到带有参数的漏斗网络,具体包括:Step S2: Train a funnel network with parameters according to the training set, which specifically includes:

步骤S21:基于全卷积网络构建漏斗网络;Step S21: constructing a funnel network based on a fully convolutional network;

步骤S22:从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;本发明实施例所述设定数目为28,共使用4块图形处理器GPU训练漏斗网络。Step S22: Select a set number of labeled microscopic images from the training set and input them into the funnel network for training. Under the supervision of local loss and correction loss, use the back-propagation algorithm to update the data in the funnel network. parameters; the set number in the embodiment of the present invention is 28, and a total of 4 graphics processing units (GPUs) are used to train the funnel network.

本发明设置的局部损失Ldet是对每张热图进行加权逐点逻辑回归,加权的目的是为了减少真值周围的虚警惩罚;偏移修正损失Loff是为了提高目标检测的准确性而提出的,它用来弥补在下采样过程中引起的分辨率损失。The local loss L det set by the present invention is to perform weighted point-by-point logistic regression on each heat map. The purpose of weighting is to reduce the false alarm penalty around the true value; the offset correction loss L off is to improve the accuracy of target detection. proposed to compensate for the resolution loss caused during downsampling.

所述局部损失的公式为:The formula for the local loss is:

其中,H为显微图像的长的像素,W为显微图像的宽的像素,N为显微图像中目标的个数,α、β分别为超参数,Yij为训练集中显微图像的真实像素值,

Figure BDA0002234029100000062
为通过网络计算输出热图中位置(i,j)的预测得分;本实施例中α为2、β为4。Among them, H is the long pixel of the microscopic image, W is the wide pixel of the microscopic image, N is the number of objects in the microscopic image, α and β are hyperparameters respectively, and Y ij is the value of the microscopic image in the training set. true pixel value,
Figure BDA0002234029100000062
is the prediction score of the position (i, j) in the output heat map through the network calculation; in this embodiment, α is 2, and β is 4.

Figure BDA0002234029100000063
Figure BDA0002234029100000063

其中,N为显微图像中目标的个数,SL1为平滑损失,ok

Figure BDA0002234029100000064
分别表示偏移量的实际值和预测值。where N is the number of objects in the microscopic image, SL 1 is the smoothing loss, ok and
Figure BDA0002234029100000064
represent the actual and predicted values of the offset, respectively.

步骤S23:判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回步骤S22。本发明实施例所述迭代次数阈值为100000。Step S23: Determine whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return to step S22. The threshold for the number of iterations in the embodiment of the present invention is 100,000.

步骤S4:所述根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱,具体包括:Step S4: determining the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap, specifically including:

步骤S41:提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。Step S41 : extract all extreme points in each extreme point heat map, and place them in the set corresponding to each extreme point heat map; the extreme point is the maximum value in the n×n sliding window, where n is the selected window width pixel value.

步骤S42:从各集合中任选一个极值点组成关键点K;具体公式为:Step S42: Choose an extreme point from each set to form a key point K; the specific formula is:

K={(x(t),y(t)),(x(l),y(l)),(x(b),y(b)),(x(r),y(r))},其中,(x(t),y(t))为顶端极值点的坐标位置,(x(l),y(l))为左端极值点的坐标位置,(x(b),y(b))为底端极值点的坐标位置,(x(r),y(r))为右端极值点的坐标位置。K={(x (t) ,y (t) ),(x (l) ,y (l) ),(x (b) ,y (b) ),(x (r) ,y (r) ) }, where (x (t) , y (t) ) is the coordinate position of the top extreme point, (x (l) , y (l) ) is the coordinate position of the left extreme point, (x (b) , y (b) ) is the coordinate position of the bottom extreme point, (x (r) , y (r) ) is the coordinate position of the right extreme point.

步骤S43:根据所述关键点计算中心点,具体公式为:Step S43: Calculate the center point according to the key point, and the specific formula is:

其中,x(l)为左端极值点横坐标、x(r)为右端极值点横坐标、y(t)为顶端极值点纵坐标、y(b)为底端极值点纵坐标。 Among them, x (l) is the abscissa of the left extreme point, x (r) is the abscissa of the right extreme point, y (t) is the ordinate of the top extreme point, and y (b) is the ordinate of the bottom extreme point .

步骤S44:在所述中心点热图上确定所述中心点对应的像素值;Step S44: determining the pixel value corresponding to the center point on the center point heat map;

步骤S45:判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回步骤S42;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;Step S45: determine whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to step S42; if the pixel value is greater than or equal to the pixel setting threshold, then the key point and the center point are used as the detection target to be selected;

步骤S46:根据所述关键点构建加权图G=(V,E),其中,V={v1,v2,...vn}为加权图G中的节点,E={e1,e2,...em}为V中的任意两个节点连接形成的边集合。Step S46: Construct a weighted graph G=(V, E) according to the key points, wherein V={v 1 , v 2 ,...v n } are nodes in the weighted graph G, E={e 1 , e 2 ,...e m } is the set of edges formed by connecting any two nodes in V.

步骤S47:根据所述加权图确定邻接矩阵A(G),具体公式为:Step S47: Determine the adjacency matrix A(G) according to the weighted graph, and the specific formula is:

Figure BDA0002234029100000072
Figure BDA0002234029100000072

其中:

Figure BDA0002234029100000073
n为节点的总数,权重ωij用两点间的欧式距离d(vi,vj)表示,即ωij=d(vi,vj)=|vi-vj|。in:
Figure BDA0002234029100000073
n is the total number of nodes, and the weight ω ij is represented by the Euclidean distance d(v i ,v j ) between two points, that is, ω ij =d(vi ,v j ) =|v i -v j | .

步骤S48:根据所述邻接矩阵确定邻接特征谱。邻接矩阵A(G)的特征多项式为:f(G,λ)=|λE-A|,求f(G,λ)的特征值λ就是加权图G的邻接特征谱Spec(A),其过程转化为求特征方程|λE-A|x=0的解。即Step S48: Determine the adjacency feature spectrum according to the adjacency matrix. The characteristic polynomial of the adjacency matrix A(G) is: f(G,λ)=|λE-A|, and finding the eigenvalue λ of f(G,λ) is the adjacency eigenspectrum Spec(A) of the weighted graph G, and its process Converted to find the solution of the characteristic equation |λE-A|x=0. which is

求解n个复根λ12,...,λn,为邻接矩阵的n个特征根,即邻接特征谱Spec(A)=[λ12,...,λn]。Solve n complex roots λ 12 ,...,λ n , which are the n eigenvalues of the adjacency matrix, that is, the adjacency eigenspectrum Spec(A)=[λ 12 ,...,λ n ] .

步骤S5:根据所述待选检测目标和所述邻接特征谱确定检测目标,具体包括:Step S5: Determine the detection target according to the to-be-selected detection target and the adjacent feature spectrum, specifically including:

步骤S51:根据所述邻接特征谱确定欧式距离,具体公式为:Step S51: Determine the Euclidean distance according to the adjacent feature spectrum, and the specific formula is:

Ds=|Spec(A)-Spec(0)|;D s = |Spec(A)-Spec(0)|;

其中,Spec(A)为邻接特征谱,Spec(0)为训练得到的初始特征谱,所述初始特征谱是根据标定的参数确定得出的。Wherein, Spec(A) is the adjacent feature spectrum, and Spec(0) is the initial feature spectrum obtained by training, and the initial feature spectrum is determined according to the calibrated parameters.

步骤S52:判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。Step S52: judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, then the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is not within the distance Within the set threshold, the key point corresponding to the candidate detection target is released.

图2为本发明实施例显微图像目标检测系统结构图,如图2所示,本发明还提供一种基于深度几何特征谱的显微图像目标检测系统,所述系统包括:FIG. 2 is a structural diagram of a microscopic image target detection system according to an embodiment of the present invention. As shown in FIG. 2 , the present invention also provides a microscopic image target detection system based on depth geometric feature spectrum, and the system includes:

训练集构建模块1,用于构建训练集,所述训练集包括多张带有标记的显微图像;A training set construction module 1, used for constructing a training set, the training set includes a plurality of labeled microscopic images;

漏斗网络确定模块2,用于根据所述训练集训练得到带有参数的漏斗网络;The funnel network determination module 2 is used to obtain the funnel network with parameters according to the training set;

热图输出模块3,用于将待检测的显微图像输入到带有参数的所述漏斗网络,输出待检测的显微图像对应的四张极值点热图和中心点热图;所述四张极值点热图分别为上、下、左、右四个方向热图;The heat map output module 3 is used for inputting the microscopic image to be detected into the funnel network with parameters, and outputting four extreme point heatmaps and center point heatmaps corresponding to the microscopic image to be detected; the The four extreme point heatmaps are up, down, left, and right direction heatmaps;

参数确定模块4,用于根据所述四张极值点热图和所述中心点热图确定待选检测目标和邻接特征谱;A parameter determination module 4, configured to determine the target to be detected and the adjacent feature spectrum according to the four extreme point heatmaps and the center point heatmap;

检测目标确定模块5,用于根据所述待选检测目标和所述邻接特征谱确定检测目标。The detection target determination module 5 is configured to determine the detection target according to the candidate detection target and the adjacent feature spectrum.

下面对各个模块进行详细论述:Each module is discussed in detail below:

所述漏斗网络确定模块2,具体包括:The funnel network determination module 2 specifically includes:

漏斗网络构建单元,用于基于全卷积网络构建漏斗网络;The funnel network construction unit is used to build a funnel network based on a fully convolutional network;

参数更新单元,用于从所述训练集中选取设定数目的带有标记的显微图像输入至所述漏斗网络进行训练,在局部损失和修正损失监督下,采用反向传播算法更新所述漏斗网络中的参数;A parameter updating unit, used for selecting a set number of labeled microscopic images from the training set and inputting them to the funnel network for training, and under the supervision of local loss and correction loss, the funnel is updated by back-propagation algorithm parameters in the network;

第一判断单元,用于判断迭代次数是否大于或等于迭代次数阈值;如果所述迭代次数大于或等于迭代次数阈值,则将所述漏斗网络的参数输出;如果迭代次数小于迭代次数阈值,则返回“参数更新单元”。The first judgment unit is used to judge whether the number of iterations is greater than or equal to the threshold of the number of iterations; if the number of iterations is greater than or equal to the threshold of the number of iterations, output the parameters of the funnel network; if the number of iterations is less than the threshold of the number of iterations, return "Parameter Update Unit".

参数确定模块4,具体包括:Parameter determination module 4, which specifically includes:

提取单元,用于提取各极值点热图中的全部极值点,并分别放置与各极值点热图对应的集合内;所述极值点为n×n滑动窗口中的极大值,其中n为选定的窗口宽度像素值。The extraction unit is used to extract all extreme points in each extreme point heat map, and place them in the set corresponding to each extreme point heat map; the extreme point is the maximum value in the n×n sliding window , where n is the selected window width pixel value.

关键点确定单元,用于从各集合中任选一个极值点组成关键点;The key point determination unit is used to select an extreme point from each set to form a key point;

中心点确定单元,用于根据所述关键点计算中心点;a center point determination unit for calculating the center point according to the key point;

像素值确定单元,用于在所述中心点热图上确定所述中心点对应的像素值;a pixel value determination unit, configured to determine the pixel value corresponding to the center point on the center point heat map;

第二判断单元,用于判断所述像素值是否大于或等于像素设定阈值;如果所述像素值小于像素设定阈值,则去除所述关键点,返回“关键点确定单元”;如果所述像素值大于或等于像素设定阈值,则将所述关键点和所述中心点作为待选检测目标;The second judgment unit is used to judge whether the pixel value is greater than or equal to the pixel setting threshold; if the pixel value is less than the pixel setting threshold, remove the key point and return to the "key point determination unit"; If the pixel value is greater than or equal to the pixel setting threshold, the key point and the center point are used as the detection target to be selected;

加权图构建单元,用于根据所述关键点构建加权图;a weighted graph construction unit for constructing a weighted graph according to the key points;

邻接矩阵确定单元,用于根据所述加权图确定邻接矩阵;an adjacency matrix determining unit for determining an adjacency matrix according to the weighted graph;

邻接特征谱确定单元,用于根据所述邻接矩阵确定邻接特征谱。An adjacency feature spectrum determining unit, configured to determine an adjacency feature spectrum according to the adjacency matrix.

检测目标确定模块5,具体包括:The detection target determination module 5 specifically includes:

欧式距离确定单元,用于根据所述邻接特征谱确定欧式距离;an Euclidean distance determining unit for determining the Euclidean distance according to the adjacent feature spectrum;

第三判断单元,用于判断所述欧式距离是否在距离设定阈值内;如果所述欧式距离在距离设定阈值内,则该所述关键点对应待选检测目标为检测目标;如果所述欧式距离不在距离设定阈值内,则解除该所述关键点对应待选检测目标。The third judging unit is used to judge whether the Euclidean distance is within the distance setting threshold; if the Euclidean distance is within the distance setting threshold, the key point corresponding to the candidate detection target is the detection target; if the Euclidean distance is within the distance setting threshold If the Euclidean distance is not within the distance setting threshold, the key point corresponding to the candidate detection target is released.

本发明使用Olympus IX53型号显微镜采集的弓形虫、锥虫、巴贝斯虫三种寄生虫和一种细胞核,共四个数据集,即四个训练集,利用本发明设定的方法分别对四种显微图像进行测试,得到测试结果如下:图3为本发明实施例检测目标为细胞核的检测图,图4为本发明实施例检测目标为锥虫的检测图,图5为本发明实施例检测目标为弓形虫的检测图,图6为本发明实施例检测目标为巴贝斯虫的检测图,在细胞核、巴贝虫、弓形虫和锥虫四种数据集上分别取得90.2%、69.3%、70.2%和95.9%的识别精度,平均测试耗时为11.5秒,达到了显微图像自动化识别的要求。The present invention uses the three kinds of parasites and one kind of cell nucleus of Toxoplasma gondii, trypanosome and Babesia collected by Olympus IX53 microscope, there are four data sets in total, namely four training sets. The microscopic images are tested, and the test results are as follows: FIG. 3 is a detection diagram of an embodiment of the present invention in which the detection target is a cell nucleus, FIG. 4 is a detection diagram of a trypanosome as the detection target in an embodiment of the present invention, and FIG. 5 is a detection diagram of an embodiment of the present invention. The detection map of the target is Toxoplasma gondii, and FIG. 6 is the detection map of the detection target of Babesia according to the embodiment of the present invention, and obtained 90.2%, 69.3%, 90.2%, 69.3%, The recognition accuracy is 70.2% and 95.9%, and the average test time is 11.5 seconds, which meets the requirements of automatic recognition of microscopic images.

本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的系统而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method.

本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处。综上所述,本说明书内容不应理解为对本发明的限制。The principles and implementations of the present invention are described herein using specific examples. The descriptions of the above embodiments are only used to help understand the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the present invention There will be changes in the specific implementation and application scope. In conclusion, the contents of this specification should not be construed as limiting the present invention.

Claims (10)

1, A microscopic image target detection method based on depth geometric characteristic spectrum, characterized in that the method comprises:
step S1: constructing a training set, wherein the training set comprises a plurality of microscopic images with marks;
step S2: training according to the training set to obtain a funnel network with parameters;
step S3: inputting the microscopic image to be detected into the funnel network with parameters, and outputting four extreme point heat maps and a central point heat map corresponding to the microscopic image to be detected; the four extreme point heat maps are respectively an upper direction heat map, a lower direction heat map, a left direction heat map and a right direction heat map;
step S4: determining a detection target to be selected and an adjacent characteristic spectrum according to the four extreme point heat maps and the central point heat map;
step S5: and determining a detection target according to the detection target to be selected and the adjacent characteristic spectrum.
2. The method for detecting the target of the microscopic image based on the depth geometric feature spectrum of claim 1, wherein the training according to the training set to obtain the funnel network with parameters specifically comprises:
step S21: constructing a funnel network based on the full convolution network;
step S22: selecting a set number of marked microscopic images from the training set, inputting the images into the funnel network for training, and updating parameters in the funnel network by adopting a back propagation algorithm under the supervision of local loss and correction loss;
step S23: judging whether the iteration times are larger than or equal to an iteration time threshold value or not; if the iteration times are larger than or equal to the iteration time threshold value, outputting the parameters of the funnel network; if the number of iterations is less than the iteration number threshold, the process returns to step S22.
3. The method for detecting microscopic image targets based on depth geometric feature spectrum according to claim 1, wherein the determining of the target to be detected and the adjacent feature spectrum according to the four extreme point heat maps and the central point heat map specifically comprises:
step S41: extracting all extreme points in each extreme point heat map, and respectively placing the extreme points in a set corresponding to each extreme point heat map;
step S42, selecting extreme points from each set to form key points;
step S43: calculating a central point according to the key points;
step S44: determining pixel values corresponding to the central points on the central point heat map;
step S45: judging whether the pixel value is larger than or equal to a pixel set threshold value; if the pixel value is smaller than the pixel set threshold, removing the key point, and returning to the step S42; if the pixel value is larger than or equal to a pixel setting threshold value, taking the key point and the central point as a detection target to be selected;
step S46: constructing a weighted graph according to the key points;
step S47: determining an adjacency matrix according to the weighted graph;
step S48: determining a adjacency feature spectrum according to the adjacency matrix.
4. The method for detecting the microscopic image target based on the depth geometric feature spectrum of claim 1, wherein the determining the detection target according to the target to be detected and the adjacent feature spectrum specifically comprises:
step S51: determining Euclidean distance according to the adjacent characteristic spectrum;
step S52: judging whether the Euclidean distance is within a distance setting threshold value; if the Euclidean distance is within a distance setting threshold, the key point corresponds to a detection target to be selected and is taken as a detection target; and if the Euclidean distance is not within the distance setting threshold, removing the key point corresponding to the target to be detected.
5. The method of claim 3, wherein the extreme point is a maximum in an n x n sliding window, where n is a selected window width pixel value.
A system for detecting a target in a microscopic image based on a depth geometric characteristic spectrum, the system comprising:
the training set constructing module is used for constructing a training set, and the training set comprises a plurality of microscopic images with marks;
the funnel network determining module is used for obtaining a funnel network with parameters according to the training set;
the heat map output module is used for inputting the microscopic image to be detected into the funnel network with parameters and outputting four extreme point heat maps and a central point heat map corresponding to the microscopic image to be detected; the four extreme point heat maps are respectively an upper direction heat map, a lower direction heat map, a left direction heat map and a right direction heat map;
the parameter determining module is used for determining a detection target to be selected and an adjacent characteristic spectrum according to the four extreme point heat maps and the central point heat map;
and the detection target determining module is used for determining a detection target according to the detection target to be selected and the adjacent characteristic spectrum.
7. The system for detecting the target of the microscopic image based on the depth geometric feature spectrum of claim 6, wherein the funnel network determination module specifically comprises:
the funnel network construction unit is used for constructing a funnel network based on the full convolution network;
the parameter updating unit is used for selecting a set number of marked microscopic images from the training set, inputting the microscopic images into the funnel network for training, and updating parameters in the funnel network by adopting a back propagation algorithm under the supervision of local loss and correction loss;
and the th judging unit is used for judging whether the iteration times is more than or equal to the iteration time threshold, outputting the parameters of the funnel network if the iteration times is more than or equal to the iteration time threshold, and returning to the parameter updating unit if the iteration times is less than the iteration time threshold.
8. The system for detecting the target of the microscopic image based on the depth geometric feature spectrum of claim 1, wherein the parameter determining module specifically comprises:
the extraction unit is used for extracting all extreme points in each extreme point heat map and respectively placing the extreme points in a set corresponding to each extreme point heat map;
the key point determining unit is used for forming key points by optionally extreme points in each set;
a central point determining unit for calculating a central point according to the key point;
a pixel value determination unit for determining pixel values corresponding to the central points on the central point heat map;
a second judgment unit configured to judge whether the pixel value is greater than or equal to a pixel setting threshold; if the pixel value is smaller than the pixel set threshold, removing the key point, and returning to a key point determining unit; if the pixel value is larger than or equal to a pixel setting threshold value, taking the key point and the central point as a detection target to be selected;
the weighted graph constructing unit is used for constructing a weighted graph according to the key points;
an adjacency matrix determination unit for determining an adjacency matrix according to the weighted graph;
and the adjacent characteristic spectrum determining unit is used for determining an adjacent characteristic spectrum according to the adjacent matrix.
9. The system for detecting the target of the microscopic image based on the depth geometric feature spectrum of claim 6, wherein the detection target determining module specifically comprises:
the Euclidean distance determining unit is used for determining the Euclidean distance according to the adjacent characteristic spectrum;
a third judging unit, configured to judge whether the euclidean distance is within a distance setting threshold; if the Euclidean distance is within a distance setting threshold, the key point corresponds to a detection target to be selected and is taken as a detection target; and if the Euclidean distance is not within the distance setting threshold, removing the key point corresponding to the target to be detected.
10. A depth geometry feature spectrum based microscopy image target detection system according to claim 8 wherein the extreme point is a maximum in an n x n sliding window, where n is a selected window width pixel value.
CN201910977216.6A 2019-10-15 2019-10-15 A method and system for microscopic image target detection based on depth geometric feature spectrum Active CN110738254B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910977216.6A CN110738254B (en) 2019-10-15 2019-10-15 A method and system for microscopic image target detection based on depth geometric feature spectrum

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910977216.6A CN110738254B (en) 2019-10-15 2019-10-15 A method and system for microscopic image target detection based on depth geometric feature spectrum

Publications (2)

Publication Number Publication Date
CN110738254A true CN110738254A (en) 2020-01-31
CN110738254B CN110738254B (en) 2022-03-25

Family

ID=69269331

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910977216.6A Active CN110738254B (en) 2019-10-15 2019-10-15 A method and system for microscopic image target detection based on depth geometric feature spectrum

Country Status (1)

Country Link
CN (1) CN110738254B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311601A (en) * 2020-03-26 2020-06-19 深圳极视角科技有限公司 Segmentation method and device for spliced image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109800631A (en) * 2018-12-07 2019-05-24 天津大学 Fluorescence-encoded micro-beads image detecting method based on masked areas convolutional neural networks
CN109858333A (en) * 2018-12-20 2019-06-07 腾讯科技(深圳)有限公司 Image processing method, device, electronic equipment and computer-readable medium
CN109858386A (en) * 2019-01-09 2019-06-07 深圳市趣方科技有限公司 A kind of microalgae cell recognition methods based on fluorescence microscope images
WO2019110567A1 (en) * 2017-12-05 2019-06-13 Ventana Medical Systems, Inc. Method of computing tumor spatial and inter-marker heterogeneity

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019110567A1 (en) * 2017-12-05 2019-06-13 Ventana Medical Systems, Inc. Method of computing tumor spatial and inter-marker heterogeneity
CN109800631A (en) * 2018-12-07 2019-05-24 天津大学 Fluorescence-encoded micro-beads image detecting method based on masked areas convolutional neural networks
CN109858333A (en) * 2018-12-20 2019-06-07 腾讯科技(深圳)有限公司 Image processing method, device, electronic equipment and computer-readable medium
CN109858386A (en) * 2019-01-09 2019-06-07 深圳市趣方科技有限公司 A kind of microalgae cell recognition methods based on fluorescence microscope images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
XINGYI ZHOU ET AL.: "Bottom-up Object Detection by Grouping Extreme and Center Points", 《ARXIV:1901.08043V3》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311601A (en) * 2020-03-26 2020-06-19 深圳极视角科技有限公司 Segmentation method and device for spliced image
CN111311601B (en) * 2020-03-26 2023-10-13 山东极视角科技股份有限公司 Segmentation method and device for spliced image

Also Published As

Publication number Publication date
CN110738254B (en) 2022-03-25

Similar Documents

Publication Publication Date Title
CN110599448B (en) Migratory learning lung lesion tissue detection system based on MaskScoring R-CNN network
Zhao et al. A deep learning-based approach for refined crack evaluation from shield tunnel lining images
CN107092870B (en) A kind of high resolution image Semantic features extraction method
CN107506761B (en) Brain image segmentation method and system based on saliency learning convolutional neural network
CN111325750B (en) Medical image segmentation method based on multi-scale fusion U-shaped chain neural network
WO2023015743A1 (en) Lesion detection model training method, and method for recognizing lesion in image
CN104244802B (en) Image processing apparatus, image processing method and image processing program
CN109559320A (en) Realize that vision SLAM semanteme builds the method and system of figure function based on empty convolution deep neural network
CN112700434B (en) Medical image classification method and classification device thereof
CN107680678A (en) Based on multiple dimensioned convolutional neural networks Thyroid ultrasound image tubercle auto-check system
CN107743225B (en) A Method for No-Reference Image Quality Prediction Using Multi-Layer Depth Representations
CN110135354A (en) A Change Detection Method Based on Real-Scene 3D Model
Mountrakis et al. Enhancing and replacing spectral information with intermediate structural inputs: A case study on impervious surface detection
CN113569724A (en) Road extraction method and system based on attention mechanism and dilated convolution
CN111209918A (en) Image saliency target detection method
CN117437201A (en) A road crack detection method based on improved YOLOv7
CN113516771B (en) A method for extracting building change features based on real-life 3D models
CN109858451A (en) A kind of non-cooperation hand detection method
CN112862860B (en) Object perception image fusion method for multi-mode target tracking
CN116884623A (en) Medical rehabilitation prediction system based on laser scanning imaging
CN112465821A (en) Multi-scale pest image detection method based on boundary key point perception
CN112419306A (en) Lung nodule detection method based on NAS-FPN
Long et al. Depth completion towards different sensor configurations via relative depth map estimation and scale recovery
CN111968147A (en) Breast cancer pathological image comprehensive analysis system based on key point detection
CN112258495A (en) Building wood crack identification method based on convolutional neural network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant