Disclosure of Invention
The application aims to provide a method and a device for adjusting blood vessel extraction, so as to realize low-time-consumption optimized adjustment of blood vessel extraction and improve the repair efficiency of blood vessel extraction.
In a first aspect, an embodiment of the present application provides a method for adjusting blood vessel extraction, where the method includes:
determining a missing blood vessel with a partial deletion from a blood vessel extraction, wherein the missing blood vessel is connected with other blood vessels in the blood vessel extraction; determining a blood vessel most relevant to the missing blood vessel from all isolated blood vessels extracted from the blood vessel, wherein the isolated blood vessel is not connected with the other blood vessels; and drawing the missing part of the missing blood vessel in the blood vessel extraction according to the most relevant blood vessel.
In the embodiment of the application, the blood vessel most relevant to the partially missing blood vessel is determined from all isolated blood vessels extracted from the blood vessel, so that the missing part of the missing blood vessel can be automatically generated according to the most relevant blood vessel, the blood vessel extraction can be optimized and adjusted without manual drawing of a user, and therefore, the time consumption is short, and the repair efficiency is high.
With reference to the first aspect, in a first possible implementation manner, determining a blood vessel most relevant to the missing blood vessel from isolated blood vessels extracted from the blood vessels includes:
determining isolated vessels related to the missing vessel in all the isolated vessels extracted from the vessel;
acquiring an included angle between each isolated blood vessel related to the deleted blood vessel and the deleted blood vessel;
and determining the isolated blood vessel with the largest included angle, wherein the isolated blood vessel with the largest included angle is the most relevant blood vessel.
In the present embodiment, since the trend of the artery is generally smooth, the isolated vessel with a larger included angle is more likely to be a part of the missing vessel. Therefore, the isolated blood vessel with the largest included angle is determined to be the blood vessel most related to the missing blood vessel, and the optimization and adjustment of blood vessel extraction can be more accurately realized.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, acquiring an included angle between each isolated blood vessel related to the deleted blood vessel and the deleted blood vessel includes:
generating a first fitted line segment for each isolated vessel associated with the missing vessel, and generating a second fitted line segment for the missing vessel;
determining the included angle between each of the first fitted line segments and the second fitted line segment.
In the embodiment of the application, because the blood vessel is generally provided with a radian, the fitted line segment of the generated blood vessel can reflect the trend of the blood vessel more accurately. Therefore, the included angle between the first fitted line segment and the second fitted line segment can be determined more accurately to determine the included angle between the isolated blood vessel and the missing blood vessel.
With reference to the first possible implementation manner of the first aspect, in a third possible implementation manner, determining an isolated vessel related to the missing vessel in all the isolated vessels extracted by the vessel includes:
obtaining a minimum distance between each isolated vessel of the all isolated vessels in the vessel extraction and the missing vessel;
and determining the isolated blood vessel with the minimum distance smaller than a preset distance, wherein the isolated blood vessel with the minimum distance smaller than the preset distance is the isolated blood vessel related to the missing blood vessel.
In the present embodiment, if two blood vessels are spaced too far apart, then the two blood vessels are less likely to be correlated. Therefore, isolated blood vessels with the minimum distance smaller than the preset distance are determined, and isolated blood vessels which are unlikely to be related can be screened out to avoid redundant calculation.
With reference to the first aspect, in a fourth possible implementation manner, determining a blood vessel most relevant to the missing blood vessel from all isolated blood vessels extracted from the blood vessel includes:
acquiring a preset correlation score of each isolated blood vessel in all the isolated blood vessels and the missing blood vessel;
and determining the isolated blood vessel with the highest preset correlation score, wherein the isolated blood vessel with the highest preset correlation score is the most relevant blood vessel.
In the embodiment of the application, the preset relevant score of each isolated blood vessel and the missing blood vessel can be determined in the process of generating the blood vessel extraction, so that the most relevant blood vessel can be directly determined according to the preset relevant score in the optimization and adjustment of the blood vessel extraction, the calculation amount in the optimization and adjustment of the blood vessel extraction is reduced, and the optimization and adjustment speed of the blood vessel extraction is improved.
With reference to any one of the possible implementation manners of the first aspect, in a fifth possible implementation manner, the drawing a missing part of the missing blood vessel in the blood vessel extraction according to the most relevant blood vessel includes:
determining a connection path between the most relevant vessel and the missing vessel;
drawing the missing part connecting the most relevant vessel and the missing vessel in the vessel extraction along the connecting path.
In the embodiment of the present application, since the missing part is drawn along the connection path, the drawn missing part can be more accurate.
In a second aspect, an embodiment of the present application provides a method for adjusting blood vessel extraction, where the method includes:
determining a plurality of crossed blood vessels from the blood vessel extraction;
acquiring an included angle between each blood vessel and a reference line, wherein the direction of the reference line is matched with the trend direction of the artery in the blood vessel extraction;
and deleting the blood vessel with the largest included angle from the blood vessel extraction.
In the embodiment of the present application, the included angle between the arteries is small because the arteries have almost the same trend direction, i.e. from the top of the organ to the end of the organ. Based on this, among a plurality of blood vessels which form intersections in the blood vessel extraction, the blood vessel with the largest included angle is likely to be a vein. Therefore, the blood vessel extraction with the largest included angle is deleted from the blood vessel extraction, namely, the blood vessel extraction is optimally adjusted by deleting veins.
With reference to the second aspect, in a first possible implementation manner, determining a plurality of intersecting blood vessels from blood vessel extraction includes:
responding to selection operation of a user, and determining a point position selected by the user from the blood vessel extraction;
and when the point location is determined to be a blood vessel intersection point in the blood vessel extraction, determining the plurality of blood vessels connected with the point location from the blood vessel extraction.
In the embodiment of the application, the veins in a plurality of blood vessels are automatically deleted only by selecting the intersection point by the user, so that the rapid and efficient optimization adjustment of blood vessel extraction is realized.
In a third aspect, an embodiment of the present application provides an adjustment apparatus for blood vessel extraction, where the apparatus includes:
a blood vessel determining module, configured to determine a missing blood vessel with a partial missing part from a blood vessel extraction, where the missing blood vessel is connected to other blood vessels in the blood vessel extraction; and further for determining a vessel most relevant to the missing vessel from all isolated vessels extracted from the vessel, wherein the isolated vessel is not connected to the other vessels;
and the blood vessel drawing module is used for drawing the missing part of the missing blood vessel in the blood vessel extraction according to the most relevant blood vessel.
With reference to the third aspect, in a first possible implementation manner,
the blood vessel determination module is further used for determining isolated blood vessels related to the missing blood vessel in all the isolated blood vessels extracted from the blood vessel; acquiring an included angle between each isolated blood vessel related to the deleted blood vessel and the deleted blood vessel; and determining the isolated blood vessel with the largest included angle, wherein the isolated blood vessel with the largest included angle is the most relevant blood vessel.
With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner,
the vessel determination module is further configured to generate a first fitted line segment of each isolated vessel associated with the missing vessel, and generate a second fitted line segment of the missing vessel; determining the included angle between each of the first fitted line segments and the second fitted line segment.
With reference to the first possible implementation manner of the third aspect, in a third possible implementation manner,
the blood vessel determination module is further configured to obtain a minimum distance between each isolated blood vessel of the all isolated blood vessels in the blood vessel extraction and the missing blood vessel; and determining the isolated blood vessel with the minimum distance smaller than a preset distance, wherein the isolated blood vessel with the minimum distance smaller than the preset distance is the isolated blood vessel related to the missing blood vessel.
With reference to the third aspect, in a fourth possible implementation manner,
the blood vessel determining module is further configured to obtain a preset correlation score between each isolated blood vessel of the all isolated blood vessels and the missing blood vessel; and determining the isolated blood vessel with the highest preset correlation score, wherein the isolated blood vessel with the highest preset correlation score is the most relevant blood vessel.
With reference to any one of the possible implementations of the third aspect, in a fifth possible implementation,
the vessel mapping module is further configured to determine a connection path between the most relevant vessel and the missing vessel; drawing the missing part connecting the most relevant vessel and the missing vessel in the vessel extraction along the connecting path.
In a fourth aspect, an embodiment of the present application provides an adjustment apparatus for blood vessel extraction, the apparatus including:
the blood vessel determining module is used for determining a plurality of blood vessels forming the intersection from the blood vessel extraction; the device is also used for acquiring an included angle between each blood vessel and a reference line, wherein the direction of the reference line is matched with the trend direction of the artery in the blood vessel extraction;
and the blood vessel deleting module is used for deleting the blood vessel with the largest included angle from the blood vessel extraction.
With reference to the fourth aspect, in a first possible implementation manner,
the blood vessel determining module is further used for responding to selection operation of a user and determining a point position selected by the user from the blood vessel extraction; and when the point location is determined to be a blood vessel intersection point in the blood vessel extraction, determining the plurality of blood vessels connected with the point location from the blood vessel extraction.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: the processor is connected with the memory;
the memory is used for storing programs;
the processor is configured to invoke and execute the program to perform the blood vessel extraction adjustment method according to the first aspect or any one of the possible implementation manners of the first aspect.
In a sixth aspect, the present application provides a non-transitory computer-readable storage medium, which stores program code, and when the program code is executed by a computer, the method for adjusting blood vessel extraction according to the first aspect or any possible implementation manner of the first aspect is performed.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Detailed Description
The technical solution in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, an embodiment of the present application provides a method for adjusting blood vessel extraction, where the method for adjusting blood vessel extraction may be performed by an electronic device, and the electronic device may be a terminal or a server, where the terminal may be a Personal Computer (PC), a tablet computer, a smart phone, a Personal Digital Assistant (PDA), or the like; the server may be a web server, a database server, a cloud server, or a server assembly composed of a plurality of sub servers, etc.
Specifically, the blood vessel extraction adjustment method may include: step S100, step S200, and step S300.
Step S100: and determining a deleted blood vessel with a part of deletion from the blood vessel extraction, wherein the deleted blood vessel is connected with other blood vessels in the blood vessel extraction.
Step S200: and determining a blood vessel most relevant to the deleted blood vessel from all isolated blood vessels extracted from the blood vessel, wherein the isolated blood vessel is not connected with the other blood vessels.
Step S300: and drawing the missing part of the missing blood vessel in the blood vessel extraction according to the most relevant blood vessel.
The flow of the adjustment method of the blood vessel extraction will be described in detail below with reference to fig. 2A and 2B. The blood vessel extraction may refer to image reconstruction of arteries enclosed in various organs, for example, the organs may be heart, lung, liver, kidney, or the like. Since the adjustment principle of the method for blood vessel extraction of various devices is approximately the same, for the sake of understanding, the present embodiment will be described by taking an organ as a heart as an example. Since the artery on the heart is a coronary artery, for the purpose of achieving the accurate description, the term "coronary artery" will be used for description in the following, that is, the coronary artery described in this embodiment can be understood as an artery.
The electronic device may acquire a plurality of CT images of different cross sections of the heart from a network or from other devices (e.g., CT devices), for example, 180 and 240 CT images may be acquired. These CT images may be presented as cardiac slices at different cross-sectional depths in the same direction (which is equivalent to stacking the CT images to form a complete heart). Since the plurality of CT images contain substantially all of the details of the coronary arteries wrapped around the heart, the electronic device can map the vessel extraction using the plurality of CT images. The blood vessel extraction can be a three-dimensional model or a two-dimensional model, and can be selected according to actual requirements.
In the process of drawing the blood vessel extraction, the electronic device may draw some isolated blood vessels in the blood vessel extraction because the identification of the coronary features in each CT image by the electronic device is not one hundred percent accurate, for example, veins in the CT image interfere with the identification.
It will be appreciated that in practice the blood pumped by the heart is shunted through the aorta to the coronary arteries which supply the heart itself with blood, and each coronary artery is connected to the aorta at the apex of the heart. Since the veins in the heart function to return blood supplied to the heart to the main vein at the apex of the heart, each vein in the heart is connected to the main vein at the apex of the heart, and is not connected to the aorta.
Since these isolated blood vessels are drawn without being connected to other blood vessels in the blood vessel extraction, it is not determined whether these isolated blood vessels can be connected to the aorta, and thus it is not determined whether these isolated blood vessels themselves are veins or coronary arteries. Therefore, in the process that the electronic equipment draws the blood vessel, the electronic equipment can retain the drawn isolated blood vessel in the blood vessel extraction, so that the blood vessel extraction can be optimized and adjusted based on the isolated blood vessel.
For example, as shown in fig. 2A, fig. 2A shows an example diagram of a drawn blood vessel extraction a. The present embodiment will explain the method of the present application by way of an example. In the blood vessel extraction a, the upper end of the model is the aorta a1, and several isolated blood vessels, which are isolated blood vessel B1, isolated blood vessel B2, isolated blood vessel B3 and isolated blood vessel B4, are also present in the blood vessel extraction a.
Based on the optimized adjustment of the drawn blood vessel extraction, the electronic device may start to perform step S100.
Step S100: and determining a deleted blood vessel with a part of deletion from the blood vessel extraction, wherein the deleted blood vessel is connected with other blood vessels in the blood vessel extraction.
In the case that the electronic device has a display capability, the electronic device may extract the drawn blood vessel and display the blood vessel on its own display interface. Of course, the manner of displaying by the electronic device itself is not limited, for example, the blood vessel extraction that the electronic device can draw is sent to other devices with display capability, so that the display interface of the devices with display capability can display the blood vessel extraction.
By observing the blood vessel extraction displayed on the display interface, the user can know which blood vessels are partially missing in the blood vessel extraction. The user can interact with the electronic device, so that the electronic device determines the missing blood vessel with partial missing on the blood vessel extraction.
For example, the user can click or touch the end of the display interface where the missing blood vessel is absent by mouse click. Correspondingly, the electronic equipment can judge whether the position clicked by the user in the blood vessel extraction is the end part of the blood vessel by obtaining the clicking operation of the user.
If the electronic device determines that the blood vessel is not the end of the blood vessel, the electronic device may not respond to the clicking operation of the user because the operation of the user is not intended to determine the missing blood vessel.
If the electronic device determines that the end of the blood vessel represents that the operation of the user aims to determine the missing blood vessel, the electronic device can determine the missing blood vessel according to the position clicked by the user in the blood vessel extraction.
As an exemplary way to determine the missing blood vessel, the electronic device may analyze the blood vessel where the tip is located with the tip as a starting point to determine whether the blood vessel where the tip is located extends to another blood vessel in the blood vessel extraction, where the other blood vessel may be any one of the blood vessels in the blood vessel extraction that is directly or indirectly connected to the aorta in the blood vessel extraction. Wherein, the vessel being directly connected to the aorta means that one end of the vessel is directly connected, and the vessel being indirectly connected to the aorta means that one end of the vessel is connected to another vessel directly connected to the aorta.
If it is determined that the connection does not extend to any other blood vessel in the blood vessel extraction, which indicates that the blood vessel in which the tip is located is an isolated blood vessel rather than a missing blood vessel, the electronic device may not respond to the click operation of the user.
If it is determined that the blood vessel extending to the other blood vessels in the blood vessel extraction indicates that the blood vessel in which the tip is located is a missing blood vessel, the electronic device may determine a blood vessel intersection point closest to the blood vessel distance value of the tip from the blood vessel extraction and determine a blood vessel located between the closest blood vessel intersection point and the tip. The blood vessel between the nearest blood vessel intersection point and the end part is a missing blood vessel, and the blood vessel distance value represents a length value of a path generated by moving the blood vessel.
In this embodiment, in order to facilitate the user to clearly know the missing blood vessel, the electronic device may further respond to a click operation of the user, and highlight the determined missing blood vessel on the display interface.
Please refer to fig. 2A, and continue the foregoing example. If the user clicks N points in the blood vessel extraction a by mouse clicking or touch clicking, the electronic device may determine that the N points are the end points of the blood vessel. On the basis, the electronic device can further determine that the blood vessel where the endpoint N is located can extend to be connected with the aorta a1, so as to determine that the blood vessel where the endpoint N is located is a missing blood vessel. The electronic device can determine that the blood vessel distance value between the intersection point M and the endpoint N is closest by analyzing each intersection point in the blood vessel extraction a, and the electronic device can determine the missing blood vessel Q located between the intersection point M and the endpoint N. For convenience of understanding, the endpoint N may be understood as one end N where the missing blood vessel Q is missing, and the intersection M may be understood as one end M where the missing blood vessel Q forms an intersection.
After determining the missing blood vessel, the electronic device may continue to perform step S200.
Step S200: and determining a blood vessel most relevant to the deleted blood vessel from all isolated blood vessels extracted from the blood vessel, wherein the isolated blood vessel is not connected with the other blood vessels.
Based on the determined missing vessel, the electronic device needs to determine the vessel that is most relevant to the missing vessel from all isolated vessels in the vessel extraction in order to repair the missing vessel based on the most relevant vessel.
In the blood vessel extraction, the distance between an isolated blood vessel and a missing blood vessel is too far, and the possibility that the isolated blood vessel and the missing blood vessel are connected in practice is very small. Therefore, in the process of determining the most relevant blood vessels, isolated blood vessels with too far distances can be screened out, sample data of the isolated blood vessels participating in correlation calculation is reduced, and the calculation amount of the electronic equipment is reduced.
As an exemplary way to screen out isolated blood vessels with too far distance, if the electronic device calculates the minimum distance between each isolated blood vessel and the missing blood vessel in all the isolated blood vessels during the process of drawing the blood vessel extraction, the electronic device may directly obtain the minimum distance between each isolated blood vessel and the missing blood vessel. If the distance calculation is not performed in the process of drawing the blood vessel extraction, the electronic device may calculate the minimum distance between each isolated blood vessel and the missing blood vessel. The electronic equipment compares the minimum distance between each isolated blood vessel and the missing blood vessel with a preset distance, and determines the isolated blood vessel of which the minimum distance is smaller than the preset distance, wherein the isolated blood vessel of which the minimum distance is smaller than the preset distance is a blood vessel which is possibly connected with the missing blood vessel in practice, namely the isolated blood vessel of which the minimum distance is smaller than the preset distance is also related to the missing blood vessel.
Continuing with FIG. 2A, the foregoing example is continued. By comparison of the distances, the electronics can determine that the isolated blood vessel B3 and isolated blood vessel B4 are a preset distance beyond the distance from the missing blood vessel Q, the electronics determine that isolated blood vessel B1 is isolated blood vessel B1 associated with the missing blood vessel Q, and isolated blood vessel B2 is isolated blood vessel B2 associated with the missing blood vessel Q.
After identifying isolated vessels that are associated with the missing vessel, the electronic device can further identify the most relevant vessels. Because the trend direction of the coronary artery is from the aorta to the end of the heart in a regular way, if the same coronary artery is divided into a plurality of parts, the included angle between any two parts is larger. However, the veins are disorganized in the transverse and longitudinal directions on the heart, so the angle between the veins and the coronary artery is usually smaller. Thus, the most relevant vessel can be determined by determining the size of the angle between each isolated vessel associated with the missing vessel and the missing vessel.
As an exemplary way of determining the most relevant blood vessels by calculating the included angle, since the blood vessels are more tortuous, the direct calculation of the included angle of the blood vessels itself may be less accurate, so that the fitting line segments of the blood vessels can be determined, and then the included angle between the blood vessels can be more accurately determined by calculating the included angle between the fitting line segments.
In this embodiment, the electronic device may generate a first fitted line segment for each isolated vessel associated with the missing vessel, and generate a second fitted line segment for the missing vessel.
As one way of generating a fitted line segment, the electronic device may generate a first fitted line segment with the two endpoints of the isolated vessel associated with the missing vessel as the two endpoints of the line segment, and generate a second fitted line segment with the two endpoints of the missing vessel as the two endpoints of the line segment. By adopting the method, the endpoint can be conveniently and quickly determined, so that the fitting line segment can be conveniently and quickly generated.
As another way of generating the fitted line segment, due to the tortuous nature of the blood vessel, generating the fitted line segment with the two end points of the blood vessel may not yet reflect the trend of the blood vessel most accurately, so the electronic device may generate the fitted line segment with the two points located in the blood vessel as the two end points, for example, with the two trisected points of the blood vessel as the two end points. Based on this, the electronic device may generate a first fitted line segment with the two trisections in the isolated vessel associated with the missing vessel as the two endpoints of the line segment, and generate a second fitted line segment with the two trisections in the missing vessel as the two endpoints of the line segment.
Based on generating the first fitted line segment and the second fitted line segment, the electronic device may determine an included angle between each first fitted line segment and the second fitted line segment, thereby determining an isolated blood vessel having a largest included angle, which is a blood vessel most related to the missing blood vessel.
In this embodiment, in order to facilitate the user to clearly know the most relevant blood vessel, the electronic device may further continue to respond to the click operation of the user, and highlight the determined most relevant blood vessel on the display interface.
Please refer to fig. 2A and 2B, which are combined to continue the foregoing example. The electronics can determine a first fitted line segment B11 of the isolated blood vessel B1, determine a first fitted line segment B21 of the isolated blood vessel B2, and determine a second fitted line segment Q1 of the missing blood vessel Q. Further, the electronic device can determine an angle α 1 between the first fitted line segment B11 and the second fitted line segment Q1, and an angle α 2 between the first fitted line segment B21 and the second fitted line segment Q1. Clearly, the magnitude of angle α 1 is less than the magnitude of angle α 2, and thus, the electronics can determine isolated vessel B2 as the most relevant vessel B2.
It will be appreciated that in practical implementation, the manner of determining the most relevant blood vessels is not limited to the above manner, and for example, in the drawing process of the blood vessel extraction, the electronic device determines the angle between each isolated blood vessel in all isolated blood vessels and each other blood vessel in the blood vessel extraction, and determines the minimum distance between each isolated blood vessel and each other blood vessel in the blood vessel extraction, wherein each other blood vessel may be each blood vessel connected with the aorta in the blood vessel extraction. Thus, the electronic device can determine the preset relevant score of each isolated blood vessel and each other blood vessel by using the minimum distance and the included angle between each isolated blood vessel and each other blood vessel, wherein the smaller the minimum distance is and the larger the included angle is, the higher the corresponding preset relevant score is, and the weight occupied by the minimum distance in the calculation can be larger than the weight occupied by the included angle in the calculation, so that the determined preset relevant score is more accurate, for example, the weight of the minimum distance is 0.7, and the weight of the included angle is 0.3. On this basis, in the process of executing step S200, the electronic device may directly obtain the preset correlation score between each isolated blood vessel of all the isolated blood vessels and the missing blood vessel, so as to determine the isolated blood vessel with the highest preset correlation score, and the isolated blood vessel with the highest preset correlation score may be the most relevant blood vessel.
It will also be understood that the most relevant vessel represents the vessel that is most likely to actually connect to the missing vessel, but does not represent a certain connection. Thus, the determined most relevant vessel may also be the wrong vessel, e.g. the determined most relevant vessel is in practice a vein. If the user finds that the most relevant blood vessel highlighted on the display interface is the wrong blood vessel, the user can manually select the most relevant blood vessel from all the isolated blood vessels through interaction with the electronic device, for example, the user clicks other isolated blood vessels in all the isolated blood vessels through mouse clicking or touch clicking, and the electronic device determines the other isolated blood vessels clicked by the user as the most relevant blood vessels according to clicking operation of the user. In this way, the electronic device may no longer highlight the most relevant vessel in the display interface, automatically determining the most relevant vessel, and highlighting the most relevant vessel selected by the user.
And after determining the most relevant blood vessel, the electronic device may proceed to step S300.
Step S300: and drawing the missing part of the missing blood vessel in the blood vessel extraction according to the most relevant blood vessel.
In this embodiment, the missing part of the missing blood vessel may be drawn automatically or manually, which will be described separately below.
Aiming at the automatic drawing mode:
the electronic equipment can be provided with a deep neural network, and the deep neural network is trained by utilizing training data of partial missing coronary artery, so that the deep neural network can draw the missing part of the coronary artery more and more accurately. The accuracy of the deep neural network in drawing the coronary missing part reaches more than 95%, for example, the deep neural network is considered to be trained well and can be put into practical application.
On the basis, the electronic equipment can input the data of the missing blood vessel and the data of the most relevant blood vessel in the blood vessel extraction into the trained deep neural network, so that the deep neural network can output the data of the missing part connecting the missing blood vessel and the most relevant blood vessel. The electronic device runs the data of the missing part in the blood vessel extraction, so that the missing part connecting the most relevant blood vessel and the missing blood vessel can be drawn in the blood vessel extraction.
For the manual drawing mode:
the user can draw a connection path between the most relevant blood vessel and the missing blood vessel in the display interface by controlling the mouse or performing touch operation. Accordingly, the electronic device can determine a connection path connecting the most relevant blood vessel and the missing blood vessel in the blood vessel extraction based on the drawing operation of the user. Therefore, the electronic equipment can draw the most relevant blood vessel and the missing part of the missing blood vessel in the blood vessel extraction along the determined connection path.
Further, if the user determines that all of the missing blood vessels in the blood vessel extraction have been repaired, the user may input an instruction indicating the end of the repair of the missing blood vessels to the electronic device. If isolated blood vessels still exist in the blood vessel extraction, the electronic equipment can delete the remaining isolated blood vessels in the blood vessel extraction according to the instruction.
In addition, since the electronic device does not recognize the coronary features in each CT image at one hundred percent accuracy, for example, the veins in the CT image interfere with the recognition, the electronic device may draw some redundant veins connected with the coronary in the blood vessel extraction. Therefore, the electronic equipment can not only repair the coronary artery with partial deletion, but also delete the redundant veins connected with the coronary artery in the blood vessel extraction.
Referring to fig. 3, fig. 3 shows a flow of a method for removing unnecessary veins by the blood vessel extraction adjustment method of the present application, where the method may include: step S101, step S201, and step S301.
Step S101: a plurality of blood vessels forming the intersection are determined from the blood vessel extraction.
Step S201: and acquiring an included angle between each blood vessel and a reference line, wherein the direction of the reference line is matched with the trend direction of the coronary artery in the blood vessel extraction.
Step S301: and deleting the blood vessel with the largest included angle from the blood vessel extraction.
Step S101, step S201 and step S301 will be described in detail with reference to fig. 4A and 4B, wherein, in order to facilitate understanding of the present solution with reference to the foregoing embodiment, the blood vessel extraction C shown in fig. 4A is a model obtained after the repair of the blood vessel extraction a with a missing blood vessel shown in fig. 2A is completed.
Step S101: a plurality of blood vessels forming the intersection are determined from the blood vessel extraction.
Since there are intersections formed by multiple coronary arteries in the blood vessel extraction, which makes it difficult for the electronic device to determine whether the multiple blood vessels forming the intersections are the intersections formed by the multiple coronary arteries or the intersections formed by the coronary arteries and veins, the electronic device cannot determine which of the multiple blood vessels forming the intersections need to delete the veins therein. Therefore, the electronic device can correspondingly determine a plurality of crossed blood vessels of which the veins need to be deleted by responding to the determination operation of the user.
As an exemplary way of determining a plurality of intersecting blood vessels in which veins need to be deleted, the user can know a plurality of blood vessels in which coronary arteries and veins intersect in blood vessel extraction by observing the blood vessel extraction displayed on the display interface. The user may select an intersection point of a plurality of blood vessels where the coronary artery and the vein form an intersection on the display interface by mouse clicking or touch clicking.
Accordingly, the electronic device may obtain and respond to the user's selection operation to determine the user-selected point from the blood vessel extraction. Further, the electronic device may also determine whether the selected point location is a blood vessel intersection in the blood vessel extraction.
If the electronic device determines that the blood vessel intersection is not a blood vessel intersection, which indicates that the purpose of the operation by the user is not to determine a plurality of blood vessels forming the intersection, the electronic device may not perform subsequent processing.
If the electronic device determines that the blood vessel intersection points indicate that the user operates to determine a plurality of blood vessels intersecting the veins of the blood vessel intersection points, the electronic device determines a plurality of blood vessels connected to the point from the blood vessel extraction, and the plurality of blood vessels connected to the point are the plurality of blood vessels intersecting the veins of the blood vessel intersection points. The manner of determining the plurality of blood vessels may be the manner of determining blood vessels at intersection points and end points described in the foregoing embodiments, and will not be described in detail here.
Of course, in order to make the user clearly know the intersecting blood vessels, the electronic device may highlight the intersecting blood vessels on the display interface.
Please refer to fig. 4A, and continue the foregoing example. If the user clicks the O point in the blood vessel extraction C by mouse click or touch, the electronic device may determine that the O point is the intersection of the two blood vessels. On this basis, the electronic device may further determine the blood vessel X1 and the blood vessel X2 connected to the blood vessel intersection O.
After determining the plurality of blood vessels forming the intersection, the electronic device may continue to perform step S201.
Step S201: and acquiring an included angle between each blood vessel and a reference line, wherein the direction of the reference line is matched with the trend direction of the coronary artery in the blood vessel extraction.
Also, since the trend direction of the coronary artery is regularly directed from the aorta to the end of the heart, the electronic device can preset a reference line directed from the aorta to the end of the heart. The coronary artery will have a relatively small angle to the reference line and the vein will have a relatively large angle to the reference line.
Then based on the set reference line, the electronic device can obtain the angle of each blood vessel from the reference line. The method for obtaining the included angle may adopt the aforementioned method of fitting a line segment, and will not be described here again.
Step S301: and deleting the blood vessel with the largest included angle from the blood vessel extraction.
Correspondingly, based on the included angle between each blood vessel and the reference line, the electronic device can determine the blood vessel with the largest included angle, delete the relevant data of the blood vessel with the largest included angle from the data extracted from the blood vessels, delete the blood vessel with the largest included angle from the blood vessels, and delete the redundant veins connected with the coronary artery.
Of course, the way of deleting the blood vessel from the blood vessel extraction in the present embodiment is not limited to the way described in the embodiment. For example, it is also possible to employ: the user selects all the blood vessels needing to be deleted in the blood vessel extraction in a frame in the display interface by controlling a mouse or performing touch operation, so that the electronic equipment can delete the blood vessels selected by the user in the frame from the blood vessel extraction.
Please refer to fig. 4A and 4B, which continue the foregoing example. The electronics can determine a line segment X11 that fits the blood vessel X1 and determine a line segment X21 that fits the blood vessel X2. Further, the electronic device can determine an angle β 1 between the fitted line segment X11 and the reference line L, and determine an angle β 2 between the fitted line segment X21 and the reference line L. Clearly, the size of angle β 1 is smaller than the size of angle β 2, and thus, the electronic device may determine that blood vessel X2 is a vein and delete it.
Referring to fig. 5, embodiments of the present application provide an electronic device 10, based on the same inventive concept, the electronic device 10 may include one or more processors 11 for executing program instructions, a bus 12, and a memory 13 in different forms, such as a disk, a ROM, or a RAM, or any combination thereof. Illustratively, the computer platform may also include program instructions stored in ROM, RAM, or other types of non-transitory storage media, or any combination thereof.
The memory 13 is used for storing a program, and the processor 11 is used for calling and running the program in the memory 13 to execute the aforementioned adjustment method for blood vessel extraction.
Referring to fig. 6, an embodiment of the present application provides an adjusting apparatus 100 for blood vessel extraction, where the adjusting apparatus 100 for blood vessel extraction is applied to an electronic device, and the adjusting apparatus 100 for blood vessel extraction includes:
a blood vessel determining module 110, configured to determine a missing blood vessel with a partial missing part from a blood vessel extraction, wherein the missing blood vessel is connected to other blood vessels in the blood vessel extraction; and further for determining a blood vessel most relevant to the missing blood vessel from all isolated blood vessels extracted from the blood vessel, wherein the isolated blood vessel is not connected to the other blood vessels.
A vessel drawing module 120, configured to draw a missing part of the missing blood vessel in the blood vessel extraction according to the most relevant blood vessel.
Optionally, the blood vessel determining module 110 is further configured to determine a plurality of blood vessels forming a cross from the blood vessel extraction; and the included angle between each blood vessel and a reference line is obtained, wherein the direction of the reference line is matched with the trend direction of the coronary artery in the blood vessel extraction.
Optionally, the adjustment apparatus 100 for blood vessel extraction may further include:
a vessel deleting module 130, configured to delete the vessel with the largest included angle from the vessel extraction.
It should be noted that, as those skilled in the art can clearly understand, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Some embodiments of the present application further provide a computer-readable storage medium of a non-volatile program code executable by a computer, where the program code is stored on the computer-readable storage medium, and when the program code is executed by the computer, the method for adjusting blood vessel extraction according to any of the above embodiments is performed.
In detail, the storage medium can be a general-purpose storage medium, such as a removable disk, a hard disk, or the like, and when the program code on the storage medium is executed, the steps of the blood vessel extraction adjustment method of the above embodiment can be executed.
The program code product of the adjustment method for blood vessel extraction provided in the embodiment of the present application includes a computer-readable storage medium storing the program code, and instructions included in the program code may be used to execute the method in the foregoing method embodiment, and specific implementation may refer to the method embodiment, and details are not described here again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In summary, the blood vessel most relevant to the missing blood vessel with partial missing is determined from all isolated blood vessels extracted from the blood vessel, so that the missing part of the missing blood vessel can be automatically generated according to the most relevant blood vessel, and the blood vessel extraction can be optimized and adjusted without drawing by a user, so that the time consumption is short, and the repair efficiency is high.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.