US20110028850A1 - Process for quantitative display of blood flow - Google Patents
Process for quantitative display of blood flow Download PDFInfo
- Publication number
- US20110028850A1 US20110028850A1 US12/462,038 US46203809A US2011028850A1 US 20110028850 A1 US20110028850 A1 US 20110028850A1 US 46203809 A US46203809 A US 46203809A US 2011028850 A1 US2011028850 A1 US 2011028850A1
- Authority
- US
- United States
- Prior art keywords
- blood flow
- tissue
- image
- set forth
- vascular region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000017531 blood circulation Effects 0.000 title claims abstract description 82
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000008569 process Effects 0.000 title description 3
- 210000004204 blood vessel Anatomy 0.000 claims abstract description 67
- 230000002792 vascular Effects 0.000 claims abstract description 36
- 210000004369 blood Anatomy 0.000 claims abstract description 14
- 239000008280 blood Substances 0.000 claims abstract description 13
- 239000002872 contrast media Substances 0.000 claims abstract description 11
- 238000012937 correction Methods 0.000 claims description 14
- 230000002596 correlated effect Effects 0.000 claims description 6
- 238000003708 edge detection Methods 0.000 claims description 5
- 230000005855 radiation Effects 0.000 claims 2
- 238000004458 analytical method Methods 0.000 claims 1
- 230000001502 supplementing effect Effects 0.000 claims 1
- 230000006399 behavior Effects 0.000 description 9
- 238000011156 evaluation Methods 0.000 description 8
- 239000007850 fluorescent dye Substances 0.000 description 7
- 238000005259 measurement Methods 0.000 description 6
- 238000003745 diagnosis Methods 0.000 description 5
- 230000003321 amplification Effects 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 238000001356 surgical procedure Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000001454 recorded image Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000000975 dye Substances 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003702 image correction Methods 0.000 description 1
- 230000010412 perfusion Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000004451 qualitative analysis Methods 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/026—Measuring blood flow
- A61B5/0261—Measuring blood flow using optical means, e.g. infrared light
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/026—Measuring blood flow
- A61B5/0275—Measuring blood flow using tracers, e.g. dye dilution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
- G06T2207/30104—Vascular flow; Blood flow; Perfusion
Definitions
- the invention relates to a quantitative method for the representation (display) of the blood flow in a patient.
- a chromophore such as indocyaninin green, for example.
- the fluorescent dye can be observed as it spreads in the tissue or along the blood vessels using a video camera. Depending on the area of application, the observation can be non-invasive or in the course of surgery, via the camera of a surgical microscope.
- the objective forming the basis of the invention is to provide medical professionals with additional aids from which they can draw conclusions concerning blood flow problems and that can support making a diagnosis.
- the contrast agent flowing into the tissue or vascular area is observed by recording the signal emitted by said contrast agent as a video, by splitting the video into individual images and storing the same, or by storing individual images directly, and by determining a quantity that is derived from the respective signal for several corresponding image areas, in particular image points of the individual images, said quantity being characteristic for the blood flow, in order to generate a two-dimensional representation based on the quantity determined for the image areas.
- an additional quantity is derived at the same time for each image area, with said quantity being characteristic for the position of the vessel, and being superimposed in the representation onto the determined quantity that is characteristic for the blood flow.
- the quantities can be determined in succession or at the same time.
- the respective image areas of the individual images can be the same local image point or image area, that is, a number of adjacent image points, if different individual images have been taken with the same resolution of exactly the same detail of the object, or according to the invention in one advantageous embodiment can also be image points or image areas in different individual images that are assigned to each other because the recording conditions have changed between the recordings, for example, object and shooting direction have moved in relation to each other or the resolution has been changed or the like. This will be explained in greater detail in a later section.
- the image area of several individual images is the outcome of assigning one respective image area of each individual image to the respective image area of the following individual image.
- a quantity or value is determined from the values that are obtained from the respective corresponding image areas of the individual images, with said quantity or value being characteristic for the blood flow in this image area as well as a quantity or a value that is characteristic for the position of the blood vessels in this image area.
- the obtained quantities are superimposed for this image area and are represented as superimposed quantities within the image area.
- the injected contrast agent is a fluorescent dye, such as indocyaninin green, for example.
- other dyes known for perfusion diagnostics can be used as well.
- the excitation of the fluorescence for generating the signal to be obtained occurs typically via a near infrared light source.
- An infrared camera which is often a CCD camera or a CMOS camera and which can be an autonomous medical device or can be integrated in a surgical microscope, is used for recording.
- the generation of the individual images of the signals that are to be analyzed occurs either by splitting a continuous video into individual images or directly through storing recorded individual images in certain time sequences, which may be stored as a bitmap, for example.
- the superimposed representation provides a valuable aid to the treating person in order to recognize flow blockages or constrictions and also to assign them reliably to individual vessels. It is, therefore a very important new diagnosis aid.
- more than two signals can be superimposed in the context of the invention as well. However, it would be advantageous to use a binary signal as a third signal or as the third quantity after the evaluation of the signal.
- the quantity characteristic for the blood flow and the quantity characteristic for the position of the blood vessels are superimposed for the image points to be represented.
- the value of a shown image point is a combination of a quantity over the blood flow and a quantity over the position of the blood vessels. Due to the fact that the information for both the position and the blood flow enter the image point, the individual image point presents the entire information necessary for a diagnosis such that the treating physician has all the information available and can make an evaluation.
- a weighted addition to the superimposition of the two quantities derived from the obtained signal is carried out.
- a weighting factor preferably, the weighting factors add up to one
- This type of superimposition can be used particularly advantageously when a false color image and a grayscale image, for example a time offset representation and a blood vessel representation shall be represented superimposed.
- the inflow behavior of the blood is made transparent via the time offset display realized in false color, and the position of the blood vessels into which the blood flows is added via the grayscale contrast of the blood vessel display obtained from the totality of the individual images.
- the full available color range remains intact.
- the inflow behavior can also be represented in a differentiated manner as is the case in the time offset display alone; the blood vessels can be localized additionally.
- other quantities that describe the blood flow such as the blood flow index, for example, which shows a measure for the volume flow of the blood, can be represented advantageously for each image point in color, and can be superimposed with a preferably grayscale image that specifies the position of the blood vessels to facilitate the orientation.
- both quantities can be represented particularly advantageously at the same time quantitatively in each image point yet can still be distinguishable separately.
- the two quantities are selected during the superimposition according to a third derived quantity that serves as a control quantity.
- a third derived quantity that serves as a control quantity.
- the value of the control quantity either the value of the one or the other quantity or also another value is entered at each image point of the superimposed representation.
- Suitable as quantities to be used are all derived quantities of the individual images or the individual images themselves that are suitable for superimposing.
- the blood vessel position itself or an edge image of the blood vessel representation using an edge detection method can be used as the control quantity.
- the edge image provides a particularly good overview of the position of the blood vessels and is particularly well suited for overlaying because it offers the option of entering a fixed value at the image points that are associated with edges, i.e., where the quantity that is characteristic for the position exceeds a certain threshold value, with said fixed value displaying the position of the blood vessels, while the value for the quantity that is characteristic for the blood flow can be entered at all other image points.
- the position of the blood vessels can also be displayed via the superimposition using recordings of a color video that is often recorded at surgical microscopes parallel to the infrared video.
- the superimposition is carried out in the context of a three-dimensional representation.
- the quantity characteristic for the blood flow can be represented in a two-dimensional fashion and the quantity characteristic for the position of the blood vessels can be inserted as a third dimension.
- the preferred representation is a perspective visualization. A three-dimensional representation may be less familiar to view and may appear more complex at a first glance; however, it definitely can integrate the entire information contents of both quantities.
- the quantities are shown on different axes of a suitable color space.
- a suitable color space is an HSL color space, where hue, saturation and luminance are plotted in relation to each other.
- One quantity can be expressed via the hue and the other via the luminance.
- the third axis of the color space can be held constant or can even be used for a superimposition with a third quantity.
- the time offset can be viewed as a quantity that is characteristic for the blood flow and is particularly well suited for this type of superimposed representation. This is the quantity that shows when the blood flows into which area and that is advantageously determined based on exceeding a threshold value for the luminance of the fluorescence signal. Often, the blood flows at the same time into blood vessels located within close proximity or into a blood vessel and the surrounding tissue. For this reason, it is not possible to perceive these areas optically separated in an exclusive representation of the time offset. Thus, a superimposition with a quantity that expresses the position of the bloods vessels is particularly important in these cases.
- An additional quantity for which the superimposition can be employed advantageously is the blood flow index. Similar blood vessels that are in close proximity to each other often exhibit a similar flow behavior. Here too it is often not possible to perceive them as separate blood vessels in a pure blood flow index representation. The resolution of the individual blood vessels and their exact position can only be recognized when the blood flow index is superimposed with a quantity that is characteristic for the blood vessel position.
- the false color scale is selected such that an intuitive correlation to known anatomical terms exists.
- the arterial character is emphasized by representing early points in time, i.e., small time offsets, in red while the venous character of other areas is emphasized by representing later points in time, i.e., large time offsets, in blue.
- the false color image is adjusted directly to a common manner of thinking of the treating persons, and thus provides them with a very intuitive direct overview.
- the superimposed representation is done in the form of a grayscale image.
- information is lost in the superimposed representation; however, the embodiment is suited for black-and-white reproduction.
- one signal is preferably realized as a binary value.
- the superimposition of the quantity that is characteristic for the blood vessel position is preferably selected as an edge image. This image provides sufficient contrast to be recognized in a grayscale image.
- the reference image that has been derived from all individual images with relevant data also reproduces excellently the position of the blood vessels. It is, therefore, ideally suited as a quantity for the blood vessel position and thus as a quantity for superimposition. Thus, a quantity can be used for the superimposition that occurs already at the movement compensation with no need for deriving an additional quantity.
- a brightness correction is applied to the individual images that takes into account changes in the recording conditions that affect the brightness of the signal.
- the amplification factor at the camera can be adjusted such that a greater contrast range of the signal can be captured during recording.
- the intensity of the light source or other recording conditions can be adjusted as well such that the brightness correction may need to take several different parameters into account.
- changes in the recording conditions are stored together with the individual images, and during the brightness correction, the recorded signal values are converted to a common value range taking into account these stored data. This ensures that steady signal progression occurs at every image point.
- FIG. 1 shows a schematic sequence of a method for representing the blood flow.
- FIG. 2 shows an example of a sequence of a brightness plot at one image point.
- FIGS. 4 a and b show examples of a time offset representation of false color representations converted to grayscale and as a grayscale image.
- FIGS. 5 a, b , and c show examples of a time offset representation, a blood vessel representation and a superimposition of these two representations.
- FIG. 8 shows schematically a surgical microscope for carrying out the method according to the invention.
- the data of the corrected individual images 4 are than stored in the form of compressed binary data (e.g., Motion JPEG2000 Data (MJ2)) or in the form of non-compressed binary data (e.g., bitmap).
- compressed binary data e.g., Motion JPEG2000 Data (MJ2)
- non-compressed binary data e.g., bitmap
- numerous other representations 14 comprising individual results as well, can be supplied from these brightness plots 12 and the individual images 4 . They can then be represented on the screen together with the individual images 4 .
- FIG. 4 a shows the onset time of the blood flow in a color representation transferred into grayscale, whereby the bars on the right side show the false color scale, the relationship between the selected colors and the respective relapsed time.
- the false color scale is selected such that an intuitive correlation to known anatomic terms exists. Accordingly, red is selected for an earlier point in time in order to emphasize the arterial character and blue for a later point in time to accent the venous character.
- the color scale thus transitions from red (here at about 2.5 sec) to green (here at about 5 sec) and finally to blue (here at about 7 sec).
- a similar representation 14 of a time offset in place of a false color image has been implemented as a grayscale image with a grayscale for black and white representations as are necessary here, for example, or also for black-and-white screens. This can be seen in FIG. 4 b .
- blood vessels into which the blood with the fluorescent dye flows immediately are shown dark while the blood vessels that the blood reaches later are shown very brightly.
- the grayscale representation has less information contents compared to the false color representation.
- a brightness plot 12 is computed for each image point based on all individual images 4 of the video. Then the point in time t 1 at which the brightness plot 12 has exceeded a certain threshold value I(t 1 ) is determined for each image point.
- the brightness plot is not steady such that several I max and I min could arise in each brightness plot 12 .
- a steady plot would also not arise for recording devices where the recording conditions may change during the recording of the individual images 4 and where the changes affect the brightness of the recorded individual images 4 . Changes in the recording conditions may be necessary, for example, whenever a greater contrast range is to be covered.
- the superimposition is weighted, i.e., one portion G 1 each of the time offset is added to a portion G 2 of the blood vessel representation, where the portions G 1 and G 2 build a sum of One.
- FIG. 6 shows a superimposition of a time offset representation as a grayscale image as described in FIG. 4 b and of an edge image.
- the edge image is obtained from the blood vessel representation using an edge detection method.
- the superimposition is carried out by entering the value of the time offset at the image points where no edges appear, while entering a fixed value at image points where edges are present.
- the vessels appear more complete the lower the selected threshold value for the edges are.
- the selected threshold is very high because the drawing shall only illustrate the principle. This representation provides a very clear overview over the path of the vessels and the blood flow that occurs in them.
- FIG. 7 One example for a superimposition in the form of a 3D representation can be seen in FIG. 7 .
- FIG. 8 shows schematically the essential components of a surgical microscope that can be used to apply the method according to the invention.
- the optics 15 of a surgical microscope reproduces an object 17 , for example the head of a patient that is to be treated during surgery and is illuminated by a light source 16 in a camera 18 .
- the camera 18 can also be a component of the surgical microscope.
- the image data recorded by the camera 18 are transferred to a computer unit 19 where they are evaluated. Medical quantities derived at the evaluation are then represented on the screen 20 , potentially together with the recorded image.
- the screen 20 can be a component of the central surgical control but can also be a component of the surgical microscope.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Hematology (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
Description
- The invention relates to a quantitative method for the representation (display) of the blood flow in a patient.
- Several methods for observing and determining the blood flow in tissue and vascular regions are known in which a chromophore such as indocyaninin green, for example, is applied. The fluorescent dye can be observed as it spreads in the tissue or along the blood vessels using a video camera. Depending on the area of application, the observation can be non-invasive or in the course of surgery, via the camera of a surgical microscope.
- Many methods are known, where only the relative distribution of the fluorescent dye in the tissue or in the blood vessels is examined qualitatively in order to draw conclusions concerning their blood flow. For example, conclusions were drawn about the blood flow and diagnoses provided by watching an IR video recorded during surgery. It is also known to record the rise in brightness of the fluorescence signal over time at all or at selected image points and in this manner record a time chart of the signal emitted by the fluorescent dye. The profile of the recorded formation plot provides the physician with information about potential vascular constrictions or other problems in the area of this image point. One example for this is provided in DE 101 20 980 A1. However, the method described in the DE 101 20 980 A1 goes beyond the qualitative analysis and embarks on a path towards a quantitative determination of the blood flow at every image point.
- The objective forming the basis of the invention is to provide medical professionals with additional aids from which they can draw conclusions concerning blood flow problems and that can support making a diagnosis.
- This objective, as well as other objectives which will become apparent from the discussion that follows, are achieved, according to the present invention, by the method and apparatus described below.
- According to the invention, the contrast agent flowing into the tissue or vascular area is observed by recording the signal emitted by said contrast agent as a video, by splitting the video into individual images and storing the same, or by storing individual images directly, and by determining a quantity that is derived from the respective signal for several corresponding image areas, in particular image points of the individual images, said quantity being characteristic for the blood flow, in order to generate a two-dimensional representation based on the quantity determined for the image areas. In order to ensure a better orientation and assignment of the vessels in the representation, an additional quantity is derived at the same time for each image area, with said quantity being characteristic for the position of the vessel, and being superimposed in the representation onto the determined quantity that is characteristic for the blood flow. The quantities can be determined in succession or at the same time. They can be stored individually and then superimposed or they can be superimposed directly and stored as a result for each image area. If the determined quantities can be used individually for diagnosis purposes, it is advantageous to store them individually and to superimpose them thereafter. In an ideal case, the respective image areas of the individual images can be the same local image point or image area, that is, a number of adjacent image points, if different individual images have been taken with the same resolution of exactly the same detail of the object, or according to the invention in one advantageous embodiment can also be image points or image areas in different individual images that are assigned to each other because the recording conditions have changed between the recordings, for example, object and shooting direction have moved in relation to each other or the resolution has been changed or the like. This will be explained in greater detail in a later section. The image area of several individual images is the outcome of assigning one respective image area of each individual image to the respective image area of the following individual image. A quantity or value is determined from the values that are obtained from the respective corresponding image areas of the individual images, with said quantity or value being characteristic for the blood flow in this image area as well as a quantity or a value that is characteristic for the position of the blood vessels in this image area. The obtained quantities are superimposed for this image area and are represented as superimposed quantities within the image area. Preferably, the injected contrast agent is a fluorescent dye, such as indocyaninin green, for example. However, other dyes known for perfusion diagnostics can be used as well. The excitation of the fluorescence for generating the signal to be obtained occurs typically via a near infrared light source. An infrared camera, which is often a CCD camera or a CMOS camera and which can be an autonomous medical device or can be integrated in a surgical microscope, is used for recording. The generation of the individual images of the signals that are to be analyzed occurs either by splitting a continuous video into individual images or directly through storing recorded individual images in certain time sequences, which may be stored as a bitmap, for example. The superimposed representation provides a valuable aid to the treating person in order to recognize flow blockages or constrictions and also to assign them reliably to individual vessels. It is, therefore a very important new diagnosis aid. Of course, more than two signals can be superimposed in the context of the invention as well. However, it would be advantageous to use a binary signal as a third signal or as the third quantity after the evaluation of the signal.
- Preferably, the quantity characteristic for the blood flow and the quantity characteristic for the position of the blood vessels are superimposed for the image points to be represented. The value of a shown image point is a combination of a quantity over the blood flow and a quantity over the position of the blood vessels. Due to the fact that the information for both the position and the blood flow enter the image point, the individual image point presents the entire information necessary for a diagnosis such that the treating physician has all the information available and can make an evaluation.
- In one exemplary embodiment, a weighted addition to the superimposition of the two quantities derived from the obtained signal is carried out. By multiplying each quantity prior to the addition by image points using a weighting factor (preferably, the weighting factors add up to one), it is possible to represent both quantities at the same time in a representation without receiving values that exceed the value range to be shown. This type of superimposition can be used particularly advantageously when a false color image and a grayscale image, for example a time offset representation and a blood vessel representation shall be represented superimposed. The inflow behavior of the blood is made transparent via the time offset display realized in false color, and the position of the blood vessels into which the blood flows is added via the grayscale contrast of the blood vessel display obtained from the totality of the individual images. The full available color range remains intact. The inflow behavior can also be represented in a differentiated manner as is the case in the time offset display alone; the blood vessels can be localized additionally. But also other quantities that describe the blood flow such as the blood flow index, for example, which shows a measure for the volume flow of the blood, can be represented advantageously for each image point in color, and can be superimposed with a preferably grayscale image that specifies the position of the blood vessels to facilitate the orientation. With this combination of a false color image for the quantity that is characteristic for the blood flow and a grayscale image for the quantity that is characteristic for the position of the blood vessels, where a color value is combined with a grayscale density value in each image point, both quantities can be represented particularly advantageously at the same time quantitatively in each image point yet can still be distinguishable separately.
- In an additional advantageous embodiment, the two quantities are selected during the superimposition according to a third derived quantity that serves as a control quantity. According to the value of the control quantity, either the value of the one or the other quantity or also another value is entered at each image point of the superimposed representation. In this manner, it is advantageously possible to indicate areas in the superimposed representation that are associated with blood vessels and areas outside of these in a different manner. Suitable as quantities to be used are all derived quantities of the individual images or the individual images themselves that are suitable for superimposing. In an advantageous manner, the blood vessel position itself or an edge image of the blood vessel representation using an edge detection method can be used as the control quantity. The edge image provides a particularly good overview of the position of the blood vessels and is particularly well suited for overlaying because it offers the option of entering a fixed value at the image points that are associated with edges, i.e., where the quantity that is characteristic for the position exceeds a certain threshold value, with said fixed value displaying the position of the blood vessels, while the value for the quantity that is characteristic for the blood flow can be entered at all other image points. As an alternative, the position of the blood vessels can also be displayed via the superimposition using recordings of a color video that is often recorded at surgical microscopes parallel to the infrared video.
- In an additional advantageous embodiment, the superimposition is carried out in the context of a three-dimensional representation. Preferably, the quantity characteristic for the blood flow can be represented in a two-dimensional fashion and the quantity characteristic for the position of the blood vessels can be inserted as a third dimension. The preferred representation is a perspective visualization. A three-dimensional representation may be less familiar to view and may appear more complex at a first glance; however, it definitely can integrate the entire information contents of both quantities.
- In an additional preferred embodiment, the quantities are shown on different axes of a suitable color space. Advantageous in this context is an HSL color space, where hue, saturation and luminance are plotted in relation to each other. One quantity can be expressed via the hue and the other via the luminance. The third axis of the color space can be held constant or can even be used for a superimposition with a third quantity. This representation also provides a good overview image that supports the treating person in making a diagnosis because the characteristic values for the blood flow as well as their relation to the blood vessels become readily apparent.
- The time offset can be viewed as a quantity that is characteristic for the blood flow and is particularly well suited for this type of superimposed representation. This is the quantity that shows when the blood flows into which area and that is advantageously determined based on exceeding a threshold value for the luminance of the fluorescence signal. Often, the blood flows at the same time into blood vessels located within close proximity or into a blood vessel and the surrounding tissue. For this reason, it is not possible to perceive these areas optically separated in an exclusive representation of the time offset. Thus, a superimposition with a quantity that expresses the position of the bloods vessels is particularly important in these cases.
- An additional quantity for which the superimposition can be employed advantageously is the blood flow index. Similar blood vessels that are in close proximity to each other often exhibit a similar flow behavior. Here too it is often not possible to perceive them as separate blood vessels in a pure blood flow index representation. The resolution of the individual blood vessels and their exact position can only be recognized when the blood flow index is superimposed with a quantity that is characteristic for the blood vessel position.
- In one advantageous embodiment of the invention, the time offset, that is the point in time at which the threshold value at the respective image point is exceeded, or the blood flow index is transferred into a color on a color scale such that a false color image is created based on which the flow behavior of the blood is visualized. A false color image provides a very quick and intuitive overview of the time successions. After the superimposition with a grayscale or edge image of the quantity that is characteristic for the blood vessel position, the inflow into each blood vessel can be viewed in a detailed manner.
- Preferably, the false color scale is selected such that an intuitive correlation to known anatomical terms exists. For example, the arterial character is emphasized by representing early points in time, i.e., small time offsets, in red while the venous character of other areas is emphasized by representing later points in time, i.e., large time offsets, in blue. In this manner, the false color image is adjusted directly to a common manner of thinking of the treating persons, and thus provides them with a very intuitive direct overview.
- In an additional preferred embodiment, the superimposed representation is done in the form of a grayscale image. Here, information is lost in the superimposed representation; however, the embodiment is suited for black-and-white reproduction. To avoid this, one signal is preferably realized as a binary value. For example, if the quantity that characterizes the blood flow is selected as a color representation that is converted to gray values, then the superimposition of the quantity that is characteristic for the blood vessel position is preferably selected as an edge image. This image provides sufficient contrast to be recognized in a grayscale image.
- Preferably, the maximum achieved intensity of the signal is determined as the quantity characteristic of the position of the blood vessel for each image area, preferably for each image point, in order to generate a two-dimensional representation of the total flow based on the maximum intensities determined for the image areas, i.e., the maximum signal value achieved in all areas, a so-called blood vessel representation. Since this maximum is reached at different times at the various image areas, this representation ensures an overview of the blood flow for all regions, which is not possible by viewing the individual images. Only then is a comprehensive overview provided for all areas with a blood flow. Until now, the physician had to view the recorded video several times in order to view the blood flow in different areas of the tissue or vascular region. This made it difficult to recognize if tissue areas had a poor blood flow or none at all. Due to the blood vessel representation according to the invention, the observer is able to recognize the maximum achieved concentration of the contrast agent at the same time at every point of the tissue or vascular region by viewing one single representation. Were the superimposition to occur with only one individual image, it would only be a snapshot, and regions might be recognized by mistake as having no blood vessels because blood does not yet flow through them at the given moment, even if blood does indeed flow through them at a later point in time. This is due to the fact that in such contrast agent recordings the blood vessels are recognized as such only when blood that contains contrast agents flows through these blood vessels. At a time when no contrast agent flows through them, the recording of a blood vessel shows no contrast and thus no quantity characteristic for the position of the blood vessel. Of course, another quantity that is a measure for a strong increase in the blood flow can be used instead of the signal maximum as well, For example, the added total flow can be used or a standard deviation that is a measure for the change in the blood flow or the like can be used. It is important that it is a quantity that reflects the blood flow having reached the maximum at a point in time and may then have dropped off again. However, to use the maximum itself is a particularly simple, unambiguous and therefore preferred method. An additional advantage of using the maximum is that it can be represented preferably with a low density, i.e., very bright, and in that the superimposed quantity for the blood flow is well visible in the color representation, for example.
- In one additional preferred embodiment, prior to determining the quantity that is characteristic for the blood flow or for the position of the blood vessels, a movement component is applied to the individual images preferably for all quantities that require viewing of several individual images. This means, the individual images are, if they are offset from each other, first placed on top of each such that indeed the respective associated image points can be compared when determining the points in time. The underlying problem here is that the recording unit or the object to be recorded may move during recording. In such a case, the recorded images of the signals will be, at least slightly, shifted in relation to each other, such that this shift must first be reversed if one plans to receive a steady signal progression for each image point of the recorded object. Such a steady signal progression is the prerequisite for determining in a spatially resolved manner the time when the threshold value of the signal or of any other quantity that is derived from the signal is exceed. Thus, without movement compensation, the points in time or the derived quantities could be assigned falsely to the image points and could lead to an erroneous representation of the time offset, blood flow index or other parameters. Preferably, the movement is compensated using edge detection, where edge images of the individual images are generated that can then be correlated in order to determine from it the shift vector. As soon as the shift vector of an individual image is determined, this individual image is shifted in relation to the previous image according to the shift vector. In one embodiment, the edge images of successive individual images are used for the correlation of the edge images. Preferably, however, the edge image of an individual image is correlated to a reference image that is generated by joining together the previous edge images that have already been correlated to each other. In the course of this process, this creates a reference image that includes all the edges that have occurred in the individual images that have been correlated before. Any individual image can be used as the starting reference image, or an image where the total image strength has exceeded a certain value or where it is determined in another fashion that the recorded signal has exceeded a noise level and is indeed the signal of the inflowing blood. Generating the summed up reference image is essential because individual images that are recorded at very different times can shown a totally different edge structure because the signal may have already flattened in one area when it reaches the maximum in another area. It would then not be possible to properly correlate these very different images that have been recorded at different points in time. The reference image that has been derived from all individual images with relevant data also reproduces excellently the position of the blood vessels. It is, therefore, ideally suited as a quantity for the blood vessel position and thus as a quantity for superimposition. Thus, a quantity can be used for the superimposition that occurs already at the movement compensation with no need for deriving an additional quantity.
- In another advantageous embodiment, a brightness correction is applied to the individual images that takes into account changes in the recording conditions that affect the brightness of the signal. For example, the amplification factor at the camera can be adjusted such that a greater contrast range of the signal can be captured during recording. The intensity of the light source or other recording conditions can be adjusted as well such that the brightness correction may need to take several different parameters into account. For this purpose, changes in the recording conditions are stored together with the individual images, and during the brightness correction, the recorded signal values are converted to a common value range taking into account these stored data. This ensures that steady signal progression occurs at every image point.
- For a full understanding of the present invention, reference should now be made to the following detailed description of the preferred embodiments of the invention as illustrated in the accompanying drawings.
-
FIG. 1 shows a schematic sequence of a method for representing the blood flow. -
FIG. 2 shows an example of a sequence of a brightness plot at one image point. -
FIGS. 3 a and b show examples of blood vessel representations without and with movement compensation. -
FIGS. 4 a and b show examples of a time offset representation of false color representations converted to grayscale and as a grayscale image. -
FIGS. 5 a, b, and c show examples of a time offset representation, a blood vessel representation and a superimposition of these two representations. -
FIG. 6 shows an example of a superimposition of a time offset representation and of an edge image of the vascular area. -
FIG. 7 shows an example of a superimposition of a time offset representation and of an edge image of the vascular area in a perspective, visualized, three-dimensional representation. -
FIG. 8 shows schematically a surgical microscope for carrying out the method according to the invention. - The preferred embodiments of the present invention will now be described with reference to
FIGS. 1-8 of the drawings. Identical elements in the various figures are designated with the same reference numerals. - The complete system with the data flows and the individual processing steps is described in
FIG. 1 and is used for representing and evaluating the blood flow. The data are recorded using a video camera 1 in the infrared range, which is arranged at the surgical microscope—not shown—or is a component thereof. The recorded infrared videos are stored in a data memory 2 and are split into individual images using avideo player 3. Alternatively, it is also possible to store the images of the video camera 1 asindividual images 4 from the outset. A frequency of fiveframes 4 per second proved to be useful. They are then corrected in a single image correction step. In the process, the corrections for the edge drop, of the dark offset or of non-linearities of the video camera 1 are carried out taking into account the requiredcorrection data 9. The data of the correctedindividual images 4 are than stored in the form of compressed binary data (e.g., Motion JPEG2000 Data (MJ2)) or in the form of non-compressed binary data (e.g., bitmap). In the case of non-compressed binary data, access times are shorter and the evaluation is faster. - For the evaluation, the
individual images 4 are transferred to the algorithms for thebrightness correction 6 andmovement correction 7. For thebrightness correction 6, for example, the different amplification factors that have been set at the video camera 1 are taken into account during recording in order to adapt the video camera 1 to the different fluorescence strength of the tissue or vascular area to be recorded. They are documented during the recording as well, are stored in the data memory 2 as metadata assigned to the video data and are computed with theindividual images 4. During themovement correction 7, the positions of the recordedindividual images 4 are aligned. The video camera 1 or the object, i.e., the tissue or vascular area may move during video recording. In such cases, theindividual images 4 are offset from each other. Thus, theindividual images 4 must be re-aligned in order to evaluate the details visible in the individual image without faults. This is exacerbated by the constantly changing image information in the individual images. To have an initial image for comparison purposes, a reference image is selected from among the individual images. The first image on which clear structures can be recognized can serve as an initial reference image. Using an edge detection method, allindividual images 4 that are to be computed with the reference image are continuously examined for their degree of offset in comparison to the reference image. This offset is taken into account in all additional steps where severalindividual images 4 are involved. In particular the reference image is continuously updated by integrating the edge image of the following individual image that is offset to the correct position into the reference image. - The
brightness determination 8 can be carried out following thecorrections measurement range determination 11. The measurement range for which the superimposed representation has to be generated can be defined in ameasurement range determination 11 via a measurement window or as a selection of specified measurement points. For example, a range of the recording can be selected if only this range is to have a superimposed representation, or if the quantities or the superimposition are to be generated for a portion of the image points only in order to save computing time. The result of thebrightness determination 8 is abrightness plot 12 as a function of the time as can be seen inFIG. 2 . Thisbrightness plot 12 is computed for all or at least for a sufficiently large sample of image points. - In an
evaluation 13, numerousother representations 14, comprising individual results as well, can be supplied from thesebrightness plots 12 and theindividual images 4. They can then be represented on the screen together with theindividual images 4. - One example for this is a so-called blood vessel representation, where all vessels in which fluorescent agents have flowed and all tissues through which fluorescence agents flowed appear in white. This representation is generated by representing the difference between the maximum and minimum brightness value for each image point of the superimposed
individual images 4. With this maximum brightness for each image point, one obtains a relative, quantitative quantity for the blood flow at all positions. This enables the physician to recognize defects. Examples for blood vessel representations can be seen inFIGS. 3 a and 3 b.FIG. 3 a shows a blood vessel representation that has been generated withoutmovement compensation 7, whileFIG. 3 b shows an example withmovement compensation 7. Clearly recognizable is the significantly better sharpness of the contours inFIG. 3 b with movement compensation. - A two-dimensional false color image representing the time offset is provided for an
additional representation 14. It can be seen inFIGS. 4 a and 4 b.FIG. 4 a shows the onset time of the blood flow in a color representation transferred into grayscale, whereby the bars on the right side show the false color scale, the relationship between the selected colors and the respective relapsed time. The false color scale is selected such that an intuitive correlation to known anatomic terms exists. Accordingly, red is selected for an earlier point in time in order to emphasize the arterial character and blue for a later point in time to accent the venous character. InFIG. 4 a, the color scale thus transitions from red (here at about 2.5 sec) to green (here at about 5 sec) and finally to blue (here at about 7 sec). In this manner, the physician receives a quick overview of the time when the blood arrived at which position of the blood vessel. Thus, using the time offset, information about the inflow and outflow of the blood in the blood vessels or in the tissue is made transparent. Because the transfer of the false color image into grayscale does not permit an unambiguous assignment of the colors, asimilar representation 14 of a time offset in place of a false color image has been implemented as a grayscale image with a grayscale for black and white representations as are necessary here, for example, or also for black-and-white screens. This can be seen inFIG. 4 b. Here, blood vessels into which the blood with the fluorescent dye flows immediately are shown dark while the blood vessels that the blood reaches later are shown very brightly. However, the grayscale representation has less information contents compared to the false color representation. - To generate the
representation 14, abrightness plot 12 is computed for each image point based on allindividual images 4 of the video. Then the point in time t1 at which thebrightness plot 12 has exceeded a certain threshold value I(t1) is determined for each image point. The threshold value is defined as I(t1)=Imin+0.2×(Imax−Imin). This point in time is converted to the respective color grayscale or height and entered into the time offset representation, Imax and Imin must be determined by comparing the recorded data of severalindividual images 4 in order to determine the threshold value I(t1). To obtain a spatially resolved signal, it is extremely important to carry out a movement compensation first. Withoutmovement compensation 7, the brightness plot is not steady such that several Imax and Imin could arise in eachbrightness plot 12. The same applies to thebrightness correction 6. Without abrightness correction 6, a steady plot would also not arise for recording devices where the recording conditions may change during the recording of theindividual images 4 and where the changes affect the brightness of the recordedindividual images 4. Changes in the recording conditions may be necessary, for example, whenever a greater contrast range is to be covered. - A problem in the qualitative and also quantitative representation of the blood flow, such as the time offset representation, for example, is that blood vessels or tissue regions that are close to each other often exhibit the same flow behavior and, therefore, melt into one region in the representation. In this manner, the flow behavior or the blood flow often can no longer be assigned unambiguously to one single vessel when viewing the representation. To re-enable this location assignment, a superimposition of a quantity that quantifies the blood flow at every image point and of a quantity that presents the position of the vessels is recommended in an additional representation as can be seen in
FIGS. 5 c, 6 and 7.FIG. 5 c shows a superimposition of a time offset representation shown inFIG. 5 a and explained based onFIG. 4 and a blood vessel representation shown inFIG. 5 b and explained based onFIG. 3 . The superimposition is weighted, i.e., one portion G1 each of the time offset is added to a portion G2 of the blood vessel representation, where the portions G1 and G2 build a sum of One. In the example ofFIG. 5 c, the superimposed representation is calculated as the superimposition=0.6×time offset representation+0.4×blood vessel representation. Although the representation shown inFIG. 5 a again does not allow for a precise assignment of the inflow behavior, because the false color image has been converted to a grayscale image, it is apparent that in this representation layout entire regions exhibit the same flow behavior and, therefore, cannot be assigned to individual vessels. This is different in the superimposition shown inFIG. 5 c. Here too the inflow behavior is represented by the color scale (here unfortunately converted to grayscale), however, it can be clearly localized due to the superimposed blood vessels and then can be assigned to the superimposed vessels. In this representation, both the moment in time of the inflow as well as the position of fine blood vessels is clearly recognizable. This can be seen even more clearly inFIG. 6 . It shows a superimposition of a time offset representation as a grayscale image as described inFIG. 4 b and of an edge image. The edge image is obtained from the blood vessel representation using an edge detection method. The superimposition is carried out by entering the value of the time offset at the image points where no edges appear, while entering a fixed value at image points where edges are present. The vessels appear more complete the lower the selected threshold value for the edges are. In the edge image that is superimposed inFIG. 6 , the selected threshold is very high because the drawing shall only illustrate the principle. This representation provides a very clear overview over the path of the vessels and the blood flow that occurs in them. - One example for a superimposition in the form of a 3D representation can be seen in
FIG. 7 . This again is a superimposition of an already described quantity, where the time offset representation enters as a false color image and the blood vessel representation expands in the fashion of a relief as a third dimension into the space. -
FIG. 8 shows schematically the essential components of a surgical microscope that can be used to apply the method according to the invention. Theoptics 15 of a surgical microscope reproduces anobject 17, for example the head of a patient that is to be treated during surgery and is illuminated by alight source 16 in acamera 18. Thecamera 18 can also be a component of the surgical microscope. The image data recorded by thecamera 18 are transferred to acomputer unit 19 where they are evaluated. Medical quantities derived at the evaluation are then represented on the screen 20, potentially together with the recorded image. Similar to thecomputer unit 19, the screen 20 can be a component of the central surgical control but can also be a component of the surgical microscope. Acontrol unit 21 controls the brightness of thelight source 16 as well as the magnification factor and the aperture of theoptics 15 and the amplification factor of thecamera 18. In addition, thecontrol unit 21 generates metadata that provide information about changes in the recording conditions that occur as soon as thecontrol unit 21 adjusts a quantity that is to be controlled. These metadata are transferred from thecontrol unit 21 to thecomputer unit 19, where they are assigned to the image data that have been provided to thecomputer unit 19 by thecamera 18. Metadata and image data are stored, at least temporarily, by thecomputer unit 19 and are evaluated according to the method according to the invention. During the evaluation, the metadata are included with the image data. The results of the evaluation according to the invention are then displayed on the display unit 20, possibly together with the image data. - There has thus been shown and described a novel method and apparatus for quantitative display of blood flow which fulfills all the objects and advantages sought therefor. Many changes, modifications, variations and other uses and applications of the subject invention will, however, become apparent to those skilled in the art after considering this specification and the accompanying drawings which disclose the preferred embodiments thereof. All such changes, modifications, variations and other uses and applications which do not depart from the spirit and scope of the invention are deemed to be covered by the invention, which is to be limited only by the claims which follow.
Claims (26)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/462,038 US20110028850A1 (en) | 2009-07-28 | 2009-07-28 | Process for quantitative display of blood flow |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/462,038 US20110028850A1 (en) | 2009-07-28 | 2009-07-28 | Process for quantitative display of blood flow |
Publications (1)
Publication Number | Publication Date |
---|---|
US20110028850A1 true US20110028850A1 (en) | 2011-02-03 |
Family
ID=43527670
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/462,038 Abandoned US20110028850A1 (en) | 2009-07-28 | 2009-07-28 | Process for quantitative display of blood flow |
Country Status (1)
Country | Link |
---|---|
US (1) | US20110028850A1 (en) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120238888A1 (en) * | 2009-12-10 | 2012-09-20 | Koninklijke Philips Electronics N.V. | Collateral blood flow assessment |
US20150221088A1 (en) * | 2011-07-09 | 2015-08-06 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US20150230711A1 (en) * | 2008-09-11 | 2015-08-20 | Carl Zeiss Meditec Ag | Medical systems and methods |
US20160071271A1 (en) * | 2013-05-13 | 2016-03-10 | Toshiba Medical Systems Corporation | Medical imaging analyzer and medical image processing method |
CN105705084A (en) * | 2013-09-20 | 2016-06-22 | 国立大学法人旭川医科大学 | Method and system for image processing of intravascular hemodynamics |
EP3410394A1 (en) * | 2017-06-01 | 2018-12-05 | Leica Instruments (Singapore) Pte. Ltd. | Method, image processor and device for observing an object containing a bolus of a fluorophore |
US10426356B2 (en) * | 2011-07-09 | 2019-10-01 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
EP3690818A1 (en) * | 2019-01-30 | 2020-08-05 | Rohde & Schwarz GmbH & Co. KG | Method of visualizing data, device for visualizing data as well as use of a method of visualizing data |
US20200306002A1 (en) * | 2019-03-25 | 2020-10-01 | Sony Olympus Medical Solutions Inc. | Medical observation control device and medical observation system |
JP2021069652A (en) * | 2019-10-30 | 2021-05-06 | カシオ計算機株式会社 | Electronic device, electronic device control method and electronic device control program |
US11222189B2 (en) | 2011-07-09 | 2022-01-11 | Gauss Surgical, Inc. | System and method for estimating extracorporeal blood volume in a physical sample |
US20220245775A1 (en) * | 2019-10-31 | 2022-08-04 | Peking University Shenzhen Graduate School | Tone mapping method and electronic device |
US11712183B2 (en) | 2012-05-14 | 2023-08-01 | Gauss Surgical Inc. | System and methods for managing blood loss of a patient |
US11836915B2 (en) | 2012-05-14 | 2023-12-05 | Gauss Surgical Inc. | System and method for estimating a quantity of a blood component in a fluid canister |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4852183A (en) * | 1986-05-23 | 1989-07-25 | Mitsubishi Denki Kabushiki Kaisha | Pattern recognition system |
US5215095A (en) * | 1990-08-10 | 1993-06-01 | University Technologies International | Optical imaging system for neurosurgery |
US6196226B1 (en) * | 1990-08-10 | 2001-03-06 | University Of Washington | Methods and apparatus for optically imaging neuronal tissue and activity |
WO2004052195A1 (en) * | 2002-12-10 | 2004-06-24 | Zerrle, Irmgard | Device for the determination of blood flow in discrete blood vessels and regions of living organisms |
US20050272994A1 (en) * | 2004-06-07 | 2005-12-08 | Rudolf Ackermann | Method for displaying medical image information dependent on a detected position of the observer |
US20060262968A1 (en) * | 2005-04-18 | 2006-11-23 | Matthias Drobnitzky | Method for integration of vectorial and/or tensorial measurement data into a representation of an anatomical image exposure |
US7469160B2 (en) * | 2003-04-18 | 2008-12-23 | Banks Perry S | Methods and apparatus for evaluating image focus |
US20090054788A1 (en) * | 2007-04-19 | 2009-02-26 | Carl Zeiss Surgical Gmbh | Method and apparatus for displaying a field of a brain of a patient and navigation system for brain surgery |
US20090148018A1 (en) * | 2004-01-26 | 2009-06-11 | Koninklijke Philips Electronics, N.V. | Image segmentation technique for displaying myocardial perfusion that does not show the microbubbles in the cardiac chambers |
US20100191124A1 (en) * | 2007-04-17 | 2010-07-29 | Prokoski Francine J | System and method for using three dimensional infrared imaging to provide psychological profiles of individuals |
-
2009
- 2009-07-28 US US12/462,038 patent/US20110028850A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4852183A (en) * | 1986-05-23 | 1989-07-25 | Mitsubishi Denki Kabushiki Kaisha | Pattern recognition system |
US5215095A (en) * | 1990-08-10 | 1993-06-01 | University Technologies International | Optical imaging system for neurosurgery |
US6196226B1 (en) * | 1990-08-10 | 2001-03-06 | University Of Washington | Methods and apparatus for optically imaging neuronal tissue and activity |
WO2004052195A1 (en) * | 2002-12-10 | 2004-06-24 | Zerrle, Irmgard | Device for the determination of blood flow in discrete blood vessels and regions of living organisms |
US7469160B2 (en) * | 2003-04-18 | 2008-12-23 | Banks Perry S | Methods and apparatus for evaluating image focus |
US20090148018A1 (en) * | 2004-01-26 | 2009-06-11 | Koninklijke Philips Electronics, N.V. | Image segmentation technique for displaying myocardial perfusion that does not show the microbubbles in the cardiac chambers |
US20050272994A1 (en) * | 2004-06-07 | 2005-12-08 | Rudolf Ackermann | Method for displaying medical image information dependent on a detected position of the observer |
US20060262968A1 (en) * | 2005-04-18 | 2006-11-23 | Matthias Drobnitzky | Method for integration of vectorial and/or tensorial measurement data into a representation of an anatomical image exposure |
US20100191124A1 (en) * | 2007-04-17 | 2010-07-29 | Prokoski Francine J | System and method for using three dimensional infrared imaging to provide psychological profiles of individuals |
US20090054788A1 (en) * | 2007-04-19 | 2009-02-26 | Carl Zeiss Surgical Gmbh | Method and apparatus for displaying a field of a brain of a patient and navigation system for brain surgery |
Cited By (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9320438B2 (en) * | 2008-09-11 | 2016-04-26 | Carl Zeiss Meditec Ag | Medical systems and methods |
US20150230711A1 (en) * | 2008-09-11 | 2015-08-20 | Carl Zeiss Meditec Ag | Medical systems and methods |
US20120238888A1 (en) * | 2009-12-10 | 2012-09-20 | Koninklijke Philips Electronics N.V. | Collateral blood flow assessment |
US9125616B2 (en) * | 2009-12-10 | 2015-09-08 | Koninklijke Philips N.V. | Collateral blood flow assessment |
US9870625B2 (en) * | 2011-07-09 | 2018-01-16 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US11670143B2 (en) * | 2011-07-09 | 2023-06-06 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US11222189B2 (en) | 2011-07-09 | 2022-01-11 | Gauss Surgical, Inc. | System and method for estimating extracorporeal blood volume in a physical sample |
US10957179B2 (en) * | 2011-07-09 | 2021-03-23 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US20150221088A1 (en) * | 2011-07-09 | 2015-08-06 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US20230260376A1 (en) * | 2011-07-09 | 2023-08-17 | Gauss Surgical Inc. | Method For Estimating A Quantity Of A Blood Component In A Fluid Receiver And Corresponding Error |
US20210192917A1 (en) * | 2011-07-09 | 2021-06-24 | Gauss Surgical, Inc | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US10426356B2 (en) * | 2011-07-09 | 2019-10-01 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US11783503B2 (en) | 2011-07-09 | 2023-10-10 | Gauss Surgical Inc. | Systems and method for estimating extracorporeal blood volume in a physical sample |
US11836915B2 (en) | 2012-05-14 | 2023-12-05 | Gauss Surgical Inc. | System and method for estimating a quantity of a blood component in a fluid canister |
US11712183B2 (en) | 2012-05-14 | 2023-08-01 | Gauss Surgical Inc. | System and methods for managing blood loss of a patient |
US9691148B2 (en) * | 2013-05-13 | 2017-06-27 | Toshiba Medical Systems Corporation | Medical imaging analyzer and medical image processing method |
US20160071271A1 (en) * | 2013-05-13 | 2016-03-10 | Toshiba Medical Systems Corporation | Medical imaging analyzer and medical image processing method |
EP3047796A4 (en) * | 2013-09-20 | 2017-05-31 | National University Corporation Asahikawa Medical University | Method and system for image processing of intravascular hemodynamics |
EP3047796B1 (en) | 2013-09-20 | 2020-11-04 | National University Corporation Asahikawa Medical University | Method and system for image processing of intravascular hemodynamics |
US10898088B2 (en) * | 2013-09-20 | 2021-01-26 | National University Corporation Asahikawa Medical University | Method and system for image processing of intravascular hemodynamics |
US20160262638A1 (en) * | 2013-09-20 | 2016-09-15 | National University Corporation Asakikawa Medical University | Method and system for image processing of intravascular hemodynamics |
CN105705084A (en) * | 2013-09-20 | 2016-06-22 | 国立大学法人旭川医科大学 | Method and system for image processing of intravascular hemodynamics |
US10750938B2 (en) | 2017-06-01 | 2020-08-25 | Leica Instruments (Singapore) Pte. Ltd. | Method, image processor and device for observing an object containing a bolus of a fluorophore |
EP3651118A1 (en) | 2017-06-01 | 2020-05-13 | Leica Instruments (Singapore) Pte. Ltd. | Method, image processor and device for observing an object containing a bolus of a fluorophore |
CN108968913A (en) * | 2017-06-01 | 2018-12-11 | 徕卡仪器(新加坡)有限公司 | For observing method, image processor and the equipment of the object comprising a fluorogen |
EP3410394A1 (en) * | 2017-06-01 | 2018-12-05 | Leica Instruments (Singapore) Pte. Ltd. | Method, image processor and device for observing an object containing a bolus of a fluorophore |
US11857164B2 (en) | 2017-06-01 | 2024-01-02 | Leica Instruments (Singapore) Pte. Ltd. | Method, image processor and device for observing an object containing a bolus of a fluorophore |
EP3690818A1 (en) * | 2019-01-30 | 2020-08-05 | Rohde & Schwarz GmbH & Co. KG | Method of visualizing data, device for visualizing data as well as use of a method of visualizing data |
US11648080B2 (en) * | 2019-03-25 | 2023-05-16 | Sony Olympus Medical Solutions Inc. | Medical observation control device and medical observation system that correct brightness differences between images acquired at different timings |
US20200306002A1 (en) * | 2019-03-25 | 2020-10-01 | Sony Olympus Medical Solutions Inc. | Medical observation control device and medical observation system |
JP2021069652A (en) * | 2019-10-30 | 2021-05-06 | カシオ計算機株式会社 | Electronic device, electronic device control method and electronic device control program |
JP7115458B2 (en) | 2019-10-30 | 2022-08-09 | カシオ計算機株式会社 | ELECTRONIC DEVICE, METHOD OF OPERATING ELECTRONIC DEVICE, AND CONTROL PROGRAM FOR ELECTRONIC DEVICE |
US20220245775A1 (en) * | 2019-10-31 | 2022-08-04 | Peking University Shenzhen Graduate School | Tone mapping method and electronic device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20110028850A1 (en) | Process for quantitative display of blood flow | |
US20100069759A1 (en) | Method for the quantitative display of blood flow | |
US20100041999A1 (en) | Process for quantitative display of blood flow | |
US20100042000A1 (en) | Method for correcting the image data that represent the blood flow | |
CN110663251B (en) | Medical image processing apparatus | |
US11051696B2 (en) | Complementary color flashing for multichannel image presentation | |
JP7531013B2 (en) | Endoscope system and medical image processing system | |
US20180153384A1 (en) | Image processing apparatus | |
CN114298980A (en) | Image processing method, device and equipment | |
JPH01113022A (en) | Endoscopic apparatus | |
WO2019016912A1 (en) | Diagnosis supporting device, diagnosis supporting method and program | |
CN108968913B (en) | Method, image processor and apparatus for observing an object containing a bolus of fluorophores | |
US12052526B2 (en) | Imaging system having structural data enhancement for non-visible spectra | |
CN116133572A (en) | Image analysis processing device, endoscope system, method for operating image analysis processing device, and program for image analysis processing device | |
US20120237108A1 (en) | Ophthalmology information processing apparatus and method of controlling the same | |
JP6058240B1 (en) | Image analysis apparatus, image analysis system, and operation method of image analysis apparatus | |
JP2016054794A (en) | Endoscope system, processor device, operation method for endoscope system, and operation method for processor device | |
WO2022018894A1 (en) | Endoscope system and method for operating same | |
JP7046500B2 (en) | Image display device, image display method and image processing method | |
JP2005345310A (en) | Blood health support system | |
CN112995586A (en) | Image capturing method using color conversion and medical image capturing system | |
US20230316521A1 (en) | Image-based determination of a property of a fluorescing substance | |
DE102008040802A1 (en) | Method for quantitative representation of blood flow in tissue or vein region of patient, involves representing parameter characteristic of flow and another parameter characteristic of vein position in superimposed manner for image regions | |
WO2022009478A1 (en) | Image processing device, endoscope system, operation method for image processing device, and program for image processing device | |
CN114305298A (en) | Image processing method, device and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CARL ZEISS SURGICAL GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SCHUHRKE, THOMAS;MECKES, GUENTER;CARL ZEISS MEDICAL SOFTWARE GMBH;AND OTHERS;REEL/FRAME:023590/0696 Effective date: 20090804 Owner name: CARL ZEISS SURGICAL GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:STEFFEN, JOACHIM;MIESNER, HANS-JOACHIM;RUDOLPH, FRANK;AND OTHERS;REEL/FRAME:023590/0796 Effective date: 20090729 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |