Bronchoscope laser speckle blood flow imaging system
Technical Field
The utility model relates to the technical field of optical imaging, in particular to a bronchoscope laser speckle blood flow imaging system.
Background
Interventional respiratory science is a medical science related to invasive diagnosis and treatment of respiratory diseases, doctors can observe pathological changes of airways and mucous membranes under direct vision through a bronchoscope, can directly obtain tracheal, bronchus and lung tissue specimens, adopts corresponding interventional treatment means aiming at the pathological changes, and greatly improves the diagnosis accuracy and treatment effect of respiratory diseases. Bronchoscopes, however, can only provide structural information of the airways, so providing functional information of tissues through other supplemental imaging techniques is critical to comprehensive assessment of the pathophysiological condition of the airways. The tissue perfusion and blood flow information is an important factor reflecting the physiological and pathological states of the tissue, and in the processes of injury and repair of various airways, such as infection, inflammation, tumor, wound and the like, the blood supply and blood flow information of the tissue are detected along with the change of the blood flow information, so that the method is also beneficial to improving the knowledge and diagnosis and treatment level of various airway diseases. At present, various means for measuring tissue blood flow, such as ultrasonic Doppler detection and narrow-band imaging technology, are available, but the technologies have limitations, such as low resolution of an ultrasonic endoscope, incapability of distinguishing blood vessels and overlarge diameter for the airway of children; whereas narrowband imaging techniques (Narrow Band Imaging, NBI), while reflecting changes in vessel morphology within the observation region, do not provide blood flow information. Therefore, exploring new respiratory endoscopic imaging techniques is critical to improving respiratory intervention diagnostic capabilities.
Laser Speckle Contrast Imaging (LSCI) is a full-field optical imaging technique that utilizes the spatiotemporal statistical properties of laser speckle intensities to achieve in vivo tissue blood flow monitoring, and can obtain real-time high-spatiotemporal resolution blood flow distribution images without relying on contrast agents and mechanical scanning. The technology has the advantages of simple equipment, non-invasiveness, no need of injecting contrast agent, high imaging speed, high resolution, long-time continuous measurement and the like, is widely applied to measurement of blood vessel diameter, blood flow speed, blood flow perfusion, blood flow density and other microcirculation blood flow parameters of tissues and organs such as retina, skin, brain and the like, can study the law of microcirculation change and pathological mechanism thereof in basic pathological processes such as inflammation, edema, hemorrhage, allergy, shock, tumor, burn, frostbite, radiation injury and the like, and has important significance for disease diagnosis and treatment.
A typical LSCI system mainly includes a light source, an imaging module, an image acquisition module, and a speckle image processing module. The system adopts coherent laser as a light source, and adjusts the spot size of the laser beam to uniformly irradiate scattering particles (such as red blood cells) in the region of interest; the scattered light is coherently formed into a speckle image, the speckle image is imaged on a CCD or CMOS camera through an optical imaging system Microscope, and an image acquisition module records the original speckle image. The spatial and temporal variations in speckle image intensity include information about the velocity of the moving scatterer, the faster the speed of movement of the scatterer, the faster the speckle pattern will fluctuate. By analyzing the temporal and spatial statistical properties of the intensity of the speckle pattern, the velocity of movement of speckle particles (e.g., red blood cells) can be estimated.
At present, various commercial laser speckle contrast imaging instruments are available on the market and can be used for detection of skin, cerebral blood flow, limb circulation and the like, but most of the instruments are huge in volume and are difficult to combine with a body cavity endoscope. At present, the fusion of a body cavity endoscope technology and laser speckle contrast imaging is still in a development and searching stage, for example, an endoscope imaging system is disclosed in the invention patent with publication number of CN105748029A, an endoscopic laser speckle blood flow imaging probe is disclosed in the invention patent with publication number of CN109009060A, an endoscopic laser speckle blood flow blood oxygen imaging system is disclosed in the invention patent with publication number of CN110151108A, and a real-time blood flow acquisition method and device for an endoscope are disclosed in the invention patent with publication number of CN 111899262A. However, the bronchoscope is limited by the diameter of the human airway, and the bronchoscope is smaller than a digestive endoscope and other endoscopes, so that the bronchoscope has higher requirements on the lens size, the image resolution, the miniaturization and integration of the system and the like of the laser speckle contrast imaging system, and the related research on the combination of the bronchoscope and the laser speckle contrast imaging device is not yet available in the prior art.
Disclosure of utility model
In order to solve the problems that the existing laser speckle contrast imaging instrument is huge in size, and the requirements of a bronchoscope on the lens size, the image resolution, the miniaturization and integration of the system and the like of the laser speckle contrast imaging system are higher, so that the laser speckle contrast imaging system is difficult to meet the requirements of bronchoscope laser speckle blood flow imaging, and the two are difficult to combine, the utility model provides the bronchoscope laser speckle blood flow imaging system.
The utility model adopts the following technical scheme:
a bronchoscope laser speckle blood flow imaging system comprises a bronchoscope, a laser, an optical fiber collimator, an optical fiber movable connector, a light guide optical fiber bundle, a front LED light source, a light source control switch, a CMOS image sensor, an image processing and displaying computer and an objective lens;
the bronchoscope comprises an inserting part and an operating part which are connected in sequence, wherein the foremost end of the inserting part is a front end part, and the front end part comprises an LED light source port, an optical fiber bundle port and an imaging port;
the front LED light source is positioned at the LED light source port, a power line of the front LED light source passes through the inside of the insertion part and is connected with a light source control switch arranged on the outer shell of the operation part, the light source control switch is connected with a power supply, and the light source control switch is also used for controlling the opening and closing of the laser;
The light guide optical fiber bundle is positioned in the insertion part, the emergent end of the light guide optical fiber bundle is positioned at the optical fiber bundle port, the incident end of the light guide optical fiber bundle is connected with the light outlet of the optical fiber collimator through the optical fiber movable connector, and the light inlet of the optical fiber collimator is aligned with the light outlet of the laser;
The CMOS image sensor is arranged at an imaging focal plane of the objective lens, an electric signal wire of the CMOS image sensor is connected with a signal transmission wire of the image processing and displaying computer after passing through the inserting part and the operating part, and the CMOS image sensor respectively uploads collected image data to the image processing and displaying computer through the electric signal wire and the signal transmission wire under the condition that the laser or the front LED light source is singly illuminated;
The image processing and displaying computer comprises a display and a processor which is pre-built with a laser speckle contrast ratio calculation program, and when the front-mounted LED light source is adopted for illumination, the processor receives the image data and controls the display to directly display the airway structure image; when the laser is adopted for illumination, the processor processes the received image data, generates laser speckle blood flow imaging information corresponding to the target area and controls the display to display the laser speckle blood flow image.
Further, the LED light source port and the fiber bundle port are located on both sides of the imaging port, respectively.
Further, the LED light source port and the fiber bundle port are located on the same side of the imaging port.
Further, the front LED light source and the LED light source ports are respectively arranged in two, and the power lines of the two front LED light sources are connected with the light source control switch.
Further, two LED light source ports are located on both sides of the imaging port, respectively.
Further, two fiber bundle ports are arranged, and the two fiber bundle ports and the two LED light source ports are distributed around the imaging port in a staggered mode.
Further, the LED light source port is circular or rectangular in shape.
Further, the optical fiber movable connector is fixedly connected with the outer shell of the operation part.
Further, the laser is a He-Ne laser.
Further, the power supply is a battery power supply or an alternating current power supply.
Compared with the prior art, the utility model has the beneficial effects that:
The utility model integrates the electronic bronchoscope and the laser speckle contrast imaging system, a front LED light source, a light guide optical fiber bundle and a CMOS image sensor are arranged in the bronchoscope, and the illumination light source used when the CMOS image sensor is controlled by the light source control switch to collect images can not only realize the respective acquisition of the common light image and the laser speckle blood flow image of the target area, but also supplement each other in the imaging process, thereby improving the imaging precision. The system of the utility model realizes the real-time blood flow information monitoring of the target area under the bronchoscope, thereby providing more comprehensive structural and functional information for evaluating the airway disease state, treating response and the like.
Drawings
FIG. 1 is a schematic diagram of a bronchoscope laser speckle blood flow imaging system according to an embodiment of the utility model;
FIG. 2 is a schematic diagram of the front structure of the front end portion when the LED light source ports are provided in two;
FIG. 3 is a schematic diagram of the front structure of the front end portion when the LED light source port and the fiber bundle port are provided in two;
Fig. 4 is another schematic front view of the LED light source port and the fiber bundle port with two front ends.
Reference numerals illustrate: 1. a laser; 2. an optical fiber collimator; 3. an optical fiber movable connector; 4. a light-guiding optical fiber bundle; 5. a front LED light source; 6. a light source control switch; 7. a CMOS image sensor; 8. an image processing and displaying computer; 9. an operation unit; 10. an insertion section; 11. an LED light source port; 12. an optical fiber bundle port; 13. an imaging port; 14. a power line; 15. an electric signal line; 16. a signal transmission line; 17. an objective lens.
Detailed Description
The technical scheme of the present utility model will be described in detail with reference to the accompanying drawings and preferred embodiments.
As shown in fig. 1 and 2, the present embodiment integrates an electronic bronchoscope with a laser speckle contrast imaging system, and provides a bronchoscope laser speckle blood flow imaging system, and the whole system is composed of a bronchoscope, a laser 1, an optical fiber collimator 2, an optical fiber movable connector 3, a light guiding optical fiber bundle 4, a front LED light source 5, a light source control switch 6, a CMOS image sensor 7, an image processing and displaying computer 8, an objective lens 17, and the like.
Specifically, the bronchoscope comprises an insertion part 10 and an operation part 9 which are connected in sequence, wherein the foremost part of the insertion part 10 is a front end part, and the front end part mainly comprises an LED light source port 11, an optical fiber bundle port 12 and an imaging port 13; the insertion part 10 is a part inserted into the air passage, and is internally provided with a light guide optical fiber bundle 4, a power line 14, an electric signal line 15, an angle steel wire and the like; the operating part 9 is a hand-held part for controlling the operation of the endoscope, and is provided with an up-down angle adjusting handle, a light source control switch 6 and the like. The bronchoscope of this embodiment may also include a biopsy port or other structure for insertion of instruments in a conventional standard bronchoscope configuration, as not limited herein.
The tip portion includes an LED light source port 11, a fiber bundle port 12, and an imaging port 13. The LED light source port 11 is used for placing the front LED light source 5 and is used as a light outlet of the front LED light source 5; the fiber bundle port 12 is used for placing the light guide fiber bundle 4 and is used as a laser light outlet; the imaging port 13 is used for placing an objective lens 17 as an entrance of the CMOS image sensor 7. The specific structure of the tip portion may be selected according to practical needs, for example, the LED light source port 11 and the fiber bundle port 12 are located on both sides of the imaging port 13, respectively, or the LED light source port 11 and the fiber bundle port 12 are located on the same side of the imaging port 13.
Further, as shown in fig. 2, the front LED light sources 5 and the LED light source ports 11 are respectively provided in two, the two LED light source ports 11 are respectively located at two sides of the imaging port 13, so as to provide more uniform LED illumination for the CMOS image sensor 7, and the power lines 14 of the two front LED light sources 5 are connected with the light source control switch 6, and the light source control switch 6 controls the two front LED light sources 5 to emit light and turn off simultaneously.
Further, two fiber bundle ports 12 are also provided, and the two fiber bundle ports 12 and the two LED light source ports 11 are distributed around the imaging port 13 in a staggered manner, as shown in fig. 3 and 4, so that illumination with stronger brightness and more uniformity can be provided for the collection of the common image and the laser speckle blood flow image of the CMOS image sensor 7.
In addition, the LED light source port 11 may have a rectangular shape (as shown in fig. 2) or a circular shape (as shown in fig. 3 and 4) so as to facilitate the installation of the front LED light source 5 and improve the area utilization of the front end portion.
The front-mounted LED light source 5 is located at the LED light source port 11, a power line 14 of the front-mounted LED light source 5 is connected with the light source control switch 6 after passing through the inside of the insertion part 10, the light source control switch 6 is connected with a power supply, the power supply can be realized by adopting a battery power supply or an alternating current power supply, the light source control switch 6 is used for controlling the on-off of the front-mounted LED light source 5 and can be fixedly arranged on a shell of the operation part 9 so as to be convenient to operate, and meanwhile, the light source control switch 6 is also used for controlling the opening and closing of the laser 1, so that the switching between LED light and laser is realized. Compared with the traditional endoscopic laser speckle blood flow imaging system, the halogen or xenon light source and the laser are coupled into the common optical fiber bundle, and interference can be generated between the halogen or xenon light source and the laser, and the front LED light source 5 is arranged at the front end part, so that the light source is not required to be coupled into the optical fiber bundle, and the interference possibly generated between the light sources is avoided.
The light guide optical fiber bundle 4 is located in the insertion portion 10, the exit end of the light guide optical fiber bundle 4 is located at the optical fiber bundle port 12, the incident end of the light guide optical fiber bundle 4 is connected with the light outlet of the optical fiber collimator 2 through the optical fiber movable connector 3, the light inlet of the optical fiber collimator 2 is aligned with the light outlet of the laser 1, the optical fiber movable connector 3 can be fixedly arranged on the shell of the operation portion 9, when laser output by the laser 1 needs to be coupled into the light guide optical fiber bundle 4, the optical fiber movable connector 3 is spliced with the light outlet pin of the optical fiber collimator 2, and the light guide optical fiber bundle is detachable and portable when the laser is not used. The optical fiber movable connector 3 in this embodiment may be implemented by an optical fiber connector in the prior art, and the details are not described here. Optionally, the laser in this embodiment adopts He-Ne laser, and the working wavelength is 632.8nm.he-Ne laser is a gas laser, and has advantages of continuous luminescence, high stability of output power, good monochromaticity, good coherence, etc.
The objective lens 17 is arranged at the imaging port 13, the CMOS image sensor 7 is fixedly arranged at the imaging focal plane of the objective lens 17, and the electric signal line 15 of the CMOS image sensor 7 is connected with the signal transmission line 16 of the image processing and displaying computer 8 after passing through the inserting part 10 and the operating part 9. The CMOS image sensor 7 uploads the collected image data to the image processing and display computer 8 through the electric signal line 15 and the signal transmission line 16 under the condition that the laser 1 or the front LED light source 5 is separately illuminated, respectively. Compared with the prior art in which the camera (CCD or CMOS) is mounted at the rear part, the light reflected by the front end of the lens is transmitted back to the camera through the image guiding beam, and the CMOS image sensor 7 is arranged at the front end part, so that the image transmitted by the CMOS image sensor 7 is clearer, and the image information is transmitted to the image processing and displaying computer 8 through an electric signal.
The image processing and displaying computer 8 includes a display and a processor for controlling the display to display, wherein a laser speckle contrast calculation program is built in the processor in advance. When illuminated with the front LED light source 5, the processor receives the image data and controls the display to directly display the image data, i.e. the airway structure image. When the laser 1 is adopted for illumination, the processor firstly carries out data processing on the received image data through a laser speckle contrast calculation program to generate laser speckle blood flow imaging information corresponding to a target area, and then controls the display to display the laser speckle blood flow image generated according to the laser speckle blood flow imaging information. The laser speckle contrast calculation program in this example is a computer program obtained according to a laser speckle contrast calculation method already developed in the prior art (see, "Li Chenxi, chen Wenliang, jiang Jingying, etc.. Laser speckle contrast blood flow imaging technology research progress [ J ]. Chinese laser 2018,45 (2): 0207006.", "hole level, yang Hui, zheng Gang, etc.. Laser speckle blood flow imaging technology research new progress [ J ]. Optical technology, 2014,40 (1): 21-26:" etc.).
The bronchoscope laser speckle blood flow imaging system of the embodiment works as follows:
After the laser 1 emits laser, the laser irradiates the light inlet of the optical fiber collimator 2, and the light outlet of the optical fiber collimator 2 is connected with the light guide optical fiber bundle 4 inside the bronchoscope insertion part 10 through the optical fiber movable connector 3, so that the laser is coupled into the bronchoscope light guide optical fiber bundle 4. Meanwhile, a front LED light source 5 is arranged in the front end part of the bronchoscope, and a light source control switch 6 for controlling the front LED light source 5 and the laser 1 to emit light is arranged on an operation part 9. When the light source control switch 6 controls the front LED light source 5 to be turned on, namely, the LED illumination channel is turned on, the laser illumination channel is in a turned-off state, only the LED light emitted by the front LED light source 5 irradiates a target area on the surface of the airway mucosa, and the CMOS image sensor 7 acquires a common light image, namely, an airway structure image; when the light source control switch 6 controls the front LED light source 5 to be turned off and controls the laser 1 to be turned on, at the moment, the laser illumination channel is turned on, the LED illumination channel is turned off, only laser emitted by the laser 1 irradiates a target area on the airway mucosal surface, and at the moment, the CMOS image sensor 7 collects and acquires laser speckle blood flow imaging information. The front LED light source 5 and the laser 1 respectively and independently illuminate, and the CMOS image sensor 7 respectively and independently images under the condition that only the laser 1 or the front LED light source 5 illuminates, so that mutual interference of the front LED light source 5 and the front LED light source in the imaging process is avoided, and interference on a measurement result is reduced. The reflected light obtained by the absorption of the LED light and the laser light respectively through the tissue is received by the front-end CMOS image sensor 7 through the objective lens 17, the CMOS image sensor 7 converts the optical signal into an electrical signal, and the electrical signal is transmitted into the image processing and displaying computer 8 through the electrical signal line 15 and the signal transmission line 16. The processor in the image processing and displaying computer 8 is pre-built with a laser speckle contrast calculating program, and the processor performs data processing on the received image data through the laser speckle contrast calculating program to generate corresponding laser speckle blood flow imaging information and control the display to display the laser speckle blood flow image. In this embodiment, a front LED light source is adopted, and the LED light source has low power consumption and small volume, and the light guide optical fiber bundle 4 only transmits laser, and the light guide optical fiber bundle 4 and the optical fiber collimator 2 are connected by the movable connector, so that the corresponding illumination channel can be selected to be opened or closed as required. In the embodiment, the CMOS image sensor is adopted to replace the traditional CCD camera, the CMOS image sensor is arranged in front, the CMOS image sensor can perform rapid data scanning only by small energy consumption, and an image signal amplifier, a signal reading circuit, an A/D conversion circuit, an image signal processor, a controller and the like can be integrated on one chip, so that the reading speed is high, the response is high, the integration level is high, the lens size of an imaging system can be greatly reduced by adopting the CMOS image sensor, and the miniaturization and integration requirements of the imaging system are met. Meanwhile, the CMOS image sensor has higher rapid shooting and video acquisition capacity, and can realize continuous shooting with high frame rate, high-speed video acquisition and real-time image processing.
The embodiment adopts a double-light source form, one is a front LED light source 5 which is arranged at the front end of the lens in front, and is connected with a power supply through a power line 14 to provide illumination information, so that an endoscopic image under LED illumination can be obtained; the other is a laser light source, which emits laser light through the laser 1, passes through the optical fiber collimator 2 and is coupled into the light guide optical fiber bundle 4, and the laser light irradiates the inside of the airway to provide laser speckle blood flow information. The light source control switch 6 is arranged on the operation part 9, so that LED illumination or laser illumination can be selected, in the process of observing the airway structure and the lesion, the LED illumination is firstly carried out, a structural image is provided, then the lesion target part is selected, and the laser illumination is switched to obtain laser speckle blood flow imaging information.
The utility model solves the problems of miniaturization and integration of the respiratory endoscope laser speckle blood flow imaging device, integrates the electronic bronchoscope and the laser speckle contrast imaging system, sets the front LED light source, the light guide fiber bundle and the CMOS image sensor in the bronchoscope, controls the illumination light source used when the CMOS image sensor collects images through the light source control switch, not only can realize the separate acquisition of the common light image and the laser speckle blood flow image of the target area, but also can complement each other in the imaging process, improves the imaging precision, and has the advantages of more miniaturized and integrated integral structure, easy manufacture, low cost and convenient research and development and updating. The system of the utility model realizes the real-time blood flow information monitoring of the target area under the bronchoscope, thereby providing more comprehensive structural and functional information for evaluating the airway disease state, treating response and the like.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples illustrate only a few embodiments of the utility model, which are described in detail and are not to be construed as limiting the scope of the utility model. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the utility model, which are all within the scope of the utility model. Accordingly, the scope of protection of the present utility model is to be determined by the appended claims.