CN111788508B - Digital microscope and method for changing the magnification of a digital microscope - Google Patents
Digital microscope and method for changing the magnification of a digital microscope Download PDFInfo
- Publication number
- CN111788508B CN111788508B CN201980016056.7A CN201980016056A CN111788508B CN 111788508 B CN111788508 B CN 111788508B CN 201980016056 A CN201980016056 A CN 201980016056A CN 111788508 B CN111788508 B CN 111788508B
- Authority
- CN
- China
- Prior art keywords
- image
- objective
- microscope
- interest
- digital
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Microscoopes, Condenser (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The invention relates firstly to a method for changing the magnification of a digital microscope. The microscope has at least two automatically switchable objectives with different imaging scales, of which one objective is always selected. The microscope further comprises an image converter for converting the captured image. According to the present invention, the magnification of the output image is continuously changed, and for this purpose, the magnification of the image photographed by the selected objective lens and converted by the image converter is continuously changed by digital image processing. When the objective lens is automatically changed, the magnifications of output images given before and after the change are matched with each other. A transformation from a previous region of interest (21) of the sample viewed with the microscope into a current region of interest (22) of the sample, wherein, synchronously with the transformation, the previous region of interest is first imaged at a location of the output image, and at the location, the transformation along the path is imaged and finally the current region of interest is imaged. The invention also relates to a digital microscope for carrying out the method.
Description
Technical Field
The invention relates firstly to a method for changing the magnification of a digital microscope. The digital microscope comprises at least two automatically switchable objectives with different imaging scales, of which one objective is always selected. The digital microscope further includes an image converter for converting an image photographed using the selected objective lens. The invention also relates to a digital microscope.
Background
DE 102008063799 a1 shows a method for compensating for an arbitrary parfocal length of an objective lens in focus on a stereomicroscope and a macro-mirror. This compensation is used to achieve correct focusing after objective lens changes in the stereomicroscope or macro-mirror.
From US 9,063,342B 2 and DE 102009012707 a1, microscopes are known which have a plurality of optical systems in the imaging beam path, in particular a multi-stage zoom system. The individual magnifying optical systems can be formed by discrete magnifying systems, by single-stage or multi-stage optical zoom systems and/or by digital zoom systems, which are combined with one another to form a controllable overall zoom system.
EP 2043005 a1 shows a method for measuring and simulating a process in a microscope system. In this method, the image seen by the camera of the microscope system at the time of actual study is simulated.
A microscope system is described in US 8,259,171B 2, which displays measured values at varying observation magnifications. For this purpose, geometric measurement data are acquired and displayed on a display.
US 2016/0274347 a1 teaches a microscope system in which all camera-related setting parameters are controlled with an ROI (region of interest) in a digital image shown on a monitor. For this purpose, a digital zoom is used to show the image section of interest in enlargement. Additionally, the image data is also used for focus setting.
EP 2606394B 1 shows a device with a digital microscope having a first and a second image sensor, whose images can be combined for presentation on a monitor. For example, panoramic images are stitched (stisching) to combine into larger images. After the maximum resolution is reached, the resolution or magnification can be increased by means of an optical system which can be switched on manually or automatically.
A microscope system with motor-controlled magnification is known from DE 10214191 a 1. The microscope system includes a plurality of optical systems having different magnifying powers and an image pickup element. The setting device is used to set an electronic zoom magnification for a sample image captured by the image capturing element. The control device generates a sample image having a display magnification on the basis of the magnification of an optical system introduced into an optical path for observing the sample and an electronic zoom magnification by using an image signal output from the image pickup element. In addition to using an object lens having a magnification power of 10 to 40 and a barrel lens having a magnification power of 1 to 1/2, an electronic zoom magnification in the range of 1 to 2 should be provided, for example, whereby a continuous magnification range of 5 to 80 should be achieved.
DE 102010030637 a1 teaches a method for actuating a microscope for continuously adjusting the magnification. The microscope comprises a zoom optics and an objective turret having at least two objectives of different magnifications.
EP 2345920 a1 shows a microscope system with an electrical zoom for continuously changing the magnification. The microscope system includes an objective turret having a plurality of objectives of different magnifications.
US 2013/0076888 a1 teaches a microscope system with zoom optics and a zoom control unit. The zoom control unit is controlled via a touch screen panel.
DE 202005021436U 1 shows an imaging system with an extended range of digital zoom. The imaging system includes two optical paths having two different magnifications.
Disclosure of Invention
Based on the prior art, the object of the invention is to be able to vary the magnification of a digital microscope over a wide range without this process hindering the observation of the sample to be observed with the microscope.
Said object is solved by a method according to the appended claim 1 and by a microscope according to the appended, side-by-side claim 15.
The method according to the invention is used to change the magnification of a digital microscope. The method is particularly useful for varying the magnification at which a sample viewed with the microscope is imaged by an image output by a digital microscope. The images are output in electronic form by a digital microscope and can be displayed on a display, for example by means of a monitor or a digital eyepiece, or output onto a data carrier or in a network.
The digital microscope comprises at least two automatically switchable objective lenses with different imaging scales. Thus, the sample can be observed microscopically with different objective lenses. One of the microscopes is always selected and is therefore used for optical imaging of the sample. The digital microscope preferably comprises a motor-driven objective changer, with which the objective can be changed.
The digital microscope further includes an image converter for converting an image photographed by the selected objective lens into an electronic image signal. The image converted by the image converter is not displayed immediately but is subjected to digital image processing. The image processing allows, in particular, the enlargement of the converted image before it is output, wherein the enlargement ratio can be varied, which is also referred to as digital zoom. Therefore, the magnification at which the sample observed with the microscope is imaged by the image output by the digital microscope is determined at least by the objective lens selected separately and by the image processing by the image converted by the image converter.
According to the present invention, the magnification of an image output by a digital microscope is continuously changed. For this purpose, in a step of the method, the magnification of the image is continuously changed by digital image processing (also referred to as digital zooming) of the image captured with the respectively selected objective lenses and converted with the image converter. According to the invention, the change of magnification is also performed by changing the objective lens. In the case of automatic objective lens change, the magnification of the image output by the digital microscope given before the change and the magnification of the image output by the digital microscope given after the change are matched to each other (abgleichen). Thus, when changing the objective lens, the magnification of the image output by the digital microscope does not change abruptly, but changes continuously or in several discrete steps. For this purpose, the magnification of the image captured with the objective lens selected before the conversion and converted with the image converter and/or the magnification of the image captured with the objective lens selected after the conversion and converted with the image converter is selected by digital image processing so that the conversion of the objective lens does not cause an abrupt change in the magnification of the image output by the digital microscope. In case the objective lens selected before the transformation and/or the objective lens selected after the transformation is formed by a zoom objective lens and/or an optical zoom system is used, the magnification of the image taken with the objective lens selected before the transformation and converted by the image converter and/or the magnification of the image taken with the objective lens selected after the transformation and converted by the image converter are selected by selecting the zoom setting accordingly such that the magnification of the image output by the digital microscope given before the transformation and the magnification of the image output by the digital microscope given after the transformation match each other.
According to the invention, the change in the magnification of the image output by the digital microscope is carried out at least by digital image processing and by one or more transformations of the objective lens, so that the method according to the invention can also be referred to as hybrid zooming. The compound zoom is preferably extended, for which purpose the digital microscope preferably comprises at least one zoom objective, at least one downstream optical zoom system and/or at least one digital zoom system for re-magnification and/or re-resolution.
A particular advantage of the method according to the invention is that the operator of the digital microscope can vary the magnification of the image output by the digital microscope over a large range by means of the switchable objective lens and can still permanently observe and take care of the details of the sample while continuously varying the magnification, since the magnification does not change abruptly. A sudden change in magnification may result in the operator not seeing the details of the sample.
In a preferred embodiment of the method according to the invention, when changing the objective lens, the image stability of the image captured by the selected objective lens and converted by the image converter after changing the objective lens is matched to the image stability of the image captured by the selected objective lens and converted by the image converter before changing the objective lens. It is thus ensured that the image stability of the image output by the digital microscope does not change when the objective lens is changed, so that it is ensured to a greater extent that the operator does not see the details of the image output by the digital microscope of the sample. In particular, when the objective lens is changed, the center of the field of view in the image captured by the selected objective lens and converted by the image converter after the change of the objective lens is matched with the center of the field of view in the image captured by the selected objective lens and converted by the image converter before the change of the objective lens.
Preferably, the operator can select the sample area of interest in the image output by the digital microscope. This region is also called a region of interest (ROI). In a preferred embodiment of the method according to the invention, the positioning of the region of interest in the image is maintained during the changing of the magnification of the image output by the digital microscope. The region of interest is preferably imaged at a specific location of the image output by the digital microscope. The positioning is preferably kept constant during continuously changing the magnification. The location is preferably formed by the center of the image output by the digital microscope.
In a preferred embodiment of the method according to the invention, after the objective lens is changed, the area of the sample observed with the microscope that was in focus before the objective lens was changed is focused. This ensures that no focus is lost when changing the objective lens. Focusing is preferably performed automatically, that is to say by means of an autofocus function.
Preferably, one or more of the switchable objective lenses of the digital microscope is/are each designed as a zoom objective. The focal length and the imaging scale of the zoom objective can be mechanically changed. The change is electronically controllable. In a preferred embodiment of the method according to the invention, the method comprises the following steps: in this step, the continuous change of the magnification of the digital microscope is performed by continuously changing the focal length or the imaging scale of the objective lens configured as a zoom lens, thereby simultaneously continuously changing the magnification of the image output by the digital microscope.
Preferably, the microscope comprises an optical zoom system with which the focal length and the magnification of the microscope can be changed with the selected objective lens, respectively. The objective lenses then preferably each have a fixed imaging ratio. In a preferred embodiment of the method according to the invention, the method comprises the following steps: in this step, continuous change of the magnification of the digital microscope is performed by continuously changing the imaging scale of the optical zoom system, thereby continuously changing the magnification of the image output by the digital microscope at the same time.
Preferably, one of the interchangeable objectives of the microscope is formed by a unit consisting of a panoramic objective and a panoramic camera. Preferably, the panoramic objective is configured as a zoom objective, so that the unit formed by the panoramic objective and the panoramic camera enables optical zooming. Preferably, the panoramic camera is configured for changing the magnification of the image output by the panoramic camera by digital image processing, thereby enabling the panoramic camera to achieve a digital zoom. In a preferred embodiment of the method according to the invention, the method comprises the following steps: in this step, the continuous change of the magnification of the digital microscope is performed by continuously changing the imaging scale of the panoramic objective configured as a zoom objective or by continuously changing the magnification of the image of the panoramic camera by means of digital image processing, thereby continuously changing the magnification of the image output by the digital microscope at the same time.
In a preferred embodiment of the method according to the invention, the change in magnification of the image captured with the selected objective and converted by the image converter is carried out by digital image processing until the imaging scale of one of the non-selected objectives is reached, which is then selected upon conversion. This results in a continuous change in the magnification of the image output by the digital microscope when changing the objective. The objective to be selected can also be designed as a zoom objective, so that the magnification of an image recorded with the previously selected objective and converted by the image converter is changed by digital image processing until the minimum imaging scale of the not yet selected objective designed as a zoom objective is reached.
In a first preferred embodiment of the method according to the invention, the magnification of the image output by the digital microscope is continuously changed by continuously increasing the magnification of the image output by the digital microscope. An objective with successively increasing imaging scales is selected. After switching to the objective with the higher imaging ratio, the magnification of the image output by the digital microscope is increased further by digital image processing of the image switched by the image switch until a resolution limit, also referred to as effective magnification, is reached. Preferably, conversely, the magnification of the image output by the digital microscope is continuously reduced.
The objectives with an increased imaging scale each have a fixed focal length in a simple preferred case, so that the magnification of the image output by the digital microscope is increased between the conversion objectives by digital image processing of the images captured with the respectively selected objective and converted by the image converter.
In a second preferred embodiment of the method according to the invention, the magnification of the image output by the digital microscope is continuously changed by continuously increasing the magnification of the image output by the digital microscope. One of the switchable objectives is designed as a zoom objective. First, the magnification of an image output by the digital microscope is increased by continuously changing the focal length or imaging scale of an objective lens configured as a zoom objective lens, and then the magnification of the image output by the digital microscope is continuously increased by performing digital image processing on an image taken with the selected objective lens and converted by an image converter until the imaging scale of one of the objective lenses having a fixed focal length is reached, and the objective lens is selected. Preferably, conversely, the magnification of the image output by the digital microscope is continuously reduced.
In a third preferred embodiment of the method according to the invention, the magnification of the image output by the digital microscope is continuously changed by continuously increasing the magnification of the image output by the digital microscope. Wherein the at least two switchable objective lenses are each designed as a zoom objective. First, the magnification of the image output by the digital microscope is increased by continuously changing the focal length or the imaging scale of the objective configured as a zoom objective until the highest imaging scale of the objective is reached, and the magnification of the image output by the digital microscope is continuously increased by performing digital image processing on the image captured with the selected objective configured as a zoom objective and converted by the image converter until the smallest imaging scale of a further objective configured as a zoom objective is reached and the further objective is selected at the time of changeover. Preferably, conversely, the magnification of the image output by the digital microscope is continuously reduced.
In a preferred embodiment of the method according to the invention, when the resolution boundary of the objective formed by the dry objective with the highest resolution is reached, a subsequent increase in the output magnification no longer causes an indication of the increase in resolution.
The switchable objective preferably comprises at least one immersion objective. In a preferred embodiment of the method according to the invention, the objective formed by the immersion objective is selected when the immersion boundary is reached, that is to say when a further increase in magnification requires the use of an immersion objective, and preferably also an indication of immersion or automatic immersion is output. In a further preferred embodiment of the method according to the invention, the automatic correction function of the objective formed by the correction objective is activated when the immersion boundary is reached, and preferably a prompt is also output to activate the automatic correction function.
According to the present invention, when a previous region of interest of a sample observed with a microscope is transformed into a current region of interest of the sample observed with the microscope, in synchronization with the transformation, the previous region of interest of the sample observed with the microscope is first imaged at a certain location of an image output by a digital microscope, and then the current region of interest of the sample observed with the microscope is imaged at the certain location of the image output by the digital microscope. The location in the image is preferably formed by the center of the image. The transformation from the previous region of interest of the sample observed with the microscope to the current region of interest of the sample observed with the microscope is preferably carried out by an operator and is preferably performed on an interactive display of the microscope.
In case the image converted by the selected objective lens and the image converter images a previous region of interest and a current region of interest of the sample observed with the microscope, the transformation of the imaging of the region of interest in the image output by the digital microscope is preferably performed by digital image processing of the image converted by the selected objective lens and the image converter. In this image processing, preferably only coordinate adjustment or matching selection of image sections is performed. The positioning of the sample relative to the objective preferably remains unchanged here.
The transformation from the previous region of interest of the sample under observation to the current region of interest of the sample under observation is preferably performed along a path on the sample under observation. The path represents the movement carried out by the operator. Preferably, in synchronism with this transformation along the path, the previous region of interest of the sample viewed with the microscope is first imaged at a selected location in the image output by the digital microscope, and then the transformation along the path is imaged at that location in the image output by the digital microscope, and finally the current region of interest is imaged. The operator can thus search for the sample in the image output by the digital microscope while changing the region of interest and thus select the respective current region of interest in a targeted manner. In principle, the region of interest can also be selected automatically, for example by shape and pattern recognition. This is of interest especially in the field of material microscopy for QC/QA.
If a transformation into a further region of interest comprising one of the previous regions of interest arranged along the path is made, the image of the one of the previous regions of interest arranged along the path is preferably rendered, which of the previously stored images imaged out of the one of the previous regions of interest. This has the advantage that the stored image can be reproduced quickly, in particular in real time, without having to take a picture of this region of interest of the sample again, that is to say without having to illuminate or contrast and visually visualize it, and without having to change the objective.
In case the image converted by the selected objective and the image converter images an image section along a path from a previous region of interest of the sample observed with the microscope to a current region of interest of the sample observed with the microscope, the transformation of the region of interest along the path up to the current region of interest is preferably imaged by digital image processing of the image converted by the selected objective and the image converter. In particular, in this image processing, only the adjustment of the coordinates or the selection of the matching of the image sections is carried out. The positioning of the sample relative to the objective preferably remains unchanged here.
In case the image converted by the selected objective and the image converter does not image the current region of interest of the sample or a path thereto, the translation of the region of interest or the movement along the path up to the current region of interest is preferably performed by changing the positioning of the sample with respect to the objective.
The change in the positioning of the sample relative to the objective is preferably effected by moving the stage of the microscope carrying the sample relative to the selected objective. The images captured with the objective or with these objectives and converted by the image converter during the changing of the positioning of the sample relative to the respectively selected objective are preferably stored. The stored images are preferably reproduced as a movie. The images captured with the objective or with the objectives and converted by the image converter during the changing of the positioning of the sample relative to the respectively selected objective are preferably stored and stitched (called stitching) into consecutive images depending on the corresponding positioning of the sample relative to the objective. The stitched images form a larger portion of the sample than the respective images captured with the respectively selected objective lens and converted by the image converter. Alternatively, the images captured with the objective or with these objectives during the change of the positioning of the sample relative to the respectively selected objective and converted by the image converter are stored and combined into a coherent image depending on the content of the images. These images can be stitched together correctly by analysis of their content.
The digital microscope according to the invention is used for observing a sample with the microscope. The digital microscope comprises at least two objective lenses capable of automatic switching. These objectives have different imaging scales. These objective lenses can be switched, wherein one of the objective lenses is always selected and positioned in the beam path of the microscope. The respectively selected objective is used for optically imaging the sample. The digital microscope preferably comprises an electrically controllable objective changer for changing the objective.
The microscope further comprises an image converter for converting images of the sample taken with the respectively selected objective.
The microscope comprises a control and image processing unit, by means of which at least the change of the objective can be controlled and by means of which digital image processing of the image captured with the selected objective and converted by the image converter can be carried out. The control and image processing unit is configured for implementing the method according to the invention, preferably the control and image processing unit is configured for implementing a preferred embodiment of the method according to the invention. The control and image processing unit is preferably formed by a computer. The microscope also preferably has the features described in connection with the method according to the invention.
Drawings
Further details and refinements of the invention result from the following description of preferred embodiments of the invention with reference to the drawings. Wherein:
FIG. 1: a preferred embodiment of a microscope according to the present invention is shown;
FIG. 2: a flow chart of a first preferred embodiment of the method according to the invention is shown;
FIG. 3: a flow chart of a second preferred embodiment of the method according to the invention is shown;
FIG. 4: a flow chart of a third preferred embodiment of the method according to the invention is shown;
FIG. 5 is a schematic view of: a schematic diagram of a fourth preferred embodiment of the method according to the invention is shown; and is
FIG. 6: a schematic diagram of a fifth preferred embodiment of the method according to the invention is shown.
Detailed Description
Fig. 1 shows a preferred embodiment of a digital microscope according to the invention. The microscope comprises a motor-driven and coded objective changer 01 having a plurality of equipped coded objectives 02, wherein one or more of the objectives 02 can each be designed as a zoom objective. The objective lens changer 01 may also be equipped with a panoramic camera (not shown) having a panoramic objective lens. The microscope also includes a motorized microscope stage 03. The microscope comprises a digital camera 04, which can be embodied as exchangeable or flange-connectable. The digital camera 04 includes an image converter (not shown) for converting images photographed with the individually selected objective lenses 02 into electronic image signals.
The microscope comprises a computer 06 with a digital display unit 07, which is preferably formed by a touch screen panel. The computer 06 also includes a keyboard and further operating and control elements (not shown). Control and image processing software is installed on the computer so that it forms the control and image processing unit of the microscope. Control and image processing software is used to implement the method according to the invention, which is explained in more detail with reference to fig. 2 to 6. In an alternative preferred embodiment, the computer can be eliminated, since the digital image processing is integrated in hardware in the optical engine of the microscope.
The embodiment of the microscope according to the invention shown also comprises a microscope base 08 and an eyepiece 09. The eyepiece 09 can alternatively or additionally be embodied as a digital eyepiece according to an image converter (not shown).
Fig. 2 shows a flow chart of a first preferred embodiment of the method according to the invention, which is carried out using the digital microscope shown in fig. 1. In this first embodiment, the n switchable objective lenses 02 (shown in fig. 1) each have a fixed imaging scale M Obj 1 To M Obj n So that it is a discontinuous objective lens. The n switchable objective lenses 02 (shown in FIG. 1) have image resolution y' Obj 1 To y' Obj n . In this first embodiment, the entire magnification range of the microscope is continuously experienced. By switching on and focusing the first objective lens having the lowest imaging ratio among the objective lenses 02 (shown in fig. 1), a first image is displayed on the display unit 07 (shown in fig. 1). If the operator wants to zoom the image (which he can control with a digital input medium such as a touch screen, a mouse pointer, a slider and/or a joystick), the resolution (i.e. the resolution of the first objective) is now taken over by the digital zoom achieved by the digital image processingRate) is constant. Digital zoom results in resolution y' DZ And results in a magnification V DZ . Reaching the imaging ratio M of the second objective lens Obj 2 And then, the second objective lens is switched to and switched on. Image stabilization and focus correction are performed while an image captured with the first objective lens and zoomed by digital zooming is still displayed at the same imaging scale as the second objective lens. The image is replaced with the image captured by the second objective lens after image stabilization and focus correction are performed on the image captured by the second objective lens. Thus, zoom-in zoom is achieved by replacing the lower resolution image with the higher resolution image. According to the same principle, further objectives up to the nth objective are selected one after the other, and during this a continuous magnification change is performed by digital zooming. At the nth objective lens, digital zooming is carried out until the effective magnification V is reached FDZ . The speed of the zooming process can be adjusted during zooming. Hybrid zooming, formed by changing the objective lens and digital zooming, can be done in two directions, that is, towards higher magnification and smaller field of view, and vice versa.
Fig. 3 shows a flow chart of a second preferred embodiment of the method according to the invention. In order to carry out this second embodiment, one of the objective lenses 02 on the objective lens changer 01 (shown in fig. 1) is constructed as a unit consisting of a panoramic camera and a panoramic objective lens (not shown), which unit is arranged at the first objective lens position of the objective lens changer 01 (shown in fig. 1). Wherein the other objective 02 (shown in fig. 1) is configured as a zoom objective and is fitted on the second objective positioning of the objective changer 01 (shown in fig. 1). Wherein the further objective 02 (shown in fig. 1) is formed by a discontinuous objective with a fixed imaging scale. In this second embodiment of the method according to the invention, the entire magnification range is likewise continuously undergone. The first image is displayed after the panoramic camera is switched on and in focus, which may then be further enlarged via an optical and/or digital zoom system integrated in the panoramic camera. Panoramic camera with image space resolution
The image space resolution is achieved upon zooming
To
The panoramic camera has a magnification
The magnification is reached upon zooming from
To
After reaching the lowest imaging ratio of the second objective designed as a zoom objective, this second objective is selected and switched on via the objective changer 01 (shown in fig. 1) and then is first magnified further by its purely optical zoom function. The zoom objective lens has a value of up to y 'upon zooming' ZO maximum Image resolution y' ZO The zoom objective lens having a lens surface reaching up to V upon zooming ZO maximum Magnification V of ZO . Subsequently, a further continuous magnification is performed with the digital zoom up to the nth objective lens and then up to the effective magnification after a change to a further discontinuous objective lens with a fixed magnification.
Fig. 4 shows a flow chart of a third preferred embodiment of the method according to the invention. In order to carry out this third embodiment, the objective lenses 02 (shown in fig. 1) each have a fixed imaging scale, wherein the microscope further comprises an optical zoom system (not shown) that can be used for each of the objective lenses 02 (shown in fig. 1) respectively. In this third embodiment, the conversion of the objective lens, the use of a downstream optical zoom system for each of the objective lenses, and the digital zooming are performed in combination. Continuously through the entire range of possible magnifications. In contrast to the embodiment shown in fig. 2, the downstream optical zoom systemInstead of digital zooming, the system takes over zooming between the individual discrete objective magnifications up to the nth objective. The optical zoom system has a zoom of up to y' Maximum of OZ Of image resolution y' OZ . The optical zoom system has a zoom lens reaching up to V ZO maximum Magnification V of OZ . The digital zoom then takes over zooming until an effective magnification is reached. Advantageously in this embodiment, in a corresponding design of the optical zoom system in the case of optical zooming between discrete objective magnifications, a simultaneous increase in resolution can be achieved in addition to the magnification change, compared to digital zooming.
Fig. 5 shows a schematic diagram of a fourth preferred embodiment of the method according to the invention. In this schematic diagram, the object field and field number dependent synergy between an optically fixed magnifying objective or optical zoom system and digital zooming is described. The application of a fixed magnification objective or optical zoom system and digital zoom is exemplarily shown in fig. 3 and 4. In this embodiment, the microscope stage 03 (shown in fig. 1) remains stationary. The sensor-equivalent object field section 11 from the illustrated part of the microscope object plane 12 is imaged in full picture via a fixedly enlarged optical objective or an optical zoom system onto the sensor image plane 13. The object field section 11 imaged onto the image converter (not shown) therefore has the greatest optical imaging behavior in terms of the resolution of the objective or the selected zoom magnification of the optical zoom system. By means of the downstream digital zoom according to the invention, it is now possible to further enlarge the monitor-equivalent image section 14 from the sensor image plane 13 without further resolution benefits. The digitally re-magnified image is then zoomed until the next optical magnification level is reached, and then the digitally magnified image is replaced by an optically generated image with higher resolution in the sensor image plane 13 (see fig. 4). In case the highest resolution objective is used or in case the highest optical zoom magnification is reached, then preferably only the digital zoom is used until the effective magnification boundary is reached. For certain applications, such as for particle analysis,digital code is re-magnified even to an ineffective magnification (leere)
) The range of (c) is still significant.
The combination according to the invention of an optical magnification changer and a digital zoom has significant advantages in terms of field of view adjustment. By permanently storing the optically generated image recorded in the sensor format, it is possible to carry out a comfortable continuous zoom at all optical imaging levels with a reduced field of view without the risk of the operator not seeing the details of the object to be observed, even if only one object region is actually observed, that is to say without the microscope stage 03 moving (as shown in fig. 1). A further advantage is that within the digital image stored in the format of the sensor image plane 13, the re-magnified smaller monitor-equivalent image section 14 can be navigated or moved laterally, purely digitally, according to the exemplary given arrow direction 16 without moving the microscope stage 03 (as shown in fig. 1). Such navigation or movement is generated by software for image processing and is controlled using a digital input medium such as a touch screen monitor (not shown) controlled by gestures. Typical microscopic practices can therefore be implemented for further selecting object details around the region in the center of the imaged field of view.
Fig. 6 shows a schematic diagram of a fifth preferred embodiment of the method according to the invention. In this schematic diagram, the object field and field number dependent synergy between an optically fixed magnification objective or an optical zoom system and digital zooming is also described. The application of a fixed magnification objective or optical zoom system and digital zoom is exemplarily shown in fig. 3 and 4. In contrast to the fourth embodiment shown in fig. 5, the microscope stage 03 (shown in fig. 1) is displaced laterally, since the displacement path within the sensor surface, i.e. in the object field section corresponding to the sensor, is no longer sufficient, in particular because the edge of the field of view of the sensor surface is reached.
An initial region of interest 21 in the microscope object plane 12 is exemplarily shown. The operator navigates in the y-direction to the first further now interesting region 22 by means of a digital input medium (not shown). According to the invention, the navigation is followed in the output image. For this purpose, the monitor-equivalent image section 14 is first moved within the sensor image plane 13, and then, after reaching the sensor boundary, the microscope stage 03 is correspondingly moved in the y direction (shown in fig. 1). In this case, on the path of the microscope stage 03 (shown in fig. 1) to the first further region of interest 22, a further image field corresponding to the sensor is recorded in the sensor image plane 13 and a stitching process, also referred to as stitching, is carried out. And storing the spliced images in a continuous digital mode. Subsequent magnification via digital zoom in real time allows for low-jitter and low-latency digital image visualization and orientation within the object along a selected travel of the microscope stage 03 (shown in fig. 1), depending on the required sensor exposure time for the object under the microscope being observed. In the same way, a further exemplary illustrated simultaneous movement 23 from the first further region of interest 22 to the second further region of interest 24 in both coordinate directions of the microscope stage 03 (shown in fig. 1) also takes place. Along the selected displacement direction 23, the image fields recorded in the sensor image plane 13 corresponding to the sensor are automatically combined to form successive digital image fields of increasing size and stored. This has the advantage that only digitally stored images are called up when navigating to the same region of interest again, which can be done in real time without illumination or contrast and optical visualization of the object during this time. Only when navigating to other previously unexplored object regions does it be necessary to re-illuminate or contrast the object under the microscope.
The method according to the invention allows, in particular in the case of fluorescent slices that fade gradually, maximum protection of the object or slice to be observed microscopically and visualization and orientation of digital images with low jitter and low delay by maximum utilization of the digitized image field without manual switching of discrete magnification levels.
The synergy between the optically fixed magnification objective or optical zoom system and the digital zoom, which is described for a fixed magnification with reference to fig. 6, depending on the object field and the number of fields of view is preferably applied in the embodiments shown in fig. 2 to 5. For other magnifications that can be achieved with these embodiments, the captured sensor-equivalent image fields are also automatically combined by stitching into a continuously increasing digital image field and stored, in the case of uneven objects and, if necessary, image stabilization and/or optical correction, along the movement direction selected there and the selected focal plane or focal map. Digital image fields pieced and stored for a selected fixed magnification are thus generated for each microscopic object or slice, which are combined with one another via a likewise recorded digital zoom function.
Preferably, all microscopic studies, that is to say the entire Workflow (Workflow), which are also carried out, for example, in a different contrast method, on the sections are recorded completely in the form of a film. A further advantage of the method according to the invention over the prior art, which only records and stores digital single images or video sequences of individual object points or slice locations, is that video information can be provided to the region of interest with respect to navigating to the slice location of interest. This is necessary, for example, to unequivocally prove a diagnosis made, for example, when making pathological sections.
A further advantage of the invention is that it allows the protected investigation of fluorescent samples, since no fluorescence excitation of the sample is required during the digital image display. The fading of the sample is reduced, so that the service life of the sample can be greatly prolonged. Especially for subsequent confocal or high resolution techniques, the sample is not severely damaged in wide field inspection.
A further advantage of the invention is that an objective with the same aperture or resolution but with a higher degree of graduation is replaced by a change of magnification by digital image processing, that is to say by digital zooming, which is an important functional component of the hybrid zoom according to the invention. For example, a 40x/1.4 objective may completely replace a 100x/1.4 objective, since higher magnification is achieved by digital zoom with the same resolution. With higher resolution objectives, e.g. 20x/1.2, an even larger magnification range is preferably replaced by digital zooming.
A further advantage of the invention is that for panoramic magnification in the case of large object fields, the digital zoom also replaces the objective lens which is not needed for tracking the region of interest; i.e., an objective lens in the range of 1.0x → 1.25x → 2.5x → 5.0 x. To the extent that a panoramic objective with a resolution and a number of fields of view suitable for the application is selected, digital zooming, as a functional component of the method according to the invention, can continuously span the range to the next higher resolution objective, so that certain objectives are not required compared to the prior art.
A further advantage of the present invention is that the integrated camera of panoramic magnification used in conjunction with digital zoom replaces the special panoramic objective.
A further advantage of the present invention is that digital zooming enables correction of mechanical centering errors. For example to correct errors in the image stabilization of the so-called objective lens. Thus, lateral runout of the center of the field of view at magnification change is avoided by digital correction. Digital zoom also allows correction of the centering of the optical zoom system during zooming; that is to say correction of mechanical guiding errors of the movable optical subsystem of the zoom objective.
The present invention has advantages in that automatic refocusing at the time of changing the objective lens is simplified by digital zooming in consideration of a unique back focal length of the objective lens determined by a factory, thereby facilitating operation and improving sample throughput.
The invention has the advantage that the necessity for a manual or manually triggered motor setting procedure on the microscope is reduced, thereby reducing setting errors and efforts for searching and tracking details of the object of interest. The invention supports application-dependent and user-friendly manipulation of the microscope and allows increased efficiency in the form of larger sample throughput.
List of reference numerals
01 Objective lens changer
02 objective lens
03 microscope stage
04 digital camera
05 -
06 computer
07 display unit
08 microscope base
09 ocular lens
10 -
11 field section
12 microscope object plane
13 sensor image plane
14 image section corresponding to monitor
15 -
16 direction of the arrow of navigation/movement
17 -
18 -
19 -
20 -
21 initial region of interest
22 first additional region of interest
23 move
24 second further region of interest
M Obj n Imaging ratio of nth objective lens
y′ Obj n Image space resolution of nth objective
y′ ZO Image space resolution of zoom objective
y′ OZ Image space resolution of optical zoom system
y′ DZ Resolution of digital zoom
V DZ Magnification of digital zoom
V ZO Magnification of zoom objective lens
V OZ Magnification of optical zoom system
V FDZ Effective magnification of digital zoom
Claims (14)
1. Method for changing the magnification of a digital microscope, wherein the digital microscope comprises at least two automatically switchable objective lenses (02) with different imaging scales, from which one objective lens (02) is always selected, and wherein the digital microscope further comprises an image converter for converting an image captured with the selected objective lens (02), characterized in that the magnification of the image output by the digital microscope is continuously changed, for which purpose the magnification of the image captured with the selected objective lens (02) and converted with the image converter is continuously changed by means of digital image processing, wherein, in the automatic switching of the objective lenses (02), the magnification of the image output by the digital microscope given before switching and the magnification of the image output by the digital microscope given after switching are matched to one another, wherein a previous region of interest (21) of the sample observed with the microscope is transformed into a current region of interest (22, 24) of the sample observed with the microscope, wherein, synchronously with the transformation, the previous region of interest (21) of the sample observed with the microscope is imaged at a certain position of the image output by the digital microscope, and at the position of the image output by the digital microscope, the transformation along the path and finally the current region of interest (22, 24) are imaged, wherein the change of the magnification of the image captured with the selected objective (02) and transformed by the image transformer is performed by digital image processing until the imaging scale of one of the unselected objectives (02) is reached, which is then selected at the time of the transformation.
2. Method according to claim 1, characterized in that when changing the objective (02), the image stability of the image captured by the selected objective (02) after changing the objective (02) and converted by the image converter is matched to the image stability of the image captured by the selected objective (2) and converted by the image converter before changing the objective (2).
3. Method according to claim 1 or 2, characterized in that the current region of interest (21, 22, 24) of the sample observed with the microscope is imaged at a certain position in the image output by the digital microscope, and that this position in the image remains unchanged during the continuously changing magnification of the image.
4. Method according to claim 1 or 2, characterized in that after the transformation of the objective (02) the area of the sample observed with the microscope that was in focus before the transformation of the objective (2) is focused.
5. Method according to claim 1 or 2, wherein one or more of the transformable objectives (02) are configured as zoom objectives, wherein the method comprises the following steps: in this step, a continuous change of the magnification of the digital microscope is carried out by continuously changing the imaging scale of an objective (2) configured as a zoom objective.
6. Method according to claim 1 or 2, characterized in that one of the transformable objectives (02) of the microscope is formed by a unit consisting of a panoramic objective and a panoramic camera, wherein the panoramic camera is configured for changing the magnification of the image output by the panoramic camera by means of digital image processing, and wherein the continuous change of the magnification of the digital microscope is carried out by continuously changing the imaging scale of the panoramic objective configured as a zoom objective or by continuously changing the magnification of the image of the panoramic camera by means of digital image processing.
7. Method according to claim 1, characterized in that the transformation from the previous region of interest (21) of the sample under observation to the current region of interest (22, 24) of the sample under observation with the microscope is carried out along a path on the sample under observation with the microscope and, in synchronism with this transformation carried out along said path, the previous region of interest (21) of the sample under observation with the microscope is first imaged at said location of the image output by said digital microscope and, at this location of the image output by said digital microscope, the transformation carried out along said path and finally the current region of interest (22, 24) are imaged.
8. Method according to claim 7, characterized in that as soon as the change of the region of interest (21, 22, 24) along the path up to the current region of interest (24) is imaged with the image taken with the selected objective (02) and the selected positioning of the sample relative to the objective (02), the change of the region of interest (21, 22, 24) along the path up to the current region of interest (24) is imaged in the image output by the digital microscope by digital image processing of this image, and that once the image taken with the selected objective (02) and the selected positioning of the sample relative to the objective (02) no longer images the change of the region of interest (21, 22, 24) along the path up to the current region of interest (24), the change of the positioning of the sample relative to the objective (02) is carried out in the image output by the digital microscope along the path by changing the positioning of the sample relative to the objective (02) A transformation of the region of interest (21, 22, 24) up to the current region of interest (24) is imaged.
9. Method according to claim 8, characterized in that the images taken with the selected objective (02) and converted by the image converter during the changing of the positioning of the sample relative to the respectively selected objective (02) are stored.
10. A method as claimed in claim 9, characterized in that the stored images are reproduced as a film.
11. A method according to claim 9 or 10, characterized in that the stored images are stitched into a coherent image depending on the positioning of the sample.
12. A method according to claim 9 or 10, characterized in that the stored images are pieced together into coherent images according to their content.
13. Method according to claim 9 or 10, characterized by transforming into a further region of interest comprising one of the previous regions of interest (21, 22, 23) arranged along said path, wherein reproducing the one of the previously stored images the one of the previous regions of interest (21, 22, 23) arranged along said path.
14. A digital microscope for viewing a sample with the microscope, the digital microscope comprising:
-at least two automatically switchable objectives (02) with different imaging scales;
-an image converter for converting an image of the sample taken with one of the objective lenses (02); and
-a control and image processing unit (06) configured for implementing the method according to claim 1 or 2.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102018104704.5 | 2018-03-01 | ||
| DE102018104704.5A DE102018104704A1 (en) | 2018-03-01 | 2018-03-01 | Digital microscope and method for changing a magnification of a digital microscope |
| PCT/EP2019/054019 WO2019166266A1 (en) | 2018-03-01 | 2019-02-19 | Digital microscope and method for modifying an enlargement of a digital microscope |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111788508A CN111788508A (en) | 2020-10-16 |
| CN111788508B true CN111788508B (en) | 2022-08-23 |
Family
ID=65717953
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980016056.7A Active CN111788508B (en) | 2018-03-01 | 2019-02-19 | Digital microscope and method for changing the magnification of a digital microscope |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN111788508B (en) |
| DE (1) | DE102018104704A1 (en) |
| WO (1) | WO2019166266A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3822686B1 (en) | 2019-11-15 | 2022-08-03 | PreciPoint GmbH | Method of providing an assembled image using a digital microscope, digital microscope system, and program for providing an assembled image using a digital microscope |
| DE102020101572A1 (en) | 2020-01-23 | 2021-07-29 | Carl Zeiss Meditec Ag | microscope |
| DE102020113454A1 (en) | 2020-05-19 | 2021-11-25 | Carl Zeiss Microscopy Gmbh | Microscope and method for generating an image composed of several microscopic individual images |
| DE102020118500A1 (en) | 2020-07-14 | 2022-01-20 | Carl Zeiss Microscopy Gmbh | Microscope and method for generating an image composed of several microscopic partial images |
| CN112068300B (en) * | 2020-11-10 | 2021-03-16 | 中国科学院自动化研究所 | Shutter type self-adaptive 3D display system based on medical microscopic image |
| DE102021121705A1 (en) | 2021-08-20 | 2023-02-23 | Carl Zeiss Microscopy Gmbh | Method for operating a microscope with zoom optics and a microscope with zoom optics |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE3739223A1 (en) * | 1987-11-19 | 1989-06-01 | Reichert Optische Werke Ag | Method for autofocusing of microscopes, and microscopes with an autofocusing system |
| WO2001084209A2 (en) * | 2000-05-03 | 2001-11-08 | Dirk Soenksen | Fully automatic rapid microscope slide scanner |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002296508A (en) * | 2001-03-30 | 2002-10-09 | Nikon Corp | Microscopic system |
| WO2006050395A2 (en) * | 2004-11-02 | 2006-05-11 | Umech Technologies, Co. | Optically enhanced digital imaging system |
| EP2043005B1 (en) | 2007-09-28 | 2013-08-21 | Carl Zeiss Microscopy GmbH | Method and device for measuring for simulating processes in a microscope system |
| JP5246266B2 (en) * | 2008-10-02 | 2013-07-24 | 株式会社ニコン | Microscope system and observation control method |
| JP5066056B2 (en) * | 2008-10-31 | 2012-11-07 | 株式会社日立ハイテクノロジーズ | Sample observation method and electron microscope |
| JP5301970B2 (en) | 2008-12-08 | 2013-09-25 | オリンパス株式会社 | Digital camera system for microscope and microscope system |
| DE102008063799A1 (en) | 2008-12-18 | 2010-06-24 | Carl Zeiss Microimaging Gmbh | Method for compensation of arbitrary alignment lengths of lenses when focusing on stereomicroscopes and macroscopes |
| DE102009012707A1 (en) | 2009-03-11 | 2010-09-16 | Carl Zeiss Microlmaging Gmbh | Microscope with several optical systems in the imaging beam path |
| DE102010030637A1 (en) * | 2010-06-29 | 2011-12-29 | Carl Zeiss Microimaging Gmbh | Method for controlling stereomicroscope, involves displacing optical element about optical path length during shifting of lenses with high and/or less magnifications until same optical magnification is set for viewer as before shifting |
| US10139613B2 (en) | 2010-08-20 | 2018-11-27 | Sakura Finetek U.S.A., Inc. | Digital microscope and method of sensing an image of a tissue sample |
| US8922639B2 (en) * | 2011-09-27 | 2014-12-30 | Olympus Corporation | Microscope system |
| CN105008979A (en) * | 2013-03-26 | 2015-10-28 | 松下健康医疗控股株式会社 | Observation device, signal output method and signal generation program |
| JP2016177152A (en) | 2015-03-20 | 2016-10-06 | オリンパス株式会社 | Microscope system |
-
2018
- 2018-03-01 DE DE102018104704.5A patent/DE102018104704A1/en active Pending
-
2019
- 2019-02-19 WO PCT/EP2019/054019 patent/WO2019166266A1/en active Application Filing
- 2019-02-19 CN CN201980016056.7A patent/CN111788508B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE3739223A1 (en) * | 1987-11-19 | 1989-06-01 | Reichert Optische Werke Ag | Method for autofocusing of microscopes, and microscopes with an autofocusing system |
| WO2001084209A2 (en) * | 2000-05-03 | 2001-11-08 | Dirk Soenksen | Fully automatic rapid microscope slide scanner |
Also Published As
| Publication number | Publication date |
|---|---|
| DE102018104704A1 (en) | 2019-09-05 |
| WO2019166266A1 (en) | 2019-09-06 |
| CN111788508A (en) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111788508B (en) | Digital microscope and method for changing the magnification of a digital microscope | |
| US10330906B2 (en) | Imaging assemblies with rapid sample auto-focusing | |
| JP4948417B2 (en) | Optically enhanced digital imaging system | |
| JP4970869B2 (en) | Observation apparatus and observation method | |
| JP4878913B2 (en) | Microscope system, microscope image synthesis method, and program | |
| US8000560B2 (en) | Virtual slide generation device, virtual slide generation method, virtual slide generation program product and virtual slide generation program transmission medium | |
| JP2019056917A (en) | Fully automatic rapid microscope slide scanner | |
| JP6310671B2 (en) | Laser microdissection region definition method and related laser microdissection system | |
| US20100194873A1 (en) | Method and device for microscopically examining a sample, computer program and computer program product | |
| JP2017194700A5 (en) | ||
| US8014579B2 (en) | Microscope system and method for synthesizing microscopic images | |
| US20160062101A1 (en) | Method and apparatus for small and large format histology sample examination | |
| JP4915071B2 (en) | Microscope and virtual slide creation system | |
| US10721413B2 (en) | Microscopy system, microscopy method, and computer readable recording medium | |
| US10475198B2 (en) | Microscope system and specimen observation method | |
| US6944326B1 (en) | Video microscopy method | |
| JP2007017930A (en) | Microscopic device | |
| JP2005266718A (en) | Microscopic image photographing system | |
| US20240053596A1 (en) | Control device for a microscope | |
| JP2021021850A (en) | Autofocus microscope and automatic imaging device of microscopic image | |
| JP5281763B2 (en) | Control device, magnification observation system, and method for controlling magnification observation device | |
| JP2018116197A (en) | Microscope system, lamination image generation program, and lamination image generation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |