JP5192965B2 - Microscope system, control program, and control method - Google Patents

Description

  The present invention relates to a microscope system that includes a plurality of objective lenses and performs various types of optical member driving by a motor for performing magnified observation of a minute sample.

Microscope devices are widely used in research and inspection in the biological field including the industrial field.
When inspecting using such a microscope device, generally operate a motorized stage that has multiple objective lenses with different magnifications and can move the observation sample in a plane perpendicular to the observation optical path from the objective lens. By doing so, observation and inspection are performed. As this inspection, for example, there is the following method. First, the objective lens is set at a low magnification, and the entire sample is screened for leaks. After that, the point where the abnormal site is found in the observation sample or the point to be recorded is returned. Furthermore, the high-magnification objective lens is switched to the optimal spectroscopic method, the abnormal part is inspected in detail, and the detailed observation data is recorded.

  In Patent Document 1, when a desired region of an observation image on a monitor is designated, an objective magnification and a stage position necessary for displaying the designated region on the entire screen are calculated, and the objective magnification is calculated based on the calculation result. There is disclosed a microscope zooming device that automatically drives a zooming mechanism and a stage so that a corresponding objective lens is inserted in the observation optical path and a designated region is located at substantially the center of the observation field.

  In Patent Document 2, there is a microscope apparatus that can set the moving direction of the stage and the moving speed of the stage by moving the pointer on the controller images for the XY direction and the Z direction displayed on the monitor. It is disclosed.

In Patent Document 3, the magnification of the microscope image is controlled based on the magnification set by the amount and direction of rotation of the mouse wheel, the position adjustment function is assigned to one switch of the mouse, and the focus adjustment is assigned to the other switch. There has been disclosed a microscope that enables position adjustment and focus adjustment of a microscope image by assigning functions.
Japanese Patent No. 2925647 JP 2001-91854 A Japanese Patent Laid-Open No. 2002-98897

  In recent years, motorization of microscope systems has been progressing. As one of them, as shown in Japanese Patent Application Laid-Open No. H10-228707, a microscope that controls a microscope by operating a mouse as a pointing device on an operation screen displayed on a monitor is known.

  However, when assigning a function for controlling a drive unit to a wheel of a mouse with a wheel, only one drive unit can be assigned because there is only one wheel. However, since the microscope system has a plurality of drive units, many of the drive units cannot be controlled by the wheel of a mouse with a wheel.

  However, the drive unit to be driven by the wheel operation of the mouse varies depending on the observation situation. For example, when it is desired to switch the drive unit to be driven on the screen displaying the specimen according to the position of the pointer, the user has to switch the unit by himself. Therefore, the user has to switch the unit as such, and the operability is not so good.

  In view of the above problems, the present invention provides a microscope system that can control a plurality of drive units with a pointing device in a microscope system that operates a microscope apparatus by operating an operation screen using the pointing device.

  A microscope system according to the present invention includes a microscope apparatus having a plurality of drive units, display control means for displaying an operation screen for operating the microscope apparatus, and an operation instruction to the microscope apparatus with respect to the operation screen. A pointing device that inputs a pointer with a pointer, and a control unit that switches the drive unit according to the position of the pointer on the operation screen and controls the operation of the switched drive unit according to an operation of the pointing device. It is characterized by providing.

The drive unit includes at least one of a zoom mechanism that zooms the observation magnification, a drive stage that can move the observation body in the same direction or perpendicular to the observation optical path, and a light control mechanism, and The operation screen includes at least one of a first region, a second region, a third region, and a fourth region, and the control unit is configured to position the pointer on the operation screen. When the pointer is in the first area on the operation screen, the drive stage is moved in the observation optical path direction according to the operation of the pointing device, and the pointer is moved on the operation screen. If it is in the second area, the drive stage is moved in the direction perpendicular to the observation optical path in accordance with the operation of the pointing device, and the pointer is in the third area on the operation screen. In this case, the zooming mechanism is scaled according to the operation of the pointing device, and when the pointer is in the fourth area on the operation screen, according to the operation of the pointing device. The light control is performed.

  The microscope system further includes an imaging unit that captures an image of an observation object observed by the microscope apparatus, and the operation screen includes an image display area that displays an image captured by the imaging unit, The control means switches the drive unit according to the position of the pointer on the image display area, and controls the operation of the switched drive unit according to an operation of the pointing device.

  The pointing device is a mouse with a wheel, and the control means controls the operation of the switched drive unit according to an operation of a wheel of the mouse with a wheel.

The control means changes the display form of the pointer to a predetermined display form according to the position on the operation screen.
In addition, a microscope apparatus according to the present invention having a plurality of drive units, a display device for displaying an operation screen for operating the microscope apparatus, and an operation instruction to the microscope apparatus with respect to the operation screen A microscope system control program that causes a computer to execute a process for controlling a microscope system having a pointing device that is input in accordance with a determination process for determining a position of the pointer on the operation screen, and a result of the determination on the operation screen A unit switching process for switching the drive unit according to the position of the pointer and a unit control process for controlling the operation of the switched drive unit according to an operation of the pointing device. And

  In addition, a microscope apparatus according to the present invention having a plurality of drive units, a display device for displaying an operation screen for operating the microscope apparatus, and an operation instruction to the microscope apparatus with respect to the operation screen A microscope system control method for controlling a microscope system having a pointing device to input by determining the position of the pointer on the operation screen, and according to the position of the pointer on the operation screen from the determination result, The drive unit is switched, and the operation of the switched drive unit is controlled in accordance with the operation of the pointing device.

  According to the present invention, when operating a microscope system by operating an operation screen using a pointing device, a plurality of drive units can be controlled by the pointing device.

A microscope system according to an embodiment of the present invention includes a microscope apparatus, a display unit, a pointing device, and a control unit.
The microscope apparatus has a plurality of drive units. For example, the microscope apparatus corresponds to the microscope apparatus 1 in this embodiment.

The display means displays an operation screen for operating the microscope apparatus. The display means corresponds to the monitor 5 in the present embodiment, for example.
The pointing device inputs an operation instruction to the microscope apparatus with a pointer on the operation screen. For example, the pointing device corresponds to the mouse 88 in this embodiment.

  The control means switches the drive unit according to the position of the pointer on the operation screen, and controls the operation of the switched drive unit according to the operation of the pointing device. For example, the control means corresponds to the host system 2 in this embodiment.

  With this configuration, in the microscope system that operates the microscope apparatus by operating the operation screen using the pointing device, the plurality of drive units can be controlled by the pointing device.

  The drive unit includes at least one of a zooming mechanism that zooms the observation magnification, a drive stage that can move the observation body in the same direction or perpendicular to the observation optical path, and a light control mechanism.

  In this case, the control means determines the position of the pointer on the operation screen. When the pointer is in the first area on the operation screen, the control means moves the drive stage in the direction of the observation optical path in accordance with the operation of the pointing device. When the pointer is in the second area on the operation screen, the control means moves the drive stage in a direction perpendicular to the observation optical path in accordance with the operation of the pointing device. When the pointer is in the third area on the operation screen, the control unit causes the magnification changing mechanism to change the magnification according to the operation of the pointing device. When the pointer is in a fourth area on the operation screen, the control means performs dimming control according to the operation of the pointing device.

  With this configuration, the drive unit to be controlled can be switched according to the position of the pointer on the operation screen. Then, according to the operation of the pointing device, it is possible to control the functions unique to the switched drive unit.

  The microscope system further includes an imaging unit that captures an image of the observation body observed by the microscope apparatus. The imaging means corresponds to the video camera 3 in the present embodiment, for example. Here, the operation screen includes an image display area for displaying an image picked up by the image pickup means. The control means switches the drive unit according to the position of the pointer on the image display area. Then, the control means controls the operation of the switched drive unit in accordance with the operation of the pointing device.

  With this configuration, the drive unit to be controlled can be switched according to the position of the pointer on the operation screen. Then, according to the operation of the pointing device, it is possible to control the functions unique to the switched drive unit.

  An example of the pointing device is a mouse with a wheel. At this time, the control means controls the operation of the switched drive unit in accordance with the operation of the wheel of the mouse with wheel.

  With this configuration, the drive unit to be controlled can be switched according to the position of the mouse pointer on the operation screen. The operation of the switched drive unit can be controlled in accordance with the operation of the wheel of the mouse with wheel.

  Further, the control means can change the display form of the pointer to a predetermined display form according to the position on the operation screen. With this configuration, the pointer display form can be changed to a predetermined display form in accordance with the position on the operation screen.

The details of the embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a diagram showing a configuration example of a microscope system that implements the present invention. The microscope apparatus 1 includes, as a transmission observation optical system, a transmission illumination light source 6, a collector lens 7 that collects illumination light from the transmission illumination light source 6, a transmission filter unit 8, and a transmission field stop 9. A transmission aperture stop 10, a condenser optical element unit 11, and a top lens unit 12 are provided. The epi-illumination observation optical system includes an epi-illumination light source 13, a collector lens 14, an epi-illumination filter unit 15, an epi-illumination shutter 16, an epi-illumination field stop 17, and an epi-illumination aperture stop 18.

  An electric stage 20 on which an observation body (specimen) 19 is placed is provided on the observation optical path where the optical path of the transmission observation optical system and the optical path of the epi-illumination observation optical system overlap. The electric stage 20 is movable in each of up, down, left and right directions. The movement control of the electric stage 20 is performed by the stage XY drive control unit 21 and the stage Z drive control unit 22.

  The electric stage 20 has an origin detection function (not shown) by an origin sensor. Thereby, the movement control by coordinate detection and coordinate specification of the specimen 19 placed on the electric stage 20 can be performed.

  A revolver 24, a cube unit 25, and a zoom optical system 27 are provided on the observation optical path. The revolver 24 selects a plurality of objective lenses 23a, 23b,... (Hereinafter collectively referred to as “objective lens 23” as necessary) to be used for observation by rotating operation. The cube unit 25 switches the speculum method.

  Further, a polarizer 28 for differential interference observation, a DIC (Differential Interference Contrast) prism 29, and an analyzer 30 can be inserted into the observation optical path. These units are motorized, and their operations are controlled by a microscope controller 31 described later.

  The objective lens 23 is equipped with a so-called objective lens with a correction ring (not shown) having an aberration correction function for correcting the thickness by the cover glass. Further, the correction ring position can be controlled by the microscope controller 31.

  The microscope controller 31 connected to the host system 2 has a function of controlling the operation of the entire microscope apparatus 1. The microscope controller 31 has a function of changing the spectroscopic method and dimming the transmitted illumination light source 6 and the epi-illumination light source 13 in accordance with a control signal from the host system 2. In addition, the microscope controller 31 has a function of sending the current microscopic state (microscope state) by the microscope apparatus 1 to the host system 2. The microscope controller 31 is also connected to the stage XY drive control unit 21 and the stage Z drive control unit 22. Thereby, the host system 2 can also control the electric stage 20.

  The microscope operation unit 34 is a hand switch including various input units for inputting operation instructions for the microscope apparatus 1. Further, the electric stage 20 can be operated by a joystick or an encoder (not shown) provided in the hand switch.

  A microscope image of the specimen 19 captured by the video camera 3 is taken into the host system 2 via the video board 32. The host system 2 can perform automatic gain control ON / OFF, gain setting, automatic exposure control ON / OFF, and exposure time setting for the video camera 3 via the camera controller 33.

  In addition, the host system 2 can store the image data of the specimen 19 sent from the video camera 3 in the operation history recording unit 4. The image data recorded in the operation history recording unit 4 can be read by the host system 2 and displayed on the monitor 5 which is a display unit.

  The host system 2 can perform image processing such as superimposing the observed images of the observed object. The host system 2 controls the display form of a graphical user interface (GUI) displayed on the monitor 5. Further, the host system 2 also provides a so-called video AF function that performs a focusing operation based on the contrast of an image captured by the video camera 3.

  The host system 2 is a computer having a CPU (Central Processing Unit), a main memory, a mouse 88, an interface unit, an auxiliary storage device, and the like. The CPU controls the operation of the entire microscope system by executing the control program. The main memory is used as a work memory by the CPU as needed.

The mouse 88 is a mouse with a wheel in this embodiment. This wheel has a click function, and corresponds to 24 clicks per rotation of the wheel in this embodiment.
The interface unit manages the exchange of various data with each component of the microscope system. The auxiliary storage device is, for example, a hard disk device that stores various programs and data.

Next, four wizard screens displayed as operation menu screens one by one on the monitor 5 by the host system 2 will be described.

  FIG. 2 is a diagram for explaining the outline of the four wizard screens. As shown in the figure, the four wizard screens include a wizard screen A, a wizard screen B, a wizard screen C, and a wizard screen D. The wizard screen A is a start menu screen. The wizard screen B is a specimen check menu screen. The wizard screen C is a specimen search menu screen. The wizard screen D is a shooting menu screen.

  Each of these four wizard screens is provided corresponding to each of a plurality of (four in this example) observation steps in microscope observation. And when performing microscope observation, a user switches a wizard screen sequentially according to an observation step, and uses it. The wizard screen can be switched from each wizard screen to any of the other three wizard screens, as indicated by the arrows in FIG.

  Each wizard screen is associated with a unit that can be set and operated so that only settings and operations required in the corresponding observation step can be received. Therefore, the user cannot perform unnecessary settings and operations on each wizard screen. The settings and operations received on each wizard screen are recorded in the operation history recording unit 4 as history data.

Next, each of the four wizard screens will be described in detail.
FIG. 3 is a diagram illustrating an example of the wizard screen A. As illustrated in FIG. The wizard screen A shown in the figure is a start menu screen (photographing course selection menu screen) that is the first operation menu screen for starting observation.

  In this wizard screen A, the user sets (exchanges) the specimen (slide glass) 19 to be observed from now on, and selects a speculum method (bright field observation, differential interference observation, fluorescence observation, etc.) to be observed from now on. It is possible to select an optical element (objective lens 23, cube, etc.) to be used and to set a photographed image size.

  In the wizard screen A, the specimen exchange button 36 is a button for giving an instruction to exchange the specimen 19. When the specimen replacement button 36 is pressed (for example, clicked with a mouse), the host system 2 sends an instruction to the electric stage 20 via the microscope controller 31. Based on this instruction, the electric stage 20 moves to stage position coordinates (sample exchange position coordinates) for exchanging the specimen 19.

  When the user performs a predetermined operation on the wizard screen A after setting the specimen 19 (for example, pressing the specimen exchange button 36 again), the position of the specimen 19 is set to the center stage position coordinates (observation start default coordinates). It is also possible to move the electric stage 20.

  The area 35 is a main area in the wizard screen A. The buttons 43, 44, and 45 in the area 35 are all speculum selection buttons. The button 43 is a fluorescence observation selection button. The button 44 is a differential interference observation selection button. The button 45 is a bright field observation selection button.

  Buttons 46 to 49 are all photographing method selection buttons. For example, the button 46 is a button for selecting normal shooting. The button 47 is a button for selecting Z stack shooting. The button 48 is a button for selecting time-lapse shooting.

  The button 51 is a button for shifting to the wizard screen B corresponding to the next observation step. The button 52 is a button for returning to the wizard screen before shifting to the wizard screen A. For example, when the wizard screen D is shifted to the wizard screen A, when the button 52 is pressed (for example, clicked with the mouse), the wizard screen D is returned to. The area 50 is an area for displaying various explanations.

  The area 37 is an area for selection, addition, and replacement (physical replacement) of optical elements to be used. The user can set a cube or the like to be used for observation by the selected spectroscopic method via this area 37. That is, the user can set only the optical elements related to the spectroscopic method selected on the wizard screen A among the various optical elements that can be driven by the microscope apparatus 1.

  Buttons 38 to 41 are buttons for directly shifting to another wizard screen. The button 38 is a button for shifting to the wizard screen A. The button 39 is a button for shifting to the wizard screen B. The button 40 is a button for shifting to the wizard screen C. The button 41 is a button for shifting to the wizard screen D. However, when a button for shifting to the same wizard screen as the wizard screen displayed on the monitor 5 is pressed (for example, clicking with a mouse), the wizard screen is not shifted. The buttons 38 to 41 are also provided on a wizard screen B, a wizard screen C, and a wizard screen D described later.

In the wizard screen A, it is also possible to set an image size when shooting with the video camera 3.
In this way, the settings and operations that can be performed by the user on the wizard screen A are, in principle, for instructing the movement of the electric stage 20 for exchanging the specimen 19 and for the imaging course (spectroscopic method). For selecting the optical element, for exchanging the optical element, and for setting the captured image size. Therefore, settings and operations for other units cannot be performed from the wizard screen A. Further, the area 50 is a menu for displaying various explanations.

  FIG. 4 is a diagram illustrating an example of the wizard screen B. As illustrated in FIG. The wizard screen B shown in the figure is an operation menu screen for searching for an initial observation start position in a macro image (photographed image with a low magnification objective lens) and performing an AF operation (focusing operation) on the macro image. It is a specimen check menu screen.

  In the wizard screen B, a range of an area 54 indicated by a rectangle in the slide image area 53 indicates an operable range of the electric stage 20 with respect to the entire slide glass as the specimen 19.

  The macro image display area 56 is an area where a macro image serving as a LIVE image of the specimen 19 photographed in real time by the video camera 3 is displayed. When the wizard screen B is displayed on the monitor 5, the objective lens 23 to be used is fixed to a low magnification (here, 4 × (4 ×) objective lens).

  In principle, the macro image displayed in the macro image display area 56 is a macro image taken under the spectroscopic method selected on the wizard screen A shown in FIG. However, when the spectroscopic method selected on the wizard screen A is fluorescence observation, it is necessary to prevent discoloration of the observation target in the specimen 19. Therefore, on the wizard screen B, the spectroscopic method is switched to differential interference observation, and a macro image taken under the differential interference observation is displayed.

  In the slide image area 53, a range corresponding to the macro image displayed in the macro image display area 56 is shown as a rectangular frame 54. The position of the cross mark 55 in the slide image area 53 is the center position displayed as a macro image in the macro image display area 56.

  Around the macro image display area 56, buttons 57 to 60 for moving the specimen 19 in four directions are provided. When the user presses one of the buttons 57 to 60 (for example, clicks with the mouse), the electric stage 20 moves in the direction corresponding to the button, and the specimen 19 moves in that direction.

  Therefore, the user can select the initial observation start position where the observation target in the specimen 19 exists by pressing the buttons 57 to 60 while confirming the display contents of the slide image area 53 and the macro image display area 56. . When the initial observation start position is selected, the AF operation can be executed. Thereby, the focus coordinate (Z coordinate) in a macro image can be determined.

  In addition, after the initial observation start position is selected, the AF operation can be executed by the user pressing the button 61 (for example, clicking the mouse), and the in-focus coordinate (Z coordinate) in the macro image is determined. can do.

  When fluorescence observation is selected on the wizard screen A, as described above, the microscopic method is temporarily switched to differential interference observation, and a macro image photographed under the differential interference observation is macroscopic. It is displayed in the image display area 56. Therefore, the selection of the initial observation start position and the determination of the in-focus coordinates in the macro image are also performed on the macro image photographed under the differential interference observation.

  The button 61 is a movement instruction button for moving to the wizard screen C corresponding to the next observation step in addition to the execution of the AF operation. When the user presses the button 61, the screen shifts to the wizard screen C. The button 62 is a button for returning to the wizard screen before shifting to the wizard screen B.

  As described above, the settings and operations that can be performed by the user on the wizard screen B are for selecting the initial observation start position where the observation target in the specimen 19 exists and for performing the AF operation on the macro image. It has become.

  When the wizard screen A is shifted to the wizard screen B, switching to the speculum method selected on the wizard screen A is automatically performed. As a result, an image by the microscopic method selected on the wizard screen A can be displayed in the macro display area 56 of the wizard screen B. However, when fluorescence observation is selected as the speculum method, switching to differential interference observation is performed as described above. In this switching of the speculum method, the objective lens 23 and other settings are set to default values according to the speculum method to be switched.

  FIG. 5 is a diagram illustrating an example of the wizard screen C. As illustrated in FIG. The wizard screen C shown in the figure is a sample search menu screen serving as an operation menu screen for searching for an imaging position in the sample 19 and selecting an imaging magnification.

  In the wizard screen C, a macro LIVE image area 63 is an area in which a macro image to be a LIVE image of the specimen 19 photographed in real time by the video camera 3 is displayed.

  In the macro LIVE image area 63, the user can search for an imaging target position in the specimen 19 and select an imaging range. Even when the wizard screen C is displayed on the monitor 5, as in the case of the wizard screen B, the objective lens 23 to be used is fixed at a low magnification (here, a 4x objective lens). .

  The range designation frame 64 indicates a shooting range by the video camera 3 on the wizard screen D corresponding to the next observation step, and is indicated by a rectangle. That is, the range indicated by the range designation frame 64 corresponds to the visual field range by the objective lens 23 used at the time of photographing on the next wizard screen D. The range designation frame 64 can be moved within the range of the macro LIVE image area 63 by a drag and drop operation with the mouse.

  The range designation frame switching area 67 is an area for changing the size (shooting magnification) of the range designation frame 64. In the range designation frame switching area 67, the user can move the slider 67a left and right to change the size (shooting magnification) of the range designation frame 64 (here, 20x to 60x (20 times)). It can be changed within the range of up to 60 times).

  The slide area 65 is an area indicating the position of the macro LIVE image area 63 with respect to the entire slide glass that is the specimen 19. In the slide area 65, a cross mark 66 indicates a position corresponding to the center of the macro image displayed in the macro LIVE image area 63.

The tool area 69 is for adjusting the brightness of the macro image displayed in the macro LIVE image area 63.
The focus area 68 is an area for adjusting the focus of the macro image displayed in the macro LIVE image area 63. In the focus area 68, when the user moves the slide bar 68a up and down, an instruction to move the electric stage 20 in the optical axis direction (Z direction) is given, and the focus position can be changed.

  Note that the instruction to move the electric stage 20 in the direction orthogonal to the optical axis direction (XY direction) is performed by the user performing a macro image scrolling operation by dragging and dropping the mouse on the macro LIVE image area 63. It is possible.

  The button 70 is a button for shifting to the wizard screen D corresponding to the next observation step for performing photographing in the range designated by the range designation frame 64. The button 71 is a button for returning to the wizard screen before shifting to the wizard screen C.

  As described above, the settings and operations that can be performed by the user on the wizard screen C are for searching for a shooting position in the specimen 19 and for selecting a shooting magnification.

  FIG. 6 is a diagram illustrating an example of the wizard screen D. As illustrated in FIG. The wizard screen D shown in the figure is a shooting menu screen that serves as an operation menu screen for shooting the range designated by the range designation frame 64 of the wizard screen C.

  In the wizard screen D, the image display area 72 is an area in which a LIVE image in which the sample 19 in the range designated by the range designation frame 64 of the wizard screen C is captured in real time by the video camera 3 is displayed, or its range. This is an area where a PAUSE image of the specimen 19 taken by the video camera 3 is displayed.

  In this image display area 72, when the user designates a position in the image display area 72 (for example, a double click of the mouse) when the LIVE image is displayed, the designated position is displayed in the image display area 72. The electric stage 20 can be moved so as to be in the center position. Therefore, the user can also instruct to move the electric stage 20 for adjusting the shooting position from the image display area 72.

  The display image switching area 85 is an area for switching an image to be displayed in the image display area 72 to either a LIVE image that is a real-time image or a PAUSE image that is a captured image.

  A button 86 in the display image switching area 85 is for switching an image to be displayed in the image display area 72 to a LIVE image. The button 87 is for switching an image to be displayed in the image display area 72 to a PAUSE image. During fluorescent image display, a PAUSE image is displayed if no operation is performed for a certain period of time to prevent discoloration.

  The focus / correction ring area 73 is used to perform focus and AF operations on the image displayed in the image display area 72. In the focus / correction ring area 73, the slide bar 74 is used for focus adjustment.

  As with the slide bar 68a in the wizard screen C, the slide bar 74 is instructed to move the electric stage 20 in the optical axis direction (Z direction) when the user moves the slide bar 74 up and down. The focus position can be changed.

  The AF button 75 is for performing an AF operation (focusing operation). The correction ring adjustment buttons 76A and 76B are used for instructing driving of the correction ring for correcting the aberration of thickness by the cover glass.

  The stage control / map area 77 is an area that displays the display range of the image display area 72 and its surrounding images, and also allows the images displayed in the area 77 to be scrolled. In the stage control / map area 77, the display range of the image display area 72 is shown as a rectangular frame 78.

  The button 79 lists images taken in the past under the same or similar observation conditions as the current observation conditions (microscopic method, cube in use, objective lens magnification (magnification), photographed image size, etc.). It is a button for displaying.

The button 80 is used to give an instruction to change the optical magnification (zoom). The button 80 can be changed to a low magnification when it is slid left, and can be changed to a high magnification when it is slid right.
The SHOT button 81 is a button for taking a LIVE image displayed in the image display area 72. An area 84 is used by the user to manually set shooting conditions. The button 82 is a button for shifting to the wizard screen C. The button 83 is a button for returning to the wizard screen before shifting to the wizard screen D.

The speculum method change instruction area 89 is an area for instructing to switch the speculum method. In this example, the fluorescent cubes A, B, C and DIC observation can be switched.
As described above, the settings and operations that can be performed by the user on the wizard screen D are for photographing the range specified by the range specification frame 64 of the wizard screen C.

  Next, the operation of the microscope system when performing specimen observation while using the above four wizard screens will be described. In the following, the operation will be described using an example in which fluorescence observation is selected as the spectroscopic method, fluorescence cube A is selected as the cube to be used, and specimen 19 is photographed under fluorescence observation using fluorescence cube A. I will do it.

  7 to 10 are flowcharts showing the specimen observation operation. These flows are controlled by the host system 2. FIGS. 11 to 19 are diagrams showing examples of wizard screens displayed on the monitor 5 during the operation.

  First, in order to start specimen observation, a wizard screen A (see FIG. 3) is displayed on the monitor 5 by a predetermined operation by the user. Thereby, the process shown in FIG. 7 related to the wizard screen A which is the start menu screen is started.

  In FIG. 7, first, the host system 2 moves the electric stage 20 to stage position coordinates (specimen exchange position coordinates) for exchanging the specimen (observer) 19 in response to the user pressing the specimen exchange button 36. . After the movement of the electric stage 20 is completed, the sample 19 is set by the user (S101).

  When the specimen 19 is set, the host system 2 determines the position of the specimen 19 in advance on the electric stage 20 in response to a predetermined operation on the wizard screen A by the user (for example, pressing the specimen exchange button 36 again). The electric stage 20 is moved so as to be the center stage position coordinate (observation start default coordinate) (S102). Thereby, the position of the electric stage 20 is set to the reference point coordinates.

  Subsequently, the microscopic method is selected by pressing any one of the buttons 43 to 45 by the user (S103). Thereby, the microscopic method for performing observation is selected. In this example, since fluorescence observation is selected, it is assumed that the button 43 is pressed here.

  Subsequently, a cube is selected by an operation on the area 37 by the user (S104). Thereby, the cube used for observation is selected. In this example, since the fluorescent cube A is used, it is assumed that the fluorescent cube A is selected here.

  Subsequently, as a camera initial setting, an image size when shooting with the video camera 3 is set by a predetermined operation on the wizard screen A by the user (S105). In this example, it is assumed that M × N (M> 0, N> 0) is set as the captured image size.

  Subsequently, in response to the user pressing the button 51, the host system 2 records the settings and operations performed in S101 to S105 as history data in the operation history recording unit 4 (S106). In this example, the fact that fluorescence observation is selected as the spectroscopic method, the fact that the fluorescent cube A is selected as the cube to be used, the photographed image size is set to M × N, and the like are recorded as history data. Part 4 is recorded. Then, the wizard screen A displayed on the monitor 5 is switched to the wizard screen B (see FIG. 4). As a result, the flowchart shown in FIG. 8 related to the wizard screen B, which is the sample check menu screen, starts.

  In FIG. 8, when transitioning to the wizard screen B, the host system 2 first instructs the microscope controller 31. Based on this instruction, the microscope controller 31 moves the electric stage 20 to a predetermined standard focus (Z coordinate) position (S201), and switches the objective lens 23 to be used to a 4x lens (S202).

  Subsequently, the host system 2 reads the speculum method selected in S103 from the operation history recording unit 4 (S203). Then, the host system 2 switches the current microscopic method to a microscopic method corresponding to the read microscopic method (S204).

  In this example, the fact that the fluorescence observation is selected as the speculum method is recorded in the operation history recording unit 4, so that the fluorescence observation is read out as the selected speculum method. Then, the current spectroscopic method is switched to differential interference observation as a spectroscopic method corresponding to the read fluorescence observation.

  In this way, when the speculum method selected on the wizard screen B is fluorescence observation, as described above, switching to differential interference observation instead of fluorescence observation is performed in order to prevent the observation target from fading. Is called. Thereby, the setting of the microscope apparatus 1 according to the current spectroscopic method is switched to the setting of the microscope apparatus 1 according to differential interference observation.

  When the switching of the spectroscopic method is completed, the host system 2 captures the specimen 19 in real time by the video camera 3 under the switched spectroscopic method, and displays the macro image as the LIVE image in the macro image display area 56. Start that.

  In this example, since switching to differential interference observation, the host system 2 captures the sample 19 in real time by the video camera 3 under the differential interference observation, and displays a macro image as a LIVE image as a macro image display. Display in the area 56 is started. FIG. 11 is a diagram showing an example of the wizard screen B at this time.

  Subsequently, the host system 2 moves the electric stage 20 in response to the user pressing the buttons 57 to 60 (S205). By this operation, the initial observation start position where the observation target in the specimen 19 exists is selected (S206). Accordingly, the user can search for the initial observation start position where the observation target in the specimen 19 exists by pressing the buttons 57 to 60 while confirming the display contents of the slide image area 53 and the macro image display area 56. it can. Then, the user can select a desired position as the initial observation start position.

  The position selected as the initial observation start position is the center position of the macro image displayed in the macro image display area 56. In this example, the point a on the macro image displayed in the macro image display area 56 of the wizard screen B shown in FIG. 11 is selected as the initial observation start position. In this case, the buttons 57 to 60 are pressed so that the point a becomes the center position of the macro image display area 56.

  Then, as shown in FIG. 12, it is assumed that the point a becomes the center position of the macro image display area 56 and is selected as the initial observation start position. The XY coordinates of the initial observation start position at this time are (x_a, y_a). As the point a moves to the center of the macro image display area 56, the rectangular frame 54 moves to a corresponding position in the slide image area 53 of the wizard screen B shown in FIG.

  After the selection of the initial observation start position is completed, the host system 2 controls the AF operation at the selected initial observation start position in response to the user pressing the button 61 (S207). In this example, the Z coordinate that is the in-focus coordinate after the AF operation is set to (z_a).

Subsequently, the host system 2 records the settings and operations performed in S201 to S207 in the operation history recording unit 4 as history data (S208).
In this example, the XY coordinates (x_a, y_a) and the Z coordinate (z_a) are recorded in the operation history recording unit 4 as history data. Then, the wizard screen B displayed on the monitor 5 is switched to the wizard screen C (see FIG. 5). As a result, the processing shown in the flowchart of FIG. 9 related to the wizard screen C which is the sample search menu screen starts.

  In FIG. 9, when moving to the wizard screen C, the host system 2 first instructs the microscope controller 31 to switch to the 4x objective lens 23 when the objective lens 23 to be used is not 4x (S301).

Subsequently, the host system 2 reads the selected speculum method from the operation history recording unit 4 (S302), and switches the current speculum method to the read speculum method (S303).
In this example, the fact that the fluorescence observation is selected as the speculum method is recorded in the operation history recording unit 4, so that the fluorescence observation is read out as the selected speculum method. At the same time, the fluorescent cube A is read as the selected cube. Then, the current spectroscopic method and cube are switched to the read fluorescence observation and fluorescence cube A. Thereby, the setting of the microscope apparatus 1 according to the current spectroscopic method is switched to the setting of the microscope apparatus 1 according to the fluorescence observation using the fluorescent cube A.

  When the switching of the speculum method is completed, the host system 2 captures the specimen 19 in real time by the video camera 3 under the switched speculum method, and displays the macro image that becomes the LIVE image in the macro LIVE image area 63. Start that.

  In this example, since the fluorescence observation using the fluorescent cube A is switched, the host system 2 captures the specimen 19 in real time by the video camera 3 under the fluorescence observation using the fluorescent cube A, and the LIVE Display of the macro image to be an image in the macro LIVE image area 63 is started. FIG. 13 is a diagram showing an example of the wizard screen C at this time.

  Subsequently, the host system 2 moves the range designation frame 64 in response to an operation (drag and drop by the mouse) of the range designation frame 64 of the macro LIVE image area 63 by the user. Alternatively, the host system 2 moves the electric stage 20 in response to the macro image scroll operation by the mouse drag and drop operation on the macro LIVE image area 63 by the user (S304). Thereby, an observation target (imaging target) is determined (S305). Thereby, the user can search for the observation target and can determine the range as the observation target by matching the desired range with the range designation frame 64.

  In this example, the point b on the macro image displayed in the macro LIVE image area 63 of the wizard screen C shown in FIG. 13 is determined as the observation target. In this case, the range designation frame 64 is operated so that the point b becomes the center position of the range designation frame 64. Then, as shown in FIG. 14, the point b becomes the center position of the range designation frame 64 and is determined as an observation target. In FIG. 14, a frame 64 'indicates the range designation frame 64 after movement.

  Subsequently, the host system 2 determines the observation target determined in S305 as the imaging target position. At the same time, the host system 2 changes the size of the range designation frame 64 according to the operation of the slider 67a in the range designation frame switching area 67 by the user, and determines the photographing magnification (objective lens magnification) (S306).

  In this example, the point b in the range designation frame 64 ′ shown in FIG. 14 is determined as the shooting target position. At the same time, it is assumed that an objective lens having a photographing magnification of 20x is determined according to the operation of the slider 67a by the user. Note that the XY coordinates of the position of the point b are (x_b, y_b).

  Subsequently, in response to the user pressing the button 70, the host system 2 captures the range displayed in the macro LIVE image area 63 at this time. The host system 2 records the macro image obtained by photographing at this time and the settings and operations performed in S301 to S306 in the operation history recording unit 4 as history data (S307).

  In this example, a macro image obtained by photographing the range displayed in the macro LIVE image area 63 at this time is defined as a macro image (pic_m_b). Then, the operation history recording unit 4 corresponds to the macro image (pic_m_b), the XY coordinates (x_b, y_b) of the b point as the coordinates of the photographing target position, and the size of the range designation frame 64 after the change. The photographing magnification (20x) and the like are recorded as history data. Then, the wizard screen C displayed on the monitor 5 is switched to the wizard screen D (see FIG. 6). As a result, the process shown in the flowchart of FIG. 10 related to the wizard screen D which is the shooting menu screen starts.

  In FIG. 10, when moving to the wizard screen D, the host system 2 first reads the determined coordinates of the photographing target position and the photographing magnification from the operation history recording unit 4 (S401). The host system 2 switches the objective lens 23 to the objective lens 23 corresponding to the read photographing magnification (S402). Further, the host system 2 moves the electric stage 20 to the coordinates of the read target position (S403).

  In this example, since the coordinates (x_b, y_b) of the shooting target position and the shooting magnification (20x) are recorded in the operation history recording unit 4, the objective lens 23 is switched to that of 20x, and the coordinates of the shooting target position ( The electric stage 20 moves to x_b, y_b).

  Then, the host system 2 uses the switched objective lens 23 to image the imaging target position of the specimen 19 with the video camera 3 in real time, and starts displaying the LIVE image in the image display area 72. Further, the macro image recorded in the operation history recording unit 4 immediately before the transition to the wizard screen D is read by the host system 2, and the macro image is displayed in the stage control / map area 77.

  In this example, the video camera 3 uses the switched 20x objective lens (the 20x objective lens determined according to the size of the range designation frame 64 ′ shown in FIG. 14) to be a shooting target position in real time. Point b is photographed, and the display of the LIVE image in the image display area 72 is started. Also, the macro image (pic_m_b) recorded in the operation history recording unit 4 immediately before shifting to the wizard screen D is read out. The macro image (pic_m_b) is displayed in the stage control / map area 77. FIG. 15 is a diagram showing an example of the wizard screen D at this time.

  As shown in the wizard screen D of FIG. 15, the point b that is the shooting target position is displayed at the center of the image display area 72. Further, a macro image (pic_m_b) is displayed in the stage control / map area 77.

  Subsequently, according to the designation of the position in the image display area 72 by the user, the host system 2 moves the electric stage 20 so that the designated position becomes the center position of the image display area 72 (S404). Thereby, the user can perform fine adjustment of the shooting target position (the range in which shooting is performed).

  In this example, the point c on the LIVE image displayed in the image display area 72 of the wizard screen D shown in FIG. When the c point is designated by the user, the host system 2 moves the electric stage 20 so that the c point becomes the center position of the image display area 72.

  Then, as shown in FIG. 16, it is assumed that the point c is the center position of the image display area 72 and is the shooting target position. At this time, as the point c moves to the center of the image display area 72, the rectangular frame 78 moves to a position corresponding to the point C in the stage control / map area 77. It is assumed that the XY coordinates of the position of point c are (x_c, y_c).

  Subsequently, in response to the user pressing the AF button 75 in the focus / correction ring area 73 (for example, clicking with the mouse), the host system 2 controls the AF operation (focusing operation) (S405).

  Further, after this AF operation, the focus position is changed by moving the electric stage 20 in the optical axis direction (z direction) in accordance with the operation of the slide bar 74 in the focus / correction ring area 73 by the user. You can also. Thereby, the user can also perform fine adjustment of an in-focus position. Note that the AF operation itself performed in S405 may be performed manually by only operating the slide bar 74. The Z coordinate that is the coordinate of the in-focus position is (z_c).

Subsequently, the host system 2 determines whether or not correction ring data (correction ring position) for the current specimen 19 is recorded in the operation history recording unit 4 (S406).
If the determination result in S406 is No, the host system 2 performs correction ring position adjustment / determination processing (S407). In this process, the host system 2 controls to drive the correction ring of the objective lens 23 in use in response to the pressing of the correction ring adjustment buttons 76A and 76B in the focus / correction ring area 73 by the user. Thus, the user can adjust the optimal correction ring position by pressing the correction ring adjustment buttons 76A and 76B while confirming the LIVE image displayed in the image display area 72. Therefore, aberration correction of thickness by the cover glass can be performed.

  Then, in response to a predetermined operation on the wizard screen D by the user, the host system 2 records the current correction ring position in the operation history recording unit 4 as a correction ring position (correction ring data) after adjustment (after correction). To do. Thereby, the user can record the corrected correction ring position in the operation history recording unit 4. In this example, it is assumed that the correction ring position (h_1) is recorded in the operation history recording unit 4 as correction ring data.

  On the other hand, if the determination result in S406 is Yes, the host system 2 reads the correction ring data recorded in the operation history recording unit 4, and drives the correction ring to a position corresponding to the correction ring data (S408). . Thereby, the correction ring is driven to an optimum position, and the thickness aberration correction by the cover glass can be performed. For example, if the correction ring position (h_1) is recorded in the operation history recording unit 4 as correction ring data, the correction ring is driven to the correction ring position (h_1) according to the correction ring data.

  With this process of S406 to S408, in this flow, the process of S407 is performed only once for one sample. After the process of S407 is performed once, the process of S407 is not performed until the sample is exchanged, and the process of S408 is performed instead.

  When the processing of S407 or S408 ends, the host system 2 determines whether or not the button 79 has been pressed by the user (S409). This determination is to determine whether or not to use the shooting conditions used at the time of past shooting when setting the shooting conditions of the video camera 3.

  Here, when the determination result in S409 is Yes, the host system 2 is the same as the current observation condition (the spectroscopic method, the cube in use, the magnification of the objective lens (imaging magnification), the captured image size, etc.) or An image (however, excluding a macro image) that has been captured by the video camera 3 and recorded in the operation history recording unit 4 in the past under similar observation conditions is searched. Then, the host system 2 displays a list of the corresponding images in a window displayed separately from the wizard screen D (S410). FIG. 17 is a diagram showing an example of the window at this time.

  In the example of the window shown in FIG. 17, in addition to the top four images (pic_1 to pic_4) having a high degree of similarity, the most recently captured image (however, excluding the macro image) (pic_0) is also displayed. . In FIG. 17, pic_0 to pic_4 are shown for convenience of explanation, and are not actually displayed.

  Subsequently, one image in the window is selected by an image selection operation (for example, click with the mouse) by the user. The host system 2 sets shooting conditions for shooting the selected image, and displays the shooting conditions on the menu 84 (S411). Thus, the user can easily reproduce the shooting condition used when the image is shot by selecting a desired image in the window.

  For example, as shown in FIG. 17, a thick dotted frame (see pic_0 image) is provided for the image selected in the window, and is displayed so as to be distinguishable from the unselected image. Further, this window disappears when, for example, the wizard screen D is switched to another wizard screen.

  In this flow, the reproducible shooting conditions are exposure, light control (including ND filter), W / B (white balance), and B / B (black balance) shooting conditions. XY coordinates and Z coordinates are not reproduced. In the reproducible shooting conditions, it is further possible to select whether or not to reproduce for each shooting condition.

  Note that this selection can be performed, for example, from within a window in which images are displayed in a list. In this case, when the user selects a desired image from the list-displayed window, for example, shooting conditions when the image is shot are also displayed in the window. Thereby, it is realizable by comprising so that a user can select the photography conditions which are not reproduced or reproduced.

  In this example, in the example of the window shown in FIG. 17, an image (pic_2) is selected by the user, and exposure (ae_2), dimming (l_2), W / B (wb_2), B / B ( bb_2) is set and reproduced.

  On the other hand, if the determination result in S409 is No, the host system 2 sets the shooting conditions for the last shooting (except for the shooting conditions for macro image shooting), and sets the shooting conditions in the menu. 84. Note that the shooting conditions can be set and displayed immediately after switching to the wizard screen D.

  When the shooting conditions are set in this manner, the host system 2 subsequently changes the set shooting conditions in response to an operation (for example, mouse click) for changing the shooting conditions for the menu 84 by the user. (S412). Thereby, the user can perform fine adjustment of the set photographing conditions. Of course, this allows the user to manually set the shooting conditions.

  Subsequently, in response to the user pressing the SHOT button 81, the host system 2 captures a LIVE image displayed in the image display area 72 (S413). In this example, the shooting conditions at this time (shooting conditions when shooting point c) are exposure (ae_c), light control (l_c), W / B (wb_c), and B / B (bb_c). The obtained image is set to (pic_c). When the LIVE image is captured, the captured image is displayed in the image display area 72 as a PAUSE image.

  Subsequently, the host system 2 records the settings and operations performed in S401 to S413 in the operation history recording unit 4 as history data (S414). In this example, the above XY coordinates (x_c, y_c) and Z coordinates (z_c), which are also the current XY coordinates and Z coordinates, and exposure (ae_c) and adjustment conditions, which are the shooting conditions when shooting point c in S413, are taken. Light (l_c), W / B (wb_c), B / B (bb_c), a captured image (pic_c), and the like are recorded in the operation history recording unit 4. In S414, the PAUSE image displayed in the image display area 72 can be switched to the LIVE image by pressing the button 86 by the user.

  The above is a series of operations for observing a specimen while using the wizard screen. However, as described above, each wizard screen can be switched to another wizard screen as necessary. In this case, the flow shown in FIG. 7 can be resumed by switching to the wizard screen A by pressing the button 38. Further, by pressing the button 39, it is possible to switch to the wizard screen B and restart the flow shown in FIG. Further, by pressing the button 40 or the button 82, it is possible to switch to the wizard screen C and restart the flow shown in FIG. Further, by pressing the button 41, it is possible to switch to the wizard screen D and restart the flow shown in FIG.

  As a result, for example, when the user presses the button 82 after the above-described processing of S414 is completed, it is possible to continue searching for an observation target to be another shooting point. In this case, the wizard screen D displayed on the monitor 5 is switched to the wizard screen C in response to the user pressing the button 82. Then, the objective lens 23 to be used is changed from 20x to 4x. Then, a macro image (LIVE image) by the 4 × objective lens is displayed again in the macro LIVE image area 63.

  Note that the XY coordinates and Z coordinates at this time are inherited from the XY coordinates and Z coordinates immediately before switching from the wizard screen D to the wizard screen C, as is apparent from the flowchart relating to the wizard screen C (see FIG. 9). It is.

  Therefore, in this example, the XY coordinates and the Z coordinates are inherited from the XY coordinates (x_c, y_c) and the Z coordinates (z_c) immediately before switching to the wizard screen C. FIG. 18 is a diagram showing an example of the wizard screen C at this time.

  Here, by the user's operation on the wizard screen C in FIG. 18, the point d displayed in the macro LIVE image area 63 is determined as a new observation target, 20x is determined as the imaging magnification, and the wizard screen D is displayed. Can be switched.

  Then, in the image display area 72 on the wizard screen D, a d-point LIVE image by a 20 × objective lens is displayed. FIG. 19 is a diagram showing an example of the wizard screen D at this time.

  Here, the user can again set the shooting condition when the last shooting was performed as the shooting condition. It is also possible to set shooting conditions used at the time of past shooting by pressing the button 79. The user can also finely adjust the shooting conditions set in this way via the menu 84.

Next, control of the drive unit constituting the microscope system by the wheel operation of the mouse 88 will be described.
FIG. 20 shows an example of the mouse 88. The mouse 88 is a mouse with a wheel, and includes a left button 90, a right button 92, and a wheel 91. The wheel 91 is generally used for scrolling the screen and rotates in the direction of W1 and the direction of W2. The rotation direction and amount of rotation of the wheel 91 are detected by the host system 2. P indicates an example of the mouse pointer of the mouse 88 displayed on the screen.

  A function for controlling the drive unit is assigned to the wheel 91. At this time, the drive unit to be controlled is different for each wizard screen and for each area in the wizard screen.

The function assignment for the wizard screen C will be described below with reference to the screen diagrams of FIGS. 21 to 34 and the flowchart of FIG.
In the flowchart of FIG. 35, the host system 2 divides the inside of the wizard screen C into a plurality of areas, and assigns a function for controlling the drive unit to each area (S501). As shown in FIG. 21, the host system 2 divides the operation category by the wheel 91 into areas of an operation category A, an operation category B, an operation category C, an operation category D, and an operation category E on the wizard screen C.

  In this way, the following is realized by dividing the wizard screen C into a plurality of areas. That is, when the position of the mouse pointer is moved to each operation section and the wheel 91 is rotated in the moved operation section, the drive of the drive unit assigned to the operation section is controlled.

  First, as shown in FIG. 21, a case where the mouse pointer is in the segmented area A will be described. When the wheel 91 is operated (S502), the host system 2 detects the position of the mouse pointer P (S503). When the mouse pointer P is in the operation area A (S504), the host system 2 changes the GUI (graphical user interface) of the mouse pointer from the form indicated by P to the form indicated by Pa in FIG. 22 (S508).

  In order to adjust the distance between the objective lens 23 and the electric stage 20, the host system 2 controls the drive of the stage Z drive control unit 22 via the microscope controller 32 according to the rotation direction and the rotation amount of the wheel 91. This is performed (S509).

  That is, when the wheel 91 is moved in the direction W2, the host system 2 controls the drive of the stage Z drive control unit 22 in the direction in which the sample 19 approaches the objective lens 23 according to the rotation amount of the wheel 91. Do. When the wheel 91 is moved in the direction of W1, the host system 2 controls the drive of the stage Z drive control unit 22 in the direction in which the sample 19 moves away from the objective lens 23 according to the amount of rotation of the wheel 91. Do.

  The electric stage 20 can be driven at 10 μm per click of the wheel in the Z direction. Since the magnification is fixed on the wizard screen C, the drive amount is also fixed. In the case of a mouse wheel without a click, the driving amount per one rotation of the wheel may correspond to 240 μm, for example.

  When the drive operation of the stage Z drive control unit 22 is finished, the host system 2 returns the mouse pointer GUI to the form indicated by P again (S519). As described above, when the mouse pointer is in the divided area A, the electric stage 20 can be driven in the Z direction by rotating the wheel 91.

  Next, as shown in FIG. 23, a case where the mouse pointer is in the segmented area B will be described. When the wheel 91 is operated (S502), the position of the mouse pointer P is detected (S503). When the mouse pointer P is in the segmented area B (S505), the host system 2 changes the GUI of the mouse pointer from the form indicated by P to the form indicated by Pb in FIG. 24 (S511).

  Subsequently, the size of the range designation frame 64 indicating the range in which shooting is performed by the video camera 3 on the next wizard screen D is changed according to the rotation direction and the rotation amount of the wheel 91 by the mouse operation. . Then, the host system 2 sets a shooting range based on the changed size of the range designation frame 64 (S512).

  That is, when the wheel 91 is moved in the direction W1, the host system 2 moves the wheel 91 in the direction in which the shooting range increases from B to B ′ (in the direction in which the shooting magnification decreases) as shown in FIG. The size of the range designation frame 64 that surrounds the photographing range is changed according to the amount of rotation. Further, when the wheel 91 is moved in the direction of W2, the host system 2 moves the shooting range from B to B ″ as shown in FIG. 25 (in the direction in which the shooting magnification increases). In accordance with the rotation amount of the wheel 91, the size of the range designation frame 64 surrounding the photographing range is changed.

  If the mouse pointer has moved outside the segmented area B, the host system 2 again returns the mouse pointer GUI to the form indicated by P (S519). After the shooting range is changed by the wheel operation, when the screen shifts to the wizard screen D, it is possible to perform shooting in the range specified by the range specification frame 64. Therefore, when the pointer is in the segmented area B, the shooting range on the next wizard screen D can be set by rotating the wheel 91.

  Next, a case where the mouse pointer P is in the segmented area C as shown in FIG. 26 will be described. When the wheel 91 is operated (S502) and the mouse pointer P is in the operation area C (S506), the host system 2 changes the GUI of the mouse pointer from P to Pc in FIG. It changes to the form shown (S513).

  Subsequently, the host system 2 controls the drive in the X direction of the stage XY drive control unit 21 according to the rotation direction and the rotation amount of the wheel 91 via the microscope controller 32 (S514).

  That is, when the wheel 91 is moved in the direction W1, the host system 2 moves the stage X in accordance with the rotation amount of the wheel 91 in order to move the sample 19 in the X direction indicated by the left-pointing arrow in FIG. -Drive control of the Y drive control unit 21 is performed. When the wheel 91 is moved in the direction W2, in order to move the specimen 19 in the X direction indicated by the right-pointing arrow in FIG. 28, the host system 2 changes the stage XY according to the rotation amount of the wheel 91. Drive control of the drive control unit 21 is performed.

  The driving amount of the electric stage 20 corresponds to a moving amount corresponding to ¼ screen in the display area direction per click of the mouse wheel. In the case of a mouse wheel without a click, the driving amount per rotation of the mouse wheel may correspond to, for example, a driving amount for five screens.

  When the driving operation of the electric stage 20 is completed, the host system 2 returns the mouse pointer GUI to the form indicated by P again (S519). Therefore, when the mouse pointer is in the divided area C, the electric stage 20 can be driven in the X direction by rotating the wheel 91.

  Next, the case where the mouse pointer is in the segmented area D as shown in FIG. 29 will be described. When the wheel 91 is operated (S502) and the mouse pointer P is in the operation area D (S507), the host system 2 changes the GUI of the mouse pointer from P to Pd in FIG. It changes to the form shown (S515).

  Subsequently, the host system 2 controls the drive in the Y direction of the stage XY drive control unit 21 according to the rotation direction and the rotation amount of the wheel 91 via the microscope controller 32 (S516).

  That is, when the wheel 91 is moved in the direction of W1, the host system 2 moves the stage X in accordance with the amount of rotation of the wheel 91 in order to move the specimen 19 in the X direction indicated by the upward arrow in FIG. -Drive control of the Y drive control unit 21 is performed. When the wheel 91 is moved in the direction of W2, the host system 2 moves the specimen 19 in the X direction indicated by the downward arrow in FIG. The drive control of the Y drive control unit 21 is performed.

  When the driving operation of the electric stage 20 is completed, the operation of returning the mouse pointer GUI to the form indicated by P is performed again (S519). Therefore, when the mouse pointer is in the divided area C, the stage 91 can be driven in the Y direction by rotating the wheel 91.

  Next, the case where the mouse pointer is in the segmented area E as shown in FIG. 32 will be described. When the wheel 91 is operated (S502) and the mouse pointer P is in the operation area E (S520), the host system 2 indicates the pointer GUI from P to Pe in FIG. The form is changed (S517).

  Subsequently, the host system 2 performs dimming control of the light source according to the rotation direction and the rotation amount of the wheel 91 via the microscope controller 32 (S518). When the wheel 91 is moved in the direction of W1, the sample image in the range designation frame 64 becomes bright as shown in FIG. When the wheel 91 is moved in the direction of W2, the sample image in the range designation frame 64 becomes dark as shown in FIG.

  That is, when the wheel 91 is moved in the direction of W1, the host system 2 performs dimming drive control of the light source in accordance with the amount of rotation of the wheel 91 in the direction of increasing the amount of light as shown in FIG. When the wheel 91 is moved in the direction of W2, the host system 2 performs dimming drive control of the light source according to the amount of rotation of the wheel 91 in the direction of decreasing the amount of light as shown in FIG.

  When the light source dimming driving operation is completed, the host system 2 returns the GUI of the mouse pointer to the form indicated by P again (S519). Therefore, when the mouse pointer is in the segmented area E, the dimming drive control of the light source can be performed by rotating the wheel 91.

Next, function assignment for the wizard screen D will be described with reference to the screen diagrams of FIGS. 36 to 38 and the flowchart of FIG. 39.
In the flowchart of FIG. 39, the host system 2 divides the inside of the wizard screen D into a plurality of areas, and assigns a function for controlling the drive unit to each area (S601). As shown in FIG. 36, the host system 2 divides the operation category by the wheel 91 into areas of an operation category A, an operation category C, an operation category D, an operation category E, and an operation category F on the wizard screen D.

  Thus, the same control as the wizard screen C is realized by dividing the wizard screen into a plurality of areas. That is, when the position of the mouse pointer is moved to each operation section and the wheel 91 is rotated in the moved operation section, the drive of the drive unit assigned to the operation section is controlled.

  First, a case where a mouse pointer is in the segmented area A will be described. When the mouse operation is performed in the operation section A, the host system 2 adjusts the stage according to the rotation direction and the rotation amount of the wheel 91 in order to adjust the distance between the objective lens 23 and the electric stage 20 as in the wizard screen C. The Z drive control unit 22 is controlled (S609).

  That is, when the wheel 91 is moved in the direction of W2, the host system 2 performs drive control of the stage Z drive control unit 22 in a direction in which the specimen 19 approaches the objective lens 23 according to the rotation amount of the wheel 91. . When the wheel 91 is moved in the direction of W1, the host system 2 performs drive control of the stage Z drive control unit 22 in a direction in which the sample 19 moves away from the objective lens 23 according to the rotation amount of the wheel 91.

  The drive amount of the electric stage 20 driven in the Z direction by the stage Z drive control unit 22 is variable according to the optical magnification. Therefore, when 20 × magnification is selected, the mouse wheel can be driven at 1 μm per click. When a 40 × magnification is selected, the mouse wheel can be driven at 0.5 μm per click. In the case of a mouse wheel without a click, the driving amount per one rotation of the wheel may correspond to a driving amount of 20 μm and 10 μm, respectively.

Since the operation category C, the operation category D, and the operation category E are the same as those of the wizard screen C, description thereof is omitted.
Next, a case where the mouse pointer is in the segmented area F as shown in FIG. 36 will be described. When the wheel 91 is operated (S602) and the mouse pointer P is in the operation area F (S605), the host system 2 changes the GUI of the mouse pointer from P to P-f in FIG. It changes to the form shown (S611).

  Subsequently, the host system 2 performs drive control of the zoom optical system 27 via the microscope controller 32 in order to adjust the optical magnification according to the rotation direction and the rotation amount of the wheel 91 (S612).

  That is, when the wheel 91 is moved in the direction of W2, the host system 2 increases the optical magnification with respect to the zoom optical system 27 in accordance with the rotation amount of the wheel 91 as shown in FIG. Drive control is performed. When the wheel 91 is moved in the direction of W1, the host system 2 performs drive control of the zoom optical system 27 in accordance with the amount of rotation of the wheel 91 in the direction of decreasing the optical magnification as shown in FIG. The zoom optical system can be driven with a drive amount that changes the magnification of 1 × per click of the wheel.

  When the drive operation of the zoom optical system 27 is completed, the host system 2 returns the mouse pointer GUI to the form indicated by P again (S619). Therefore, when the mouse pointer is in the segmented region F, the optical magnification can be driven by rotating the wheel 91.

  FIG. 40 shows an example of the wheel operation control table. The wheel operation control table exists for each wizard screen and is stored in the storage device of the host system 2. The wheel operation control table stores, for example, “partition area name”, “partition area range”, “drive unit name”, “operation content by wheel”, and “mouse pointer image”.

  In “partition area name”, the name of the section area is stored. The “division area range” stores coordinates indicating the range of the division area on the wizard screen. “Drive unit name” stores the drive unit name assigned to the segmented area. The “operation content by wheel” stores control information for driving the drive unit in accordance with the rotation direction and the rotation amount of the wheel when the mouse pointer is in the divided area. The “mouse pointer image” stores the image data of the mouse pointer displayed when the mouse pointer is on the divided area or the location information of the image data.

  When executing the flow of FIGS. 35 and 39, the CPU of the host system 2 reads the wheel operation control table corresponding to each wizard screen from the storage device, and performs processing based on the flow. By using the wheel operation control table, the host system 2 can switch the drive unit to be driven according to the area on the wizard screen. Furthermore, by using the wheel operation control table, the host system 2 converts the rotation direction and rotation amount of the wheel into an instruction signal for physical operation of the switched drive unit and transmits it to the microscope controller 31. Can do. Therefore, the microscope controller 31 can drive the drive unit based on the transmitted signal.

  As described above, in the microscope system according to the present embodiment, the drive unit to be driven is automatically selected according to the selected region and the wheel operation of the mouse 88 in the region on the specimen display screen or the operation menu display screen. And the switched drive unit can be controlled. As a result, it is possible to improve the operability of the microscope system and reduce the operation burden on the user.

  In this embodiment, the assignment of the mouse wheel of the mouse with the wheel of the pointing device has been described. However, it may be replaced with a trap ball or other general pointing device. Further, the driving amount by the mouse wheel is not a fixed amount, but may be set arbitrarily by the user for each part. The drive unit assigned to the mouse wheel may be an electric AS (Aperture Stop), an electric correction ring, or other drive unit.

  The processing and wheel operation control tables shown in the flowcharts of FIGS. 7 to 10, 35, and 39 create a control program to be executed by the CPU of a computer having a standard configuration as described above and read the computer. It may be recorded on a possible recording medium. In this case, the present invention can be implemented by reading the program from a recording medium into a computer and executing it by a CPU.

  As a recording medium from which the recorded control program can be read by a computer, for example, a storage device such as a ROM or a hard disk device provided as an internal or external accessory device in the computer, or a medium driving device provided in the computer is inserted. A portable recording medium such as a flexible disk, MO (magneto-optical disk), CD-ROM, DVD-ROM, or the like from which the control program recorded can be read out can be used.

  The recording medium may be a storage device provided in a computer system functioning as a program server connected to a computer via a communication line. In this case, a transmission signal obtained by modulating a carrier wave with a data signal representing a control program is transmitted from the program server to a computer through a communication line as a transmission medium, and the computer demodulates the received transmission signal. By replaying the control program, the control program can be executed by the CPU of the computer.

  For example, although the upright microscope apparatus is employed as the microscope apparatus 1 in the microscope system according to the above-described embodiment, an inverted microscope apparatus may be employed instead. Further, the present embodiment may be applied to various systems such as a line apparatus incorporating a microscope apparatus.

  According to the present invention, on the specimen display screen or the operation menu display screen, the drive unit to be driven is automatically switched according to the region selected with the mouse and the mouse wheel operation on the selected region. As a result, it is possible to improve the operability of the microscope system and reduce the operation burden on the user.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to each embodiment mentioned above, A various improvement and change are possible within the range which does not deviate from the summary of this invention.

It is a figure which shows the structural example of the microscope system which implements this invention. It is a figure explaining the outline | summary of four wizard screens. It is a figure which shows an example of the wizard screen. It is a figure which shows an example of the wizard screen. It is a figure which shows an example of the wizard screen. It is a figure which shows an example of the wizard screen. It is a figure which shows the flowchart which concerns on the wizard screen. It is a figure which shows the flowchart which concerns on the wizard screen. FIG. 10 is a diagram illustrating a flowchart according to a wizard screen C. It is a figure which shows the flowchart which concerns on the wizard screen. It is a 1st figure which shows an example of the wizard screen B during observation operation | movement. It is a 2nd figure which shows an example of the wizard screen B during observation operation | movement. It is a 1st figure which shows an example of the wizard screen C during observation operation | movement. It is a 2nd figure which shows an example of the wizard screen C during observation operation | movement. It is a 1st figure which shows an example of the wizard screen D during observation operation | movement. It is a 2nd figure which shows an example of the wizard screen D during observation operation | movement. It is a figure which shows an example of a window. It is a 3rd figure which shows an example of the wizard screen C during observation operation | movement. It is a 3rd figure which shows an example of the wizard screen D during observation operation | movement. An example of a mouse 88 is shown. An example of a screen when the mouse pointer P is in the divided area A of the wizard screen C is shown. The screen example when the mouse pointer P is detected in the divided area A of the wizard screen C and the form of the mouse pointer is changed is shown. The example of a screen when the mouse pointer P exists in the division area B of the wizard screen C is shown. A screen example (part 1) in the case where the mouse pointer P is detected in the divided area B of the wizard screen C and the form of the mouse pointer is changed is shown. A screen example (part 2) when the mouse pointer P is detected in the divided area B of the wizard screen C and the form of the mouse pointer is changed is shown. The example of a screen when the mouse pointer P exists in the division area C of the wizard screen C is shown. A screen example (part 1) when the mouse pointer P is detected in the divided area C of the wizard screen C and the form of the mouse pointer is changed is shown. A screen example (part 2) when the mouse pointer P is detected in the divided area C of the wizard screen C and the form of the mouse pointer is changed is shown. The example of a screen when the mouse pointer P exists in the division area D of the wizard screen C is shown. A screen example (part 1) when the mouse pointer P is detected in the divided area D of the wizard screen C and the form of the mouse pointer is changed is shown. A screen example (part 2) when the mouse pointer P is detected in the divided area D of the wizard screen C and the form of the mouse pointer is changed is shown. The example of a screen when the mouse pointer P exists in the division area E of the wizard screen C is shown. A screen example (part 1) when the mouse pointer P is detected in the divided area E of the wizard screen C and the form of the mouse pointer is changed is shown. A screen example (part 2) when the mouse pointer P is detected in the divided area E of the wizard screen C and the form of the mouse pointer is changed is shown. A flow when a mouse wheel operation is performed on each area of the wizard screen C is shown. The example of a screen when the mouse pointer P exists in the division area F of the wizard screen D is shown. A screen example (part 1) when the mouse pointer P is detected in the divided area F of the wizard screen D and the form of the mouse pointer is changed is shown. A screen example (part 2) when the mouse pointer P is detected in the divided area F of the wizard screen D and the form of the mouse pointer is changed is shown. A flow when a mouse wheel operation is performed on each area of the wizard screen D is shown. An example of a wheel operation control table is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Microscope apparatus 2 Host system 3 Video camera 4 Operation history recording part 5 Monitor 6 Light source for transmission illumination 7 Collector lens 8 Transmission filter unit 9 Transmission field stop 10 Transmission aperture stop 11 Condenser optical element unit 12 Top lens unit 13 For epi-illumination Light source 14 Collector lens 15 Epi-illumination filter unit 16 Epi-illumination shutter 17 Epi-illumination field stop 18 Epi-illumination aperture diaphragm 19 Observation body 20 Electric stage 21 Stage XY drive control unit 22 Stage Z drive control unit 23 Objective lens 24 Revolver 25 Cube unit 26 Eyepiece Lens 27 Zoom optical system 28 Polarizer 29 DIC prism 30 Analyzer 31 Microscope controller 32 Video board 33 Camera controller 34 Microscope operation unit 35 Area 36 Sample exchange Button 37 Area 38, 39, 40, 41 Button 43 Fluorescence observation selection button 44 Differential interference observation selection button 45 Bright field observation selection button 46, 47, 48, 49 Button 50 Area 51, 52 Button 53 Slide image area 54 Area 55 Rectangular Frame 56 Macro image display area 57, 58, 59, 60, 61, 62 button 63 Macro LIVE image area 64 Range designation frame 65 Slide area 66 Cross mark 67 Range designation frame switching area 68 Focus area 69 Tool area 70, 71 button 72 Image display area 73 Focus / correction ring area 74 Slide bar 75 AF button 76 Correction ring adjustment button 77 Stage control / map area 78 Rectangular frame 79 button 81 SHOT button 80, 82, 83 button 84 area 85 display image switching area 86, 87 button 88 mouse with wheel 89 speculum method change instruction area 90 left button 91 wheel 92 right button

Claims (7)

A microscope apparatus having a plurality of drive units;
Display means for displaying an operation screen for operating the microscope apparatus;
A pointing device for inputting an operation instruction to the microscope apparatus with a pointer to the operation screen;
And a control unit that switches the drive unit according to the position of the pointer on the operation screen and controls the operation of the switched drive unit according to the operation of the pointing device. system. The drive unit includes at least one of a zoom mechanism that zooms the observation magnification, a drive stage that can move the observation body in the same direction or perpendicular to the observation optical path, and a light control mechanism, and The operation screen includes at least one of a first area, a second area, a third area, and a fourth area,
The control means determines the position of the pointer on the operation screen, and when the pointer is in the first area on the operation screen, observes the driving stage according to the operation of the pointing device. When the pointer is in the second area on the operation screen, the drive stage is moved in the direction perpendicular to the observation optical path in accordance with the operation of the pointing device. Is in the third area on the operation screen, the magnification is scaled by the scaling mechanism in accordance with the operation of the pointing device, and the pointer is in the fourth area on the operation screen. 2. The microscope system according to claim 1, wherein dimming control is performed according to an operation of the pointing device. The microscope system further includes:
An image pickup means for picking up an image of an observation body observed by the microscope device;
The operation screen includes an image display area for displaying an image captured by the imaging unit,
The control means switches the drive unit according to the position of the pointer on the image display area, and controls the operation of the switched drive unit according to an operation of the pointing device. Item 3. The microscope system according to Item 1 or 2. The pointing device is a mouse with a wheel;
The microscope system according to any one of claims 1 to 3, wherein the control means controls the operation of the switched drive unit in accordance with an operation of a wheel of the mouse with a wheel. 2. The microscope system according to claim 1 , wherein the control unit changes the display form of the pointer to a predetermined display form in accordance with a position on the operation screen. A microscope apparatus having a plurality of drive units, a display apparatus for displaying an operation screen for operating the microscope apparatus, and a pointing device for inputting an operation instruction to the microscope apparatus with a pointer to the operation screen A microscope system control program for causing a computer to execute processing for controlling a microscope system,
Determination processing for determining the position of the pointer on the operation screen;
From the determination result, a unit switching process for switching the drive unit according to the position of the pointer on the operation screen;
A microscope system control program for causing a computer to execute unit control processing for controlling the operation of the switched drive unit in accordance with an operation of the pointing device. A microscope apparatus having a plurality of drive units, a display apparatus for displaying an operation screen for operating the microscope apparatus, and a pointing device for inputting an operation instruction to the microscope apparatus with a pointer to the operation screen A microscope system control method for controlling a microscope system,
Determining the position of the pointer on the operation screen;
From the determination result, the drive unit is switched according to the position of the pointer on the operation screen,
A microscope system control method, comprising: controlling an operation of the switched drive unit in accordance with an operation of the pointing device.