[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

EP3806457A1 - Verfahren zur verarbeitung medizinischer bilder - Google Patents

Verfahren zur verarbeitung medizinischer bilder Download PDF

Info

Publication number
EP3806457A1
EP3806457A1 EP19811717.8A EP19811717A EP3806457A1 EP 3806457 A1 EP3806457 A1 EP 3806457A1 EP 19811717 A EP19811717 A EP 19811717A EP 3806457 A1 EP3806457 A1 EP 3806457A1
Authority
EP
European Patent Office
Prior art keywords
medical image
display
image
cut
medical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP19811717.8A
Other languages
English (en)
French (fr)
Other versions
EP3806457A4 (de
Inventor
Motoaki Kobayashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Olympus Medical Solutions Inc
Original Assignee
Sony Olympus Medical Solutions Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Olympus Medical Solutions Inc filed Critical Sony Olympus Medical Solutions Inc
Publication of EP3806457A1 publication Critical patent/EP3806457A1/de
Publication of EP3806457A4 publication Critical patent/EP3806457A4/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20—Surgical microscopes characterised by non-optical aspects
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/0012—Surgical microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/02—Objectives
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/18—Arrangements with more than one light path, e.g. for comparing two specimens
    • G02B21/20—Binocular arrangements
    • G02B21/22—Stereoscopic arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/368—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements details of associated display arrangements, e.g. mounting of LCD monitor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/34—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00—Stereoscopic photography
    • G03B35/08—Stereoscopic photography by simultaneous recording
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00—Stereoscopic photography
    • G03B35/18—Stereoscopic photography by simultaneous viewing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/371—Surgical systems with images on a monitor during operation with simultaneous use of two cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30041—Eye; Retina; Ophthalmic

Definitions

  • the present disclosure relates to a medical image processing apparatus.
  • a medical observation apparatus capable of enlarged observation of an observation target such as an affected site in order to support microsurgery such as neurosurgery.
  • the medical observation apparatus include a medical observation apparatus equipped with an optical microscope and a medical observation apparatus equipped with an imaging device that functions as an electronic imaging microscope.
  • the medical observation apparatus equipped with the above-described optical microscope will be referred to as an "optical medical observation apparatus”.
  • a medical observation apparatus equipped with the above-described imaging device will be referred to as an "electronic imaging medical observation apparatus” or simply as a “medical observation apparatus”.
  • an electronic imaging medical observation apparatus can obtain image quality equal to or higher than that of an optical medical observation apparatus.
  • a user of an electronic imaging medical observation apparatus for example, a medical worker such as a practitioner or an assistant of the practitioner
  • Patent Literature 1 JP 2006-218105 A
  • Some medical observation apparatuses include a plurality of imaging devices and have a function of capturing an image for the right eye and an image for the left eye, that is, can capture a 3D image.
  • an image captured by a medical observation apparatus is referred to as a "medical image”.
  • some display devices capable of displaying a medical image have a configuration corresponding to any types of display capable of 3D display, such as an eyeglass type that enables 3D display in cooperation with an eyeglass-type device, or a naked eye type that enables 3D display without cooperation with the eyeglass-type device.
  • an eyeglass type that enables 3D display in cooperation with an eyeglass-type device
  • a naked eye type that enables 3D display without cooperation with the eyeglass-type device.
  • an inward angle (described below) in two imaging devices, that is, the device for capturing a medical image for the right eye and the device for capturing a medical image for the left eye and a convergence angle (described below) formed by the right eye and the left eye of the viewer of the display screen.
  • the convergence angle (described below) varies from display device to display device due to various factors such as a location where the display device is arranged and a size of the display screen. Therefore, even if the inward angle (described below) in the medical observation apparatus is fixed, it is difficult to achieve a match between the inward angle (described below) and the convergence angle (described below).
  • the present disclosure proposes a novel and improved medical image processing apparatus capable of obtaining a medical image with a more natural three-dimensional effect.
  • a medical image processing apparatus including: an image processor configured to set a cut-out range for each of a medical image for a right eye and a medical image for a left eye, captured respectively by a first imaging device and a second imaging device with a fixed inward angle that is an angle formed by imaging directions, and perform an electronic zoom process of enlarging an image in the cut-out range; and a display controller configured to control display on a display screen of the medical image for the right eye and the medical image for the left eye that have been subjected to the electronic zoom process by the image processor, wherein the image processor is configured to set the cut-out range for each of the medical image for the right eye and the medical image for the left eye based on a reference distance corresponding to the inward angle and a subject distance in the first imaging device and the second imaging device.
  • a medical observation apparatus (hereinafter, sometime simply referred to as the "medical observation apparatus") is an apparatus including at least two imaging devices capable of capturing a 3D image and a display device capable of 3D display. Note that the medical observation apparatus is also a medical image processing apparatus.
  • the medical observation apparatus includes an imaging device that captures a medical image for the right eye and an imaging device that captures a medical image for the left eye will be described as an example.
  • the inward angle according to the present embodiment is "an angle formed by an imaging direction in an imaging device that captures a medical image for the right eye and an imaging direction in an imaging device that captures a medical image for the left eye”.
  • the inward angle is the angle formed by center lines of imaging planes of the respective imaging devices with respect to a tolerance point.
  • an imaging device that captures the medical image for the right eye is referred to as a "first imaging device”
  • an imaging device that captures the medical image for the left eye is referred to as a "second imaging device”.
  • the imaging direction of the first imaging device and the imaging direction of the second imaging device are fixed, and as a result, the inward angle is fixed as illustrated in a configuration example described below.
  • the convergence angle according to the present embodiment is an "angle between the right eye and the left eye of the observer".
  • the convergence angle corresponds to "an angle formed between the line of sight of the right eye and the line of sight of the left eye when a certain position on the display screen is in focus", for example.
  • the convergence angle corresponding to the display device can be estimated from a representative value (for example, an average value) of human's interocular distance and a set value of the distance (viewing distance) between the observer and the display screen.
  • the convergence angle corresponding to the display device may be set to a value corresponding to a specific person on the basis of an interocular distance value set for a specific person and a detection result of a distance (viewing distance) between the specific person and the display screen detected by a distance sensor or the like.
  • FIG. 1 is an explanatory view for describing the inward angle and the convergence angle.
  • a of FIG. 1 conceptually illustrates the inward angle
  • B of FIG. 1 conceptually illustrates the convergence angle.
  • the interocular distance illustrated in B of FIG. 1 is generally about 60 to 70 [mm].
  • the greater the difference between the inward angle and the convergence angle the more the viewer of the medical image displayed on the display screen feels that the image is a flat image with no three-dimensional effect or that the image is a distorted image with an excessive three-dimensional effect. More specifically, the greater the difference between the inward angle and the convergence angle, the more the perception in the depth direction changes. In addition, the greater the viewing distance, the greater the sense of depth perceived.
  • the medical observation apparatus has a configuration for fixing the inward angle, and controls a cut-out range in an electronic zoom process to acquire a medical image that gives a more natural three-dimensional effect.
  • FIG. 2 is an explanatory view illustrating an example of a medical observation apparatus 100 according to the present embodiment, and illustrates an example of a surgical operation field in which the medical observation apparatus 100 is used.
  • FIG. 2 illustrates an example of a view seen from an observer who is operating a surgery on an affected site P using the medical observation apparatus 100.
  • FIGS. 3 to 5 are explanatory views illustrating an example of a hardware configuration of the medical observation apparatus 100 according to the present embodiment.
  • FIG. 3 is a perspective view of the medical observation apparatus 100 viewed from the back side (the side opposite to the display screen).
  • a cover member Co is provided on the back side of the medical observation apparatus 100.
  • the cover member Co is detachable.
  • FIG. 4 is a perspective view illustrating the medical observation apparatus 100 in a state where the cover member Co illustrated in FIG. 3 has been removed.
  • a first imaging device Cam1 and a second imaging device Cam2 are provided inside the cover member Co.
  • the first imaging device Cam1 and the second imaging device Cam2 are arranged such that imaging directions are fixed, and an inward angle is fixed in the medical observation apparatus 100.
  • FIG. 5 is an explanatory view illustrating an example of an external appearance of the medical observation apparatus 100 in the state where the cover member Co illustrated in FIG. 3 has been removed.
  • a of FIG. 5 is a front view of the medical observation apparatus 100 viewed from the front side (a side of a display screen DS).
  • B of FIG. 5 and C of FIG. 5 are side views of the medical observation apparatus 100
  • D of FIG. 5 is a rear view of the medical observation apparatus 100.
  • the external appearance of the medical observation apparatus 100 is not limited to the example illustrated in FIG. 5 .
  • the medical observation apparatus 100 in the state where the cover member Co has been removed as illustrated in FIGS. 4 and 5 is taken as an example for convenience of description.
  • the medical observation apparatus 100 is driven by electric power supplied from an internal power supply such as a battery included in the medical observation apparatus 100 or by electric power supplied from a connected external power supply, for example.
  • the medical observation apparatus 100 includes two imaging devices of, for example, the first imaging device Cam1 and the second imaging device Cam2. Note that the medical observation apparatus according to the present embodiment may include three or more imaging devices as described above.
  • first imaging device Cam1 and the second imaging device Cam2 it is possible to apply configurations of imaging devices used in various known electronic imaging microscope units.
  • each of the first imaging device Cam1 and the second imaging device Cam2 includes an optical system and an image sensor that includes an imaging element that captures an image of an observation target using light that has passed through the optical system, for example.
  • the optical system includes, as optical elements, an objective lens, at least one lens of a zoom lens and a focusing lens, and a mirror.
  • the image sensor include an image sensor using a plurality of imaging elements such as a complementary metal oxide semiconductor (CMOS) and a charge coupled device (CCD).
  • CMOS complementary metal oxide semiconductor
  • CCD charge coupled device
  • Each of the first imaging device Cam1 and the second imaging device Cam2 is equipped with one or more functions generally provided in an electronic imaging microscope unit such as a zoom function including at least an electronic zoom function (electronic zoom function or an optical zoom function and an electronic zoom function) and an auto focus (AF) function.
  • a zoom function including at least an electronic zoom function (electronic zoom function or an optical zoom function and an electronic zoom function) and an auto focus (AF) function.
  • Each of the first imaging device Cam1 and the second imaging device Cam2 may be configured to be capable of imaging at a so-called high resolution such as 4K and 8K.
  • a so-called high resolution such as 4K and 8K.
  • the configuration in which each of the first imaging device Cam1 and the second imaging device Cam2 is capable of high-resolution imaging it is possible to display an image on the display device having a large display screen of 50 inches or more, for example, while ensuring a predetermined resolution (full HD image quality, for example). Accordingly, the visibility of the observer such as an operator is improved.
  • each of the first imaging device Cam1 and the second imaging device Cam2 can be made simpler, and each of the first imaging device Cam1 and the second imaging device Cam2 can be further downsized.
  • the medical observation apparatus 100 includes the display device capable of displaying an arbitrary image on the display screen DS as illustrated in FIG. 5 .
  • the display device include a liquid crystal display and an organic electro-luminescence (EL) display.
  • the medical observation apparatus 100 includes, for example, one processor or two or more processors (not illustrated) each of which is constituted by an arithmetic circuit such as a micro processing unit (MPU), a read only memory (ROM; not illustrated), a random access memory (RAM; not illustrated), a recording medium (not illustrated), and a communication device (not illustrated).
  • MPU micro processing unit
  • ROM read only memory
  • RAM random access memory
  • communication device not illustrated
  • the processor functions as a control unit described below.
  • the ROM (not illustrated) stores programs used by the processor (not illustrated) and control data such as calculation parameters.
  • the RAM (not illustrated) temporarily stores a program executed by the processor (not illustrated), or the like.
  • the recording medium (not illustrated) functions as a storage unit (not illustrated) in the medical observation apparatus 100.
  • various types of data such as "data relating to various processes in the medical observation apparatus 100 such as data indicating a reference distance (described below) corresponding to the inward angle" and various applications are stored.
  • examples of the recording medium (not illustrated) include a magnetic recording medium such as a hard disk, and nonvolatile memory such as flash memory.
  • the recording medium (not illustrated) may be removable from the medical observation apparatus 100.
  • the communication device is a communication unit included in the medical observation apparatus 100 and has a role of performing wireless or wired communication with an external device.
  • examples of the communication device (not illustrated) include an IEEE 802.15.1 port and a transmission/reception circuit (wireless communication), an IEEE 802.11 port and a transmission/reception circuit (wireless communication), a communication antenna and a radio frequency (RF) circuit (wireless communication), or a local area network (LAN) terminal and a transmission/reception circuit (wired communication).
  • the medical observation apparatus 100 has, for example, the hardware configuration described above. Note that it goes without saying that the hardware configuration of the medical observation apparatus 100 is not limited to the above example.
  • the medical observation apparatus 100 may be realized as a single apparatus including all the configurations described above, or some or all of the configurations may be realized as separate apparatuses.
  • the first imaging device Cam1 and the second imaging device Cam2 may be realized as independent devices using imaging devices or the like independent of the medical observation apparatus 100.
  • the display device (a display unit described below) may be realized as a single device using a display device or the like independent of the medical observation apparatus 100.
  • the medical observation apparatus 100 may be a medical image processing apparatus including at least a processor (a control unit described below).
  • FIG. 6 is a functional block diagram illustrating an example of the configuration of the medical observation apparatus 100 according to the present embodiment.
  • the medical observation apparatus 100 includes, for example, an imaging unit 102, a display unit 104, and a control unit 106.
  • the imaging unit 102 captures an image of an observation target.
  • the imaging unit 102 is constituted by two imaging devices, for example, the first imaging device Cam1 and the second imaging device Cam2.
  • the imaging by the imaging unit 102 is controlled by, for example, the control unit 106.
  • the display unit 104 is a display means provided in the medical observation apparatus 100, and displays various images such as a medical image on a display screen.
  • the display unit 104 is configured by, for example, the display device described above.
  • the display on the display unit 104 is controlled by the control unit 106, for example.
  • the control unit 106 includes the above-described processor (not illustrated), for example, and has a role of controlling the entire medical observation apparatus 100. In addition, the control unit 106 plays a leading role in processes in the medical observation apparatus described below. Note that the processing in the control unit 106 may be distributed among a plurality of processing circuits (for example, a plurality of processors) to be executed.
  • control unit 106 includes, for example, an imaging controller 108, an image processor 110, and a display controller 112.
  • the imaging controller 108 controls the imaging device forming the imaging unit 102.
  • Examples of the control on the imaging device include control on one or more general functions of an electronic imaging type microscope unit such as control on an AF function at least including a zoom function (the electronic zoom function or the optical zoom function and the electronic zoom function).
  • the image processor 110 performs an electronic zoom process on each of a medical image for the right eye and a medical image for the left eye.
  • the electronic zoom process according to the present embodiment is a process of setting a cut-out range for a medical image and enlarging an image in the cut-out range. An example of the electronic zoom process according to the present embodiment will be described below.
  • the display controller 112 performs a display control process of displaying a medical image on the display screen.
  • the display controller 112 controls the display of the display device by transmitting a display control signal and an image signal to the display device forming the display unit 104, for example.
  • Examples of display control of a medical image on the display screen, which is realized by the display control process in the display controller 112, include the following examples.
  • An example of the display control process according to the present embodiment will be described below.
  • control unit 106 is not limited to the example illustrated in FIG. 6 .
  • control unit 106 when the display control process is performed in an apparatus outside the medical observation apparatus 100, such as a medical controller, the control unit 106 does not necessarily include the display controller 112.
  • control unit 106 may be arbitrarily configured according to a way of dividing the functions of the medical observation apparatus 100 such as a configuration according to a way of dividing the processes performed in the medical observation apparatus 100.
  • the medical observation apparatus 100 has, for example, a functional configuration illustrated in FIG. 6 .
  • the functional configuration of the medical observation apparatus according to the present embodiment is not limited to the configuration illustrated in FIG. 6 .
  • the medical observation apparatus can implement a part or all of the imaging controller 108, the image processor 110, and the display controller 112 illustrated in FIG. 6 separately from the control unit 106 (for example, using another processing circuit).
  • the medical observation apparatus does not necessarily include the display controller 112.
  • the electronic zoom process and the display control process will be described as examples of the processing in the medical observation apparatus according to the present embodiment.
  • a case where the medical observation apparatus 100 performs the electronic zoom process and the display control process will be described as an example.
  • the electronic zoom process in the medical observation apparatus 100 is performed, for example, in the image processor 110 provided in the control unit 106 as described above.
  • the display control process in the medical observation apparatus 100 is performed, for example, in the display controller 112 provided in the control unit 106 as described above.
  • the electronic zoom process is a process of setting a cut-out range for a medical image and enlarging an image in the cut-out range.
  • the medical observation apparatus 100 enlarges the image in the cut-out range at a set magnification.
  • the set magnification may be a preset fixed value or may be a variable value that can be changed by an operation of a user of the medical observation apparatus 100 or the like.
  • the magnification related to the electronic zoom process may be set such that a display parallax amount in the enlarged image of the cut-out range approaches a display parallax amount corresponding to a distance from an observer viewing the display screen to a subject as will be described below.
  • the medical observation apparatus 100 sets the cut-out range for each of the medical image for the right eye and the medical image for the left eye based on the reference distance corresponding to the inward angle and a subject distance in the first imaging device Cam1 and the second imaging device Cam2.
  • FIG. 7 is an explanatory view for describing an example of the electronic zoom process in the medical observation apparatus 100 according to the present embodiment.
  • "RD" illustrated in FIG. 7 illustrates an example of the reference distance corresponding to the inward angle (hereinafter, the same applies to other drawings).
  • Each of "WD1", “WD2", and “WD3” illustrated in FIG. 7 illustrates an example of the subject distance.
  • the reference distance may be referred to as “reference distance RD” and the subject distance may be referred to as “subject distance WD”.
  • the reference distance RD is a "distance between a reference position of each of the first imaging device Cam1 and the second imaging device Cam2 and a position of an intersection of the imaging direction in the first imaging device Cam1 and the imaging direction in the second imaging device Cam2". Since the inward angle is fixed in the medical observation apparatus 100, the reference distance RD may be, for example, a fixed value associated with the inward angle. Note that the reference distance RD may be a variable value that can be changed by the operation of the user of the medical observation apparatus 100. Hereinafter, the intersection is referred to as a "focus point".
  • the subject distance WD is a distance called a working distance.
  • Examples of the subject distance WD may include a "distance between the reference position of each of the first imaging device Cam1 and the second imaging device Cam2 and a subject, such as an affected site, when the focus is achieved".
  • the position of the subject when the focus is achieved is called, for example, an in-focus position.
  • the subject distance WD is identified by any method, for example, using a distance measurement result obtained by a distance sensor (not illustrated) (distance measured by the distance sensor) or calculating a hyperfocal distance in the first imaging device Cam1 or the second imaging device Cam2.
  • the distance sensor (not illustrated) may be a distance sensor provided in the medical observation apparatus 100, or may be an external distance sensor connected to the medical observation apparatus 100.
  • a of FIG. 7 illustrates a case where the reference distance RD and the subject distance WD match.
  • B of FIG. 7 is an example of a case where the reference distance RD and the subject distance WD do not match, and illustrates a case where the subject distance WD is longer than the reference distance RD.
  • C of FIG. 7 is another example of the case where the reference distance RD and the subject distance WD do not match, and illustrates a case where the subject distance WD is shorter than the reference distance RD.
  • the inward angle is fixed in the medical observation apparatus 100, it is difficult to obtain an image (an example of a medical image) that has been subjected to the electronic zoom process with a more natural three-dimensional effect in a case where the cut-out range is set to be the same in each of the state A of FIG. 7 , the state B of FIG. 7 , and the state C of FIG. 7 .
  • the medical observation apparatus 100 controls the setting of the cut-out range for each of the medical image for right eye and the medical image for left eye based on the reference distance RD and the subject distance WD.
  • the medical observation apparatus 100 sets the cut-out range based on a difference between the reference distance RD and the subject distance WD.
  • the difference between the reference distance RD and the subject distance WD is sometimes simply referred to as the "difference".
  • the difference is a value obtained by subtracting the subject distance WD from the reference distance RD.
  • the difference may be a value obtained by subtracting the reference distance RD from the subject distance WD.
  • the medical observation apparatus 100 identifies an adjustment amount corresponding to a difference by referring to, for example, a "table (or database) in which the difference and the adjustment amount of the cut-out range are associated".
  • the medical observation apparatus 100 may identify an adjustment amount corresponding to a difference by an operation of an arbitrary algorithm that can identify the adjustment amount of the cut-out range based on the difference.
  • An example of the adjustment amount according to the present embodiment is the number of pixels.
  • the adjustment amount according to the present embodiment may be any value that can shift the cut-out range from the reference position.
  • the above-described table is stored in a recording medium that functions as a storage unit (not illustrated) or an external recording medium.
  • Examples of the reference position of the cut-out range according to the present embodiment include a position at which an image that gives a more natural three-dimensional effect can be obtained when the reference distance RD and the subject distance WD match, that is, a position where a center position of the cut-out range becomes a center position of a medical image.
  • the reference position of the cut-out range according to the present embodiment is not limited to the above example.
  • a case where the reference position of the cut-out range is "the position where the center position of the cut-out range becomes the center position of the medical image" will be described as an example.
  • the medical observation apparatus 100 sets a cut-out range such that a center position of the cut-out range is moved in the horizontal direction by pixels corresponding to a difference from the center position of each of a medical image for the right eye and a medical image for the left eye.
  • FIG. 8 is an explanatory view illustrating a first example of setting of a cut-out range in the medical observation apparatus 100 according to the present embodiment.
  • a of FIG. 8 illustrates a case where subjects O1 and O2 are captured in the state illustrated in A of FIG. 7 .
  • B of FIG. 8 illustrates a medical image for the left eye obtained in the case of A of FIG. 8
  • C of FIG. 8 illustrates a medical image for the right eye obtained in the case of A of FIG. 8 .
  • the reference distance RD and the subject distance WD match, and the difference is zero.
  • the subject O1 at the focus point is at the center of the image for both the medical image for the left eye and the medical image for the right eye.
  • the medical observation apparatus 100 sets the cut-out range such that the center position of the cut-out range becomes the center position of each of the medical image for the right eye and the medical image for the left eye as illustrated in B of FIG. 8 and C of FIG. 8 .
  • FIG. 9 is an explanatory view illustrating a second example of setting of a cut-out range in the medical observation apparatus 100 according to the present embodiment.
  • a of FIG. 9 illustrates a case where the subjects O1 and O2 are captured in the state illustrated in B of FIG. 7 .
  • B of FIG. 9 illustrates a medical image for the left eye obtained in the case of A of FIG. 9
  • C of FIG. 9 illustrates a medical image for the right eye obtained in the case of A of FIG. 9 .
  • the reference distance RD and the subject distance WD do not match, and the difference is a value other than zero (for example, a negative value).
  • the subject O1 is not at the center of the image for both the medical image for the left eye and the medical image for the right eye.
  • the medical observation apparatus 100 sets the cut-out range to move in the horizontal direction by pixels corresponding to the difference from the center position of each of the medical image for the right eye and the medical image for the left eye as illustrated in B of FIG. 9 and C of FIG. 9 .
  • the cut-out range corresponding to the difference is set as described above, it is possible to obtain an image in a state where a match is achieved between the reference distance RD and the subject distance WD even if the inward angle is fixed. Accordingly, the "image obtained by cutting out the cut-out range and enlarging the cut-out range at the set magnification", that is, the image that has been subjected to the electronic zoom process becomes an image with a more natural three-dimensional effect.
  • FIG. 10 is an explanatory view illustrating a third example of setting of a cut-out range in the medical observation apparatus 100 according to the present embodiment.
  • a of FIG. 10 illustrates a case where subjects O1 and O2 are captured in the state illustrated in C of FIG. 7 .
  • B of FIG. 10 illustrates a medical image for the left eye obtained in the case of A of FIG. 10
  • C of FIG. 10 illustrates a medical image for the right eye obtained in the case of A of FIG. 10 .
  • the reference distance RD and the subject distance WD do not match, and the difference is a value other than zero (for example, a positive value).
  • the subject O1 is not at the center of the image for both the medical image for the left eye and the medical image for the right eye.
  • the medical observation apparatus 100 sets the cut-out range to move in the horizontal direction by pixels corresponding to the difference from the center position of each of the medical image for the right eye and the medical image for the left eye as illustrated in B of FIG. 10 and C of FIG. 10 .
  • the cut-out range corresponding to the difference is set as described above, it is possible to obtain an image in a state where a match is achieved between the reference distance RD and the subject distance WD even if the inward angle is fixed. Accordingly, the "image obtained by cutting out the cut-out range and enlarging the cut-out range at the set magnification", that is, the image that has been subjected to the electronic zoom process becomes an image with a more natural three-dimensional effect.
  • the medical observation apparatus 100 sets the cut-out range for each of the medical image for the right eye and the medical image for the left eye based on the reference distance RD and the subject distance WD as described with reference to FIGS. 7 to 10 , for example. Then, the medical observation apparatus 100 cuts out the image in the set cut-out range and enlarges the image in the cut-out range at the set magnification.
  • the medical observation apparatus 100 sets a size of the set cut-out range to a size corresponding to the set magnification. That is, the medical observation apparatus 100 can adjust the magnification according to the size of the cut-out range. For example, when the magnification is changed, the medical observation apparatus 100 changes the size of the set cut-out range to a size corresponding to the changed magnification.
  • the medical observation apparatus 100 refers to a table (or database) in which the magnification and the size of the cut-out range are associated to identify the size of the cut-out range corresponding to the set magnification.
  • FIG. 11 is an explanatory view for describing an example of the electronic zoom process in the medical observation apparatus 100 according to the present embodiment, and illustrates an example of the size of the cut-out range corresponding to the magnification.
  • the medical observation apparatus 100 may reset the cut-out range each time the relationship between the reference distance RD and the subject distance WD changes. Even if the subject distance WD changes, the image that has been subjected to the electronic zoom process can be made to be an image with a more natural three-dimensional effect by resetting the cut-out range.
  • the medical observation apparatus 100 may move the cut-out range based on a predetermined moving operation.
  • the medical observation apparatus 100 moves the cut-out range in a state of maintaining the correspondence between cut-out ranges set for a medical image for the right eye and a medical image for the left eye.
  • the cut-out range When the cut-out range is moved in the state of maintaining the set correspondence between the set cut-out range, the cut-out range is moved in the state of maintaining the match between the reference distance RD and the subject distance WD. Accordingly, the image that has been subjected to the electronic zoom process becomes an image with a more natural three-dimensional effect even if the cut-out range is moved in the state of maintaining the correspondence between the cut-out ranges.
  • examples of the predetermined moving operation include any operations such as an "operation by the line of sight”, an “operation by a gesture”, an “operation by voice”, an “operation on a remote controller such as a foot switch and a hand switch”, and an "operation on an any operation device provided in the medical observation apparatus 100".
  • the medical observation apparatus 100 identifies the content of the operation by the line of sight based on, for example, a "detection result of the line of sight detected by any image processing on a captured image on which a detection target of the operation has been captured".
  • An imaging device that captures the detection target of the operation may be an imaging device provided in the medical observation apparatus 100, or may be an imaging device outside the medical observation apparatus 100 such as a surgical site camera.
  • the image processing related to the detection of the line of sight may be performed by the medical observation apparatus 100 or may be performed by an external device of the medical observation apparatus 100.
  • the medical observation apparatus 100 identifies the content of the operation by the gesture based on, for example, a "detection result of the gesture detected by any image processing on a captured image on which a detection target of the operation has been captured".
  • the image processing related to the detection of the gesture may be performed by the medical observation apparatus 100 or may be performed by an external device of the medical observation apparatus 100.
  • the medical observation apparatus 100 identifies the content of the operation by voice based on, for example, a "detection result of predetermined voice detected by any signal processing on the voice obtained by a voice input device such as a microphone".
  • the voice input device may be a voice input device provided in the medical observation apparatus 100 or a voice input device outside the medical observation apparatus 100.
  • the signal processing on the voice may be performed by the medical observation apparatus 100 or may be performed by an external device of the medical observation apparatus 100.
  • the medical observation apparatus 100 identifies the content of the operation based on, for example, an operation signal corresponding to the operation.
  • FIG. 12 is an explanatory view for describing an example of the electronic zoom process in the medical observation apparatus 100 according to the present embodiment, and illustrates an example of movement of a cut-out range based on the moving operation by the line of sight.
  • a of FIG. 12 illustrates an example of the cut-out range set before the moving operation by the line of sight is performed.
  • B of FIG. 12 illustrates an example of the cut-out range set when the moving operation by the line of sight has been performed, and illustrates an example of the cut-out range set when the line of sight has moved to the left.
  • C of FIG. 12 illustrates another example of the cut-out range set when the moving operation by the line of sight has been performed, and illustrates an example of the cut-out range set when the line of sight has moved downward.
  • the display control process is, for example, a process of displaying a medical image on a display screen. Note that it goes without saying that the medical observation apparatus 100 can display an image other than the medical image on the display screen.
  • Examples of the medical image displayed on the display screen by the medical observation apparatus 100 include the following examples.
  • the medical observation apparatus 100 switches the medical image to be displayed on the display screen, for example, based on a display switching operation performed by a user of the medical observation apparatus 100 or automatically based on a result of image processing.
  • FIG. 13 is an explanatory view for describing an example of the display control process in the medical observation apparatus 100 according to the present embodiment.
  • a of FIG. 13 illustrates a case where subjects O1, O2, O3, and O4 are captured in the state illustrated in A of FIG. 7 .
  • B of FIG. 13 illustrates a medical image for the left eye obtained in the case of A of FIG. 13 .
  • FIG. 14 is an explanatory view for describing a first example of the display performed by the display control process in the medical observation apparatus 100 according to the present embodiment.
  • a of FIG. 14 illustrates an example in which one or both of the medical image for the right eye and the medical image for the left eye are displayed on the display screen.
  • a display range of the medical image displayed on the display screen is an image corresponding to an angle of view of an imaging device.
  • the angle of view of the imaging device may include an "angle of view that is the same as a size of a real scale of a subject viewed with the naked eye when an observer observes the display screen of the display device at an optimum viewing distance".
  • each of the first imaging device and the second imaging device has, for example, the "angle of view at which the size of the subject included in the medical image when the observer observes the display screen on which the medical image is displayed at a predetermined viewing distance, such as the optimum viewing distance, is similar to the size seen when an observer views the real scale of the subject with naked eyes.
  • B of FIG. 14 illustrates an example in which the image that has been subjected to the electronic zoom process is displayed on the display screen.
  • the display illustrated in B of FIG. 14 is, for example, display used when an operator (an example of the observer) desires to observe an enlarged image of a region to be treated during a treatment in a highlighted manner.
  • the display illustrated in B of FIG. 14 is desirably "display that is temporarily performed based on the operator's intentional operation".
  • C of FIG. 14 illustrates an example in which "one or both of the medical image for the right eye and the medical image for the left eye” and "the image that has been subjected to the electronic zoom process" are displayed in combination on the display screen.
  • C of FIG. 14 is an "example of display in which the image that has been subjected to the electronic zoom process is superimposed on one or both of the medical image for the right eye and the medical image for the left eye.
  • the medical observation apparatus 100 may perform adjustment such that a display parallax of the image that has been subjected to the electronic zoom process is seen on the farther side based on a distance from the observer to an observation target.
  • the distance from the observer to the observation target can be obtained by, for example, measuring the distance with a distance sensor or adding the optimum viewing distance of the display screen of the display device to the subject distance WD. Since the display parallax is adjusted as described above, the image that has been subjected to the electronic zoom process becomes an image that gives a feeling as if the observation target is viewed from the position of the observer.
  • a method of setting the image that has been subjected to the electronic zoom process to be the image that gives the feeling as if the observation target is viewed from the position of the observer is not limited to the above example.
  • the medical observation apparatus 100 can also "set the image that has been subjected to the electronic zoom process to be the image that gives the feeling as if the observation target is viewed from the position of the observer" by setting the magnification related to the electronic zoom process.
  • a subject included in the image that has been subjected to the electronic zoom process can be recognized to be located on the farther side by the observer by increasing a display parallax amount within an allowable range.
  • examples of the allowable range of the display parallax amount may include a range that does not exceed a representative value of the human's interocular distance.
  • the display parallax amount in the enlarged image of the cut-out range increases as the magnification related to the electronic zoom process increases.
  • the medical observation apparatus 100 sets the magnification related to the electronic zoom process such that the display parallax amount in the enlarged image of the cut-out range (hereinafter, referred to as a "first display parallax amount”) approaches a display parallax amount corresponding to the distance from the observer viewing the display screen to the subject (hereinafter referred to as a “second display parallax amount").
  • first display parallax amount the display parallax amount in the enlarged image of the cut-out range
  • second display parallax amount a display parallax amount corresponding to the distance from the observer viewing the display screen to the subject
  • the state where "the first display parallax amount approaches the second display parallax amount” includes, for example, a state where "the first display parallax amount matches with the second display parallax amount” and a state where "the first display parallax amount falls within the allowable range of the display parallax amount, and an absolute value of a difference between the second display parallax amount and the first display parallax amount is the minimum value.
  • magnification related to the electronic zoom process is set such that the first display parallax amount approaches the second display parallax amount, it is possible to implement "setting the image that has been subjected to the electronic zoom process to be the image that gives the feeling as if the observation target is viewed from the position of the observer".
  • the medical observation apparatus 100 calculates the second display parallax amount based on, for example, the angle of view of each of the first imaging device and the second imaging device, the distance from the observer to the observation target, and the size of the display screen of the display device.
  • the medical observation apparatus 100 determines the first display parallax amount based on the calculated second display parallax amount and an upper limit value corresponding to the allowable range of the display parallax amount. Then, the medical observation apparatus 100 sets the magnification related to the electronic zoom process based on a size of the set cut-out range and the determined first display parallax amount.
  • the medical observation apparatus 100 identifies the magnification related to the electronic zoom process by, for example, "referring to a table (or database) in which the size of the cut-out range, the display parallax amount, and the magnification are associated with each other", performing "an operation of an arbitrary algorithm that can identify the magnification based on the size of the cut-out range and the display parallax amount", or the like, and sets the identified magnification.
  • a table or database
  • examples of the display performed by the display control process according to the present embodiment are not limited to the examples described with reference to FIGS. 13 and 14 .
  • the medical observation apparatus 100 can display an image of a cut-out range corresponding to a set magnification.
  • FIG. 15 is an explanatory view for describing a second example of display performed by the display control process in the medical observation apparatus 100 according to the present embodiment, and illustrates an example of the display when a size of a cut-out range corresponding to a magnification is set in a zoom process.
  • a of FIG. 15 illustrates an example of display when the cut-out range set in the zoom process is a "cut-out range (standard size)" illustrated in FIG. 11 .
  • B of FIG. 15 illustrates an example of display when the cut-out range set in the zoom process is a "cut-out range (electronic zoom magnification 1)" illustrated in FIG. 11 .
  • C of FIG. 15 illustrates an example of display when the cut-out range set in the zoom process is a "cut-out range (electronic zoom magnification 2)" illustrated in FIG. 11 .
  • the cut-out range moves according to a predetermined moving operation in the zoom control
  • the example of the display corresponding to the movement of the cut-out range is not limited to the example illustrated below.
  • FIG. 16 is an explanatory view for describing a third example of display performed by the display control process in the medical observation apparatus 100 according to the present embodiment, and illustrates an example of the display when the cut-out range is moved in response to a predetermined moving operation in the zoom process.
  • a of FIG. 16 illustrates an example of display when the cut-out range is the cut-out range illustrated in A of FIG. 12 .
  • B of FIG. 16 illustrates an example of display when the cut-out range is the cut-out range illustrated in B of FIG. 12 .
  • C of FIG. 16 illustrates an example of display when the cut-out range is the cut-out range illustrated in C of FIG. 12 .
  • an image within the moved cut-out range is displayed in a display area in a state where the display area in which the electronically zoomed image is displayed is fixed on the display screen.
  • an observer can perform observation by moving only the image enlarged by the electronic zoom (electronically zoomed image) while maintaining the observation state around the cut-out range.
  • FIG. 17 is an explanatory view for describing the third example of display performed by the display control process in the medical observation apparatus 100 according to the present embodiment, and illustrates another example of the display when the cut-out range is moved in response to a predetermined moving operation in the zoom process.
  • a of FIG. 17 illustrates another example of display when the cut-out range is the cut-out range illustrated in A of FIG. 12 .
  • B of FIG. 17 illustrates another example of display when the cut-out range is the cut-out range illustrated in B of FIG. 12 .
  • C of FIG. 17 illustrates another example of display when the cut-out range is the cut-out range illustrated in C of FIG. 12 .
  • a position of a display area where the electronically zoomed image is displayed on the display screen is moved in a moving direction of the cut-out range so as to be interlocked with the movement of the cut-out range.
  • an image around the cut-out range is hidden as the display area moves, but an image around the cut-out range other than the moving direction remains visible.
  • the display area moves in the movement direction of the cut-out range in the display example illustrated in FIG. 17 , there is an "advantage that the observer feels as if he or she is moving the electronically zoomed image in a natural sense".
  • the following effects can be achieved. Needless to say, the effects achieved by using the medical observation apparatus according to the present embodiment are not limited to the following examples.
  • a program for example, a program capable of executing processing in the medical observation apparatus according to the present embodiment, such as a "program that functions as the image processor 110 illustrated in FIG. 6 " and a “program that functions as the image processor 110 and the display controller 112 illustrated in FIG. 6 ") for causing a computer system to function as the medical observation apparatus according to the present embodiment is executed by a processor or the like in the computer system, it is possible to obtain a medical image with a more natural three-dimensional effect.
  • the computer system according to the present embodiment includes a single computer or a plurality of computers. A series of processes according to the control method of the present embodiment is performed by the computer system according to the present embodiment.
  • programs for causing the computer system to function as the medical observation apparatus according to the present embodiment are executed by a processor or the like in the computer system, thereby enabling the foregoing advantageous effects afforded by the processing pertaining to the medical observation apparatus according to the present embodiment to be provided.
  • the program for causing the computer system to function as the medical observation apparatus according to the present embodiment is provided, but the present embodiment can further provide a recording medium storing the program therein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Surgery (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Gynecology & Obstetrics (AREA)
  • Quality & Reliability (AREA)
  • Biophysics (AREA)
  • Studio Devices (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Focusing (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Automatic Focus Adjustment (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
EP19811717.8A 2018-05-30 2019-03-12 Verfahren zur verarbeitung medizinischer bilder Withdrawn EP3806457A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018102993 2018-05-30
PCT/JP2019/009922 WO2019230115A1 (ja) 2018-05-30 2019-03-12 医療用画像処理装置

Publications (2)

Publication Number Publication Date
EP3806457A1 true EP3806457A1 (de) 2021-04-14
EP3806457A4 EP3806457A4 (de) 2021-07-07

Family

ID=68698768

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19811717.8A Withdrawn EP3806457A4 (de) 2018-05-30 2019-03-12 Verfahren zur verarbeitung medizinischer bilder

Country Status (5)

Country Link
US (1) US20210076023A1 (de)
EP (1) EP3806457A4 (de)
JP (1) JPWO2019230115A1 (de)
CN (1) CN112204959A (de)
WO (1) WO2019230115A1 (de)

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0795623A (ja) * 1993-06-25 1995-04-07 Sanyo Electric Co Ltd 立体撮像装置
JPH0937302A (ja) * 1995-07-18 1997-02-07 Olympus Optical Co Ltd 立体撮像装置
JP2001142166A (ja) * 1999-09-15 2001-05-25 Sharp Corp ３ｄカメラ
JP4212987B2 (ja) * 2003-08-26 2009-01-21 シャープ株式会社 立体画像表示装置、立体画像表示方法、その方法をコンピュータに実行させるためのプログラム及びそのプログラムを記録した記録媒体
JP4674094B2 (ja) 2005-02-10 2011-04-20 オリンパス株式会社 立体観察装置
JP4995854B2 (ja) * 2009-03-11 2012-08-08 富士フイルム株式会社 撮像装置、画像補正方法および画像補正プログラム
JP2011205385A (ja) * 2010-03-25 2011-10-13 Panasonic Corp 立体映像制御装置および立体映像制御方法
JP2012147059A (ja) * 2011-01-07 2012-08-02 Nikon Corp 画像情報処理装置及び画像情報処理システム
WO2013065543A1 (ja) * 2011-10-31 2013-05-10 富士フイルム株式会社 視差調節装置及び方法、撮影装置、再生表示装置
JP2015007722A (ja) * 2013-06-25 2015-01-15 キヤノン株式会社 画像表示装置
JP6323183B2 (ja) * 2014-06-04 2018-05-16 ソニー株式会社 画像処理装置および画像処理方法
WO2016208246A1 (ja) * 2015-06-24 2016-12-29 ソニー・オリンパスメディカルソリューションズ株式会社 医療用立体観察装置、医療用立体観察方法、及びプログラム

Also Published As

Publication number Publication date
CN112204959A (zh) 2021-01-08
EP3806457A4 (de) 2021-07-07
WO2019230115A1 (ja) 2019-12-05
US20210076023A1 (en) 2021-03-11
JPWO2019230115A1 (ja) 2021-09-09

Similar Documents

Publication Publication Date Title
US9766441B2 (en) Surgical stereo vision systems and methods for microsurgery
US9967475B2 (en) Head-mounted displaying of magnified images locked on an object of interest
EP2903551B1 (de) Digitales system für videoerfassung und -anzeige in der chirurgie
US9330477B2 (en) Surgical stereo vision systems and methods for microsurgery
US10561304B2 (en) Medical stereoscopic observation device, medical stereoscopic observation method, and program
JP4398352B2 (ja) 医療用立体撮像装置
JP2015531271A (ja) 外科用画像処理システム、外科用画像処理方法、プログラム、コンピュータ可読記録媒体、医用画像処理装置、および画像処理検査装置
JP2017509925A (ja) ３ｄビデオ顕微鏡装置
EP3514595B1 (de) Vorrichtung zur medizinischen beobachtung und steuerungsverfahren
JP2006158452A5 (de)
WO2013179855A1 (ja) 立体視内視鏡システム
JP2015205017A (ja) 手術顕微鏡システム
US20130300737A1 (en) Stereoscopic image generating apparatus, stereoscopic image generating method, and stereoscopic image generating program
JP2015220643A (ja) 立体観察装置
JP2016225861A (ja) 情報処理装置、情報処理方法、及び生体内撮像システム
US10634891B2 (en) Medical observation device, lens driving control device, lens driving control method, and video microscope device
JP2006208407A (ja) 立体画像観察用顕微鏡システム
EP3806457A1 (de) Verfahren zur verarbeitung medizinischer bilder
US12048485B2 (en) Surgery 3D visualization apparatus
JP5891554B2 (ja) 立体感提示装置および方法ならびにぼけ画像生成処理装置，方法およびプログラム
EP3677213A1 (de) Medizinische kontrollvorrichtung und medizinisches beobachtungssystem
KR101173280B1 (ko) 주시각 제어를 위한 입체 영상 신호의 처리 방법 및 장치
US20230147711A1 (en) Methods for generating stereoscopic views in multicamera systems, and associated devices and systems
WO2012043547A1 (ja) 立体視画像表示方法および立体視画像表示装置
WO2020161905A1 (ja) 顕微鏡、顕微鏡用制御装置及びプログラム

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201109

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20210607

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 13/128 20180101AFI20210531BHEP

Ipc: A61B 1/00 20060101ALI20210531BHEP

Ipc: A61B 90/20 20160101ALI20210531BHEP

Ipc: G03B 35/08 20210101ALI20210531BHEP

Ipc: G03B 35/18 20210101ALI20210531BHEP

Ipc: H04N 5/232 20060101ALI20210531BHEP

Ipc: H04N 13/239 20180101ALI20210531BHEP

Ipc: H04N 13/356 20180101ALI20210531BHEP

Ipc: H04N 13/361 20180101ALI20210531BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20220503