JP2001101451A - High-speed three-dimensional image display device and method for interactively designating coordinates within three-dimensional space on three-dimensional image while using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily, speedily and exactly perform the operation of point coordinate designation in a three-dimensional (3D) space while utilizing an input/output device which is generally available. SOLUTION: Concerning a 3D image display device provided with a CPU 21 for performing various kinds of processing such as numerical calculation and control of image processing, a first storage device 22 for storing 3D grid data or the like, a second storage device 23 for storing a processing program or known data, a display device 24 and an input device 25, a volume rendering processing program 231 and a 3D high-speed processing program 232 are stored in the second storage device 23.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus having a function of displaying a data set arranged in a three-dimensional space as a three-dimensional image, and more particularly to a user interface of various analysis applications based on the image. .

[0002]

2. Description of the Related Art Data arranged in a three-dimensional space typified by conventionally known numerical calculation data and medical image device data tends to have a very large number of data.
In many cases, it is practically impossible for humans to directly examine the numerical values of individual data. Therefore, expressing three-dimensional data as a three-dimensional image that is easily visually recognizable by humans is generally performed in many fields. The three-dimensional image generated in this way is not only viewed intuitively as a video, but is also used as important information for performing various analyzes according to the purpose of each field. There are many methods of analysis, but it is important to know the three-dimensional position accurately,
There are many analysis methods specially devised for each field, in addition to commonly used methods such as measuring the distance in three-dimensional space and calculating the volume of the space divided by certain conditions I do.

[0003]

When performing an analysis using three-dimensional spatial information using a three-dimensional image, the operation of designating / changing a position, a shape, a trajectory, etc. is performed by one or some input device. It is common to carry out as a combination of designation / change operations on a plurality of three-dimensional coordinates.
However, although an output device that displays a three-dimensional image, although it can only handle two-dimensional information, and an input device can specify only two-dimensional coordinates, input of three-dimensional coordinates is particularly difficult in the depth direction. It is difficult to specify the depth of the object. Although it is of course possible to directly specify each coordinate by numerical input, the advantage of intuitive operation using images is completely lost, and the value as an image display analysis system has been greatly impaired. In addition, there are three-dimensional input / output devices using special machines and devices, but they are very special and have many problems in terms of economy, reliability, ease of use, availability in the future, etc. It was hard to say that it reached a general and practical system. Such difficulty in specifying the three-dimensional coordinates has required a longer learning period for the operator and imposes a great mental and time burden on the operation. Furthermore, the contents intended by the operator are often not accurately recognized by the system, and the danger of impairing the most essential value of the system, namely, the credibility of the analysis result, has increased.

[0004] The present invention solves the above-mentioned problems by enabling the operation of specifying point coordinates in a three-dimensional space to be performed simply, quickly, and accurately using a commonly available input / output device. Is the solution.

[0005]

In order to achieve the above object, the invention of a three-dimensional image high-speed display device according to claim 1 is provided.
A CPU that performs various processes such as numerical calculation and image processing control, a first storage device that stores three-dimensional grid data and the like, a second storage device that stores processing programs and known data, a display device, and an input device And a volume rendering processing program and a three-dimensional high-speed processing program are stored in the ROM.

The invention according to claim 2 is characterized in that the three-dimensional image high-speed display device according to claim 1 has the following functions. (1) A high-speed three-dimensional display function that can continuously generate a three-dimensional image according to parameters that change over time. (2) A storage function for storing the coordinates of a point to be operated as a numerical value. (3) Coordinate points stored by the storage function of the above item (2) and related points, straight lines, figures, three-dimensional
(1) A graphic display function that can be clearly drawn at an arbitrary angle by the same projection method as the three-dimensional display of the item. (4) A superimposition display function of superimposing and displaying two images generated by the above items (1) and (2). (5) The operator sets the projection method, angle, etc., as described in (1).
(2) Function instructing function for instructing the function of each item. (6) A point movement instruction function in which an operator visually, interactively, and continuously instructs movement of a point to be operated on the image generated in the above item (4). (7) The movement on the image designated by the preceding paragraph is converted into a three-dimensional movement direction and movement distance based on the projection method, angle, and set constraints of the three-dimensional image at that time, and A three-dimensional coordinate changing function for changing the three-dimensional coordinates stored by the function of the above item (2) using It is characterized by.

According to a third aspect of the present invention, there is provided the high-speed three-dimensional image display device according to the second aspect, further comprising at least one of the following functions (a) to (c), and When the user gives an instruction to move the target point using the function of the above item (6), the three types of auxiliary images can be displayed or hidden independently. . (A) A three-dimensional object that can be displayed by superimposing a three-dimensional object such as a curved surface, a plane, a straight line, or the like as a figure on a three-dimensional image, which is composed of a set of all movable points. Overlay display function. (B) A data sampling superimposing display function of superimposing and displaying data obtained by sampling data from a three-dimensional data set using the same three-dimensional object using the same projection and angle as the three-dimensional image. (C) A processing function in which a three-dimensional data set is subjected to some processing such as cutting, emphasizing, and deforming using the same three-dimensional object, and a three-dimensional image display based on the data is also changed in conjunction therewith.

According to a fourth aspect of the present invention, there is provided a method of interactively designating coordinates in an original space on a three-dimensional image.
Using the described three-dimensional image high-speed display device, a data set obtained as three-dimensional grid point data is converted into a three-dimensional image using a high-speed three-dimensional image generation function, and the result of the three-dimensional image is displayed on a display. Display, and using the two-dimensional image displayed on the display as a visual guide, superimposing and displaying coordinate points graphically displayed by the same projection method as the three-dimensional image, such as a three-dimensional projection method and a viewpoint / angle. By continuously, intuitively grasping the current coordinate set values while continuously changing the three-dimensional image creation parameters of
It is characterized in that coordinates in a three-dimensional space are specified simply and accurately while using a two-dimensional input / output device.

Further, according to the present invention, while the coordinate set value is being changed, the coordinate change is performed using the three-dimensional grid point data, the three-dimensional image creation parameter at that time, and the set coordinate value being changed. Displaying more visual information by continuously and interactively generating auxiliary images that serve as visual guides and adding the function of superimposing or replacing the auxiliary images with the original display image It is characterized in that the coordinate points can be changed accurately and quickly according to the three-dimensional position intended by the operator.

[0010] With the above configuration, it is possible to quickly specify an accurate three-dimensional coordinate point on a three-dimensional image which is easy for the operator to intuitively understand, using a generally used two-dimensional input device and output device.・ Accurately possible. The operator
Create a three-dimensional image in which the coordinate point you want to express more distinctively by interactive specification of angles, drawing conditions, etc., and draw the operation target figure superimposed and displayed on the image as you want It can be easily installed at any position and shape. By repeatedly performing the designated operation, the operator can interactively and continuously check the superimposed image of the three-dimensional image and the figure at various angles and drawing conditions, and can always visually check for errors. . Further, the position change assisting image of the present invention makes it very easy to grasp the three-dimensional spatial position of the coordinate point on the three-dimensional image, including the depth, so that the number of position change operations and the coordinate point position Both of the time required for the entire specification can be greatly reduced. In addition, since it is very easy to check whether the coordinate point after the position change is accurately set to the three-dimensional position intended by the operator, the accuracy of the position designation is greatly improved.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Before describing the embodiments of the present invention in detail, the present invention can directly convert a vast amount of three-dimensional grid point data into three-dimensional data without converting them into conventional polygons. Volume rendering used by
Similarly, the MMX technology employed by the present invention will be described.

First, volume rendering will be described. In volume rendering, X-ray CT (Co
mputed Tomography)
The inside of the human body can be sliced and displayed as a tomographic image. This tomographic image represents the amount of X-ray absorption at each point on the tomographic plane. By stacking tomographic images obtained by moving the tomographic plane little by little, the X-ray absorption amount for each voxel, which can be divided at regular intervals in the vertical, horizontal, and front-back directions, is stored in a three-dimensional array. Data can be obtained. Such data is called volume data,
Depending on the measurement method, the concentration or density of a specific substance distributed in a certain space (volume) can be represented. When displaying a skeleton based on volume data, for example, in the conventional CG technique, it is necessary to first determine the shape of the surface of the bone and then apply a rendering algorithm such as ray tracing. However, bones have a very complicated shape in some places, and the absorption rate of X-rays in the bones and adjacent tissues may change smoothly, so that bones, muscles, internal organs, etc. must be clearly separated. Is difficult. In such a case, a method of directly drawing the tissue from the volume data without determining the shape of the surface of the bone is called volume rendering.
ering). As an application other than the medical image of volume rendering, it is used when displaying clouds using the concentration distribution of water vapor in the atmosphere.

The method of volume rendering is as follows (reference: "computer graphics")
(Page 204 and later) Published by the Image Information Education Committee, supervised by the Technical CG Standard Textbook Editing Committee.)
In volume rendering, a feature value distributed in a three-dimensional space is sampled at regular intervals along an arbitrary line of sight (ray), and the values are added to finally generate a translucent image. I do. Sampling a volume along a ray is called ray casting (ray c
asting). FIG. 13 shows the concept of volume rendering. Rays are emitted from each pixel on the projection plane, and voxels in the volume are sampled at regular intervals. In volume rendering, the interior is visualized by performing translucent display, which is realized by giving each voxel an opacity α. The opacity α may use the value of the voxel itself, but a method of determining α based on the gradient from the value of the adjacent voxel has also been proposed. By increasing α of the voxel corresponding to the surface of the object to be displayed, the object can be rendered opaque and emphasized. In ray casting, the product of the luminance value of each voxel and α is sequentially added, and when the sum of α becomes 1 or the ray exits the target volume, the processing for that pixel is terminated, and the addition is performed. The result is displayed as the value of the pixel. Assuming that the luminance value and the opacity at the current sample position are i and α, respectively, and the integrated luminance value incident on this point is I _in , the integrated luminance value I _out when passing through this sample point is expressed by the following equation ( It is represented by 1). I _out = I _in (1−α) + iα (1) In general, the luminance value and opacity at a sampling point in ray casting are linear as shown in FIG. 14 from the values of eight adjacent voxels. It can be obtained by interpolation.

FIG. 15 shows a general volume rendering processing procedure. First, in the pre-processing, noise removal, image enhancement, and the like are performed on the three-dimensional volume data obtained from the simulation results of the CT images and various physical quantity distributions. Here, three-dimensional image processing may be performed on the entire volume. Next, the luminance value and opacity of each voxel are determined, and the final luminance value for each pixel is obtained by ray casting. Determining these values is important in volume rendering.

Therefore, a method for determining the luminance value and the opacity will be described. First, with respect to the luminance value, the luminance value i of each voxel is calculated from the shading model of the phone using the normal vector N estimated from the gradient from the value of the adjacent voxel as shown in Expression (2). You. i = Ik _a + I _{[k d (N · L) +} k s (N · H) ] _{/ (k 1 + k 2 d} ) ···· (2) where, I is representative of the light source intensity. k _a , k _d , and k _s respectively represent the proportions of ambient light, diffused light, and specularly reflected light components normally used in CG. d represents the distance from the projection plane to the voxel, depth coding k ₁ and k ₂ are to be displayed brightly nearer to the projection surface (depth coding)
Is the parameter of the modulus. L is a unit direction vector from a voxel to a light source, H is a vector for obtaining specularly reflected light, and is obtained by the following equation using a line-of-sight vector V that is the direction of a ray. H = (V + L) / | V + L | (3) The normal vector N of a certain voxel f (i, j, k) in the volume is obtained by the following equation (4). N = ▽ f (i, j, k) / | ▽ f (i, j, k) | (4) where ▽ f (i, j, k) is x of this voxel value,
The gradient in the y and z directions is obtained as in the following equation (5). ▽ f (i, j, k) = [(f (i + 1, j, k) −f (i−1, j, k), (f (i, j + 1, k) −f (i, j−1, k), (f (i, j, k + 1) -f (i, j, k-1))] / 2 (5) A color attribute value can be given to each voxel. Determines the luminance value including the color as the product of the color characteristic of the light source and the color value of the voxel.
There is a method of calculating with the three primary colors, but more strictly, it is necessary to consider the spectral characteristics in the visible light region.

Next, how to determine the opacity will be described. As described above, the value of the voxel itself can be used as the opacity α, but there is also a method of determining α based on the gradient from the value of the adjacent voxel in addition to the voxel value. The reason for considering the gradient value is that the boundary between different components can be emphasized. Now, it is assumed that the voxel value f and the opacity α which are the boundaries of the components are given as shown in FIG. At this time, the opacity α of a voxel having an arbitrary voxel value f is given by the following equation (6) as the product of the gradient and the opacity interpolated from the figure. _{α = ▽ f [α n +} 1 (f -f n) / (f n + 1 - f n) + α n (f n + 1 -f n) / (f n + 1 -f n)] ··· (6) (When f _n <f <f _{n + 1} ; otherwise, α = 0)

The use of the above-described volume rendering processing has the advantage that three-dimensional data can be viewed accurately because there is no intermediate data conversion for converting to polygons as in the prior art. Moreover, when converted into polygons, polygons are obtained when a certain parameter has one value (for example, when temperature is a parameter, for example, at 20 ° C.), but information on other values (temperature) is not obtained. Although the polygon rendering process is missing, the volume rendering process allows the operator to see the desired temperature while looking at the display device while specifying, for example, 10 ° C. to 12 ° C. Become.

However, the drawback of the volume rendering process is that it takes a long time to process the volume rendering process, and it has never been conceivable to specify the volume rendering process interactively while using an input / output device. The present applicant focuses on the fact that the volume rendering process processes a huge amount of data, but the fact that most of the processing content is actually "repetitive processing", and employs MMX technology that enables high-speed processing. Then, it became possible to specify the information interactively. Therefore, next, the MMX technology which enables another high-speed processing, which is another base of the present invention, will be described.

The MMX technology was originally from Intel
"Technology to speed up processing in the multimedia and communication fields." In other words, conventional Penti
um (hereinafter referred to as “Pentium”) is a technology that has made it possible to execute a process with a heavy load or a process that was not possible at a higher speed, especially when handling multimedia data. . The core data processing method is described in M. J. "SI" proposed by Flynn
MD ”(Single Instruction-stream Multiple Data-s
tream). SIMD, as the word implies, is a method of processing a plurality of data with one instruction. It can be seen that if multiple data can be processed at one time, the execution speed will be faster, but that is linked to multimedia because most of the "multimedia processing" is actually "iterative processing". Performing effect processing on image data, reproducing audio data, decompressing a compressed file, and the like are all processes that endlessly repeat the same work on original data. For example, if the original data is D1
When it is composed of 100 elements from to D100, first, processing (operation) is performed on D1, and then D2,
Execute in order with D3. When executed one by one, 100 operations are required. However, if this can be processed at a time using SIMD, four data can be processed at first.
D4 can be extracted and operated, and then D5 to D8 can be extracted and processed, so that a total of 25 operations are required.

A description will be given of an example of an operation often used in signal processing. As shown in FIG. 17, two types of data strings (a,
Suppose that a process of calculating the sum of b) is performed by pairing each of the eight with b). Simply paying attention to the operation processing portion, in the case of the conventional method without MMX technology, data reading is performed 16 times, multiplication and shift are performed 8 times, and addition is performed 7 times. However, in the MMX technology, data reading requires only four times, multiplication twice, shift twice, and addition once. As described above, the number is 39 in the case of 9 and the number in the case of 9 is overwhelmingly, and the difference is overwhelmingly large. Further, since many of the MMX instructions require only one clock, the difference in the execution time is further increased. Thus, the present invention focuses on the fact that the SIMD method can perform processing in a short time, such as only a few seconds, for a volume rendering that conventionally took several hours.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a configuration diagram of an image processing system according to the first embodiment of the present invention. This system includes a computer main body 1, a display 2, a computer mouse 3, and a keyboard 4. The display 2 outputs a two-dimensional image, and the computer mouse 3 can perform two-dimensional position / motion input and button input. The operator gives instructions using the computer mouse 3 and the keyboard 4 while watching the screen displayed on the display 2. FIG. 2 is a block diagram of the apparatus according to the embodiment of the present invention, in which the CPU 21 performs various processes such as numerical calculation and control of image processing. The RAM 22 stores three-dimensional grid data and the like. The ROM 23 stores a processing program and known data. Here, a volume rendering processing program 231 used by the present invention and a three-dimensional high-speed processing program 232 using instructions and the like applying SIMD technology are also stored. The present invention is not limited to a RAM or a ROM, and it goes without saying that a storage device other than a semiconductor storage device may be used. The display device 24 is the display 2 shown in FIG. 1, and uses a CRT, a color liquid crystal display device, or the like. The input device 25 is the computer mouse 3 and the keyboard 4 shown in FIG. Although only one CPU is illustrated, a CPU dedicated to volume rendering processing or a CPU dedicated to three-dimensional high-speed processing may be separately used to increase the speed. To exchange three-dimensional lattice data with the outside, a parallel I / O (not shown) is used.
And a serial I / O are connected to the main bus. FIG.
FIG. 5 is a flowchart of a procedure for setting an arbitrary line segment in a three-dimensional space by the three-dimensional coordinate designation method according to the present invention. FIG.
FIG. 2 illustrates functions for realizing the present embodiment together with a data flow. A three-dimensional data set having a size in each of the vertical direction, the horizontal direction, and the height direction is input to the data storage shown in B3 of FIG. 4 in advance in the computer main body 1, and each data is represented by one numerical value. Is scalar data consisting of

In FIG. 3, in step S1, values are set to variables indicated by B4 and B5 in FIG. The value to be set is determined by the operation and the condition setting so far. B
4 stores a series of information such as a viewpoint position, a viewpoint angle, and a viewing angle necessary for expressing the three-dimensional projection, and B5 stores two three-dimensional information for expressing a line segment in the present embodiment. The coordinates are stored.

In step S2, first, a three-dimensional image is generated from a three-dimensional data set by a three-dimensional image display function (B6 in FIG. 4) realized by hardware and software of the computer main body 1. To generate the three-dimensional image, the data of B3 and the three-dimensional drawing parameters of B4 are used. In the present embodiment, the three-dimensional image is as shown in FIG.

In step S3, a figure for expressing the coordinate information stored in B5 is created. This figure is created by the same projection as the creation of the three-dimensional image, and in this embodiment, it is as shown in FIG. Here, P1 and P2 are figures representing two three-dimensional coordinates to be set, and L is a linear figure connecting P1 and P2 so that the operator can recognize the line segment.

In step S4, the two images created in steps S2 and S3 are superimposed and displayed on the display 2. In the present embodiment, it is as shown in FIG.

In step S5, the computer mouse 3
Alternatively, the operation waits until an operator input is made through the keyboard 4. In step S6, it is determined whether or not the input by the operator is an instruction to end the coordinate setting work, and if so, the entire processing is ended. In step S7, it is determined whether or not the input by the operator is an instruction to change the three-dimensional drawing parameters. If so, the process branches to step S8. In step S8, the contents of the three-dimensional drawing variable B4 are updated according to the instruction of the operator, and the process loops to step S2.

In step S9, it is determined that the operator's instruction is to change the three-dimensional coordinates, and it is first determined which of the two points the change instruction is for. In the present embodiment, when the button of the computer mouse 3 is pressed for the first time, it is determined that one of P1 and P2 which is closer to the mouse pointer is to be changed.

In step S10, a plane (M) on which the point to be changed can move is determined. In the present embodiment, it is assumed that the target point can move in a direction orthogonal to a straight line (N) drawn from the viewpoint position of the three-dimensional image to the current coordinates. Therefore, in this case, the plane M is a plane orthogonal to the straight line N. This is shown in FIG. Under these conditions, the point does not move in the depth direction when viewed from the operator, and the operation of moving the object vertically and horizontally and the three-dimensional movement of the target point are intuitively matched, which facilitates understanding.

In step S11, an auxiliary image is created using the surface M. As the auxiliary image of the present embodiment, the surface M
Thus, two types of images, ie, an image A obtained by cutting a three-dimensional image and an image B obtained by sampling three-dimensional data using a plane M, are created. Image A is shown in FIG. 9, and image B is shown in FIG.

In step S12, the auxiliary image created in step S11 is combined with the original display image and displayed on the display 2. The operator displays the original display image and image A
And the image B can be selected, superimposed with desired strength, and displayed on the display 2. FIG. 11 shows a display example in which only the image A is selected, and FIG. 12 shows a display example in which the image A and the image B are superimposed. In step S13, the process waits until there is an input from the computer mouse 3 or the keyboard 4 by the operator. In step S14, it is determined whether or not the input by the operator is an instruction to end the currently executing coordinate change. If there is an instruction to end, the process loops to step S4.

In step S15, the contents of the coordinate change are interpreted. The input of the operator is converted into a movement vector of the target point in the three-dimensional space. In step S16, the storage contents of the coordinate variable B5 are changed based on the movement vector calculated in step S15. In step S17, a new coordinate display figure is created based on the updated contents of the coordinate variable B5. That is, each of the figures P1, P2, and L is drawn at a new position. In step S18, the coordinate display graphic created in step S17 is superimposed on the three-dimensional image and displayed on the display 2, and the process loops to step S12.

As described above, the present invention comprises a combination of the following functions. In addition, each of these functions can continue to operate continuously at a speed sufficient to allow the operator to perform interactive operations according to parameters such as changing angles. (1) A high-speed three-dimensional display function that can continuously generate a three-dimensional image according to parameters that change over time. (2) A storage function for storing the coordinates of a point to be operated as a numerical value. (3) Coordinate points stored by the storage function of the above item (2) and related points, straight lines, figures, three-dimensional
(1) A graphic display function that can be clearly drawn at an arbitrary angle by the same projection method as the three-dimensional display of the item. (4) A superimposition display function of superimposing and displaying two images generated by the above items (1) and (2). (5) The operator sets the projection method, angle, etc., as described in (1).
(2) Function instructing function for instructing the function of each item. (6) A point movement instruction function in which an operator visually, interactively, and continuously instructs movement of a point to be operated on the image generated in the above item (4). (7) The movement on the image designated by the preceding paragraph is converted into a three-dimensional movement direction and movement distance based on the projection method, angle, and set constraints of the three-dimensional image at that time, and A three-dimensional coordinate changing function for changing the three-dimensional coordinates stored by the function of the above item (2) using (8) When the operator instructs movement of a target point using the function of the above item (6), the following (a), (b),
The three types of auxiliary images (c) can be independently displayed or hidden. (A) A three-dimensional object that can be displayed by superimposing a three-dimensional object such as a curved surface, a plane, a straight line, or the like as a figure on a three-dimensional image, which is composed of a set of all movable points. Overlay display function. (B) A data sampling superimposing display function of superimposing and displaying data obtained by sampling data from a three-dimensional data set using the same three-dimensional object using the same projection and angle as the three-dimensional image. (C) A processing function in which a three-dimensional data set is subjected to some processing such as cutting, emphasizing, and deforming using the same three-dimensional object, and a three-dimensional image display based on the data is also changed in conjunction therewith.

In the conventional apparatus, it is possible to measure the distance between two points in a two-dimensional image, but it is too long and impossible to measure the distance between two points in a three-dimensional image. Although I did not even think about such a thing, according to the present invention, it becomes possible. That is, using a normal two-dimensional display device and a mouse, a three-dimensional space image is displayed on the two-dimensional display device using the high-speed three-dimensional image generation according to the present invention, and a point in the three-dimensional space is designated with the mouse. By rotating, enlarging, moving, etc. at high speed, it is possible to re-designate the position by rotating the depth, which was not known only by projecting two points on one screen, and to specify the position by further rotating. The convergence is rapid only by repeating several times, and the distance between the two points can be accurately measured.

[0034]

As described above, a conventional two-dimensional display device, such as a two-dimensional display device, which was not even considered in the conventional device, is used.
According to the present invention, the distance between points can be measured at a high speed by a high-speed three-dimensional image generation function, such as rotating, enlarging, or moving a figure. The depth can be immediately known by high-speed rotation, and the distance between two points can be accurately measured by repeating the re-designation of the position several times. The above is an example of rotation, but the same can be said for enlargement and movement.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram according to an embodiment of the present invention.

FIG. 2 is a configuration diagram of an apparatus according to an embodiment of the present invention.

FIG. 3 is a processing flow chart in the embodiment of the present invention.

FIG. 4 is a block diagram showing a data flow in the embodiment of the present invention.

FIG. 5 is an example of a three-dimensional image generated by B6.

FIG. 6 is an example of a coordinate display graphic generated by B7.

FIG. 7 is an example of a superimposed image without an auxiliary image generated by B8.

FIG. 8 is a diagram illustrating a relationship between a plane M on which a coordinate setting target point can move and a viewpoint in the embodiment of the present invention.

FIG. 9 shows an example of an auxiliary image generated by B10.
An image A created by cutting a three-dimensional image by a plane M is shown.

FIG. 10 shows an image B created by sampling three-dimensional data using a surface M as an example of an auxiliary image generated by B10.

FIG. 11 is an example of a superimposed image in the case of auxiliary images A and B generated by B8, showing an original display image and a display example in which only image A is selected.

FIG. 12 is an example of a superimposed image in the case of auxiliary images A and B generated by B8, showing a display example in which an original display image and an image A and an image B are superimposed.

FIG. 13 is a diagram showing the concept of volume rendering.

FIG. 14 is a diagram showing sampling in ray casting.

FIG. 15 is a diagram showing a volume rendering processing procedure.

FIG. 16 is a diagram illustrating an opacity α in consideration of a gradient value.

FIG. 17 is a diagram illustrating a data processing method.
(A) is a figure which shows the conventional method, (b) is a figure which shows the method of MMX technology.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Computer main body 2, 24 Display 3 Computer mouse 4 Keyboard 21 CPU 22 RAM 23 ROM 231 Volume rendering processing program 232 3D high-speed processing program 24 Display device 25 Input device

 ────────────────────────────────────────────────── ─── Continued on the front page F term (reference) 5B050 CA02 CA07 EA12 EA19 EA27 EA28 FA02 FA05 5B080 AA17 BA02 FA02 FA08 FA17 5C082 AA01 AA24 BA12 CB01 CB06 DA22 DA87 MM02 MM09

Claims (5)

[Claims] A CPU for performing various processes such as numerical calculation and control of image processing; a first storage device for storing three-dimensional grid data and the like; a second storage device for storing processing programs and known data; A three-dimensional image display device comprising a device and an input device, wherein a volume rendering processing program and a three-dimensional high-speed processing program are stored in the second storage device. 2. The three-dimensional image high-speed display device according to claim 1, wherein the three-dimensional image high-speed display device has the following functions. (1) A high-speed three-dimensional display function that can continuously generate a three-dimensional image according to parameters that change over time. (2) A storage function for storing the coordinates of a point to be operated as a numerical value. (3) Coordinate points stored by the storage function of the above item (2) and related points, straight lines, figures, three-dimensional
(1) A graphic display function that can be clearly drawn at an arbitrary angle by the same projection method as the three-dimensional display of the item. (4) A superimposition display function of superimposing and displaying two images generated by the above items (1) and (2). (5) The operator sets the projection method, angle, etc., as described in (1).
(2) Function instructing function for instructing the function of each item. (6) A point movement instruction function in which an operator visually, interactively, and continuously instructs movement of a point to be operated on the image generated in the above item (4). (7) The movement on the image designated by the preceding paragraph is converted into a three-dimensional movement direction and movement distance based on the projection method, angle, and set constraints of the three-dimensional image at that time, and A three-dimensional coordinate changing function for changing the three-dimensional coordinates stored by the function of the above item (2) using 3. The three-dimensional image high-speed display device according to claim 2, further comprising at least one of the following functions (a) to (c), and wherein an operator has the function described in (6). A three-dimensional image high-speed display apparatus characterized in that, when a movement of a target point is instructed using a function, the auxiliary image can be independently displayed or hidden. (A) A three-dimensional object that can be displayed by superimposing a three-dimensional object such as a curved surface, a plane, a straight line, or the like as a figure on a three-dimensional image, which is composed of a set of all movable points. Overlay display function. (B) A data sampling superimposing display function of superimposing and displaying data obtained by sampling data from a three-dimensional data set using the same three-dimensional object using the same projection and angle as the three-dimensional image. (C) A processing function in which a three-dimensional data set is subjected to some processing such as cutting, emphasizing, and deforming using the same three-dimensional object, and a three-dimensional image display based on the data is also changed in conjunction therewith. 4. A three-dimensional image using a high-speed three-dimensional image generation function to convert a data set obtained as three-dimensional grid point data into a three-dimensional image using the three-dimensional image high-speed display device according to claim 3. The imaged result is displayed on a display, and the two-dimensional image displayed on the display is used as a visual guide, and the coordinate points graphically displayed by the same projection method as the three-dimensional image are superimposed and displayed. By interactively, continuously and intuitively grasping the current coordinate setting values while continuously changing the three-dimensional image creation parameters such as the original projection method and the viewpoint and angle, it is possible to use a two-dimensional input / output device to perform tertiary A method for interactively specifying coordinates in a three-dimensional space on a three-dimensional image, which is characterized by simply and accurately specifying coordinates in a source space. 5. An auxiliary device for providing a visual guide for coordinate change using the three-dimensional grid point data, the three-dimensional image creation parameter at that time, and the set coordinate value being changed while the coordinate set value is being changed. Displaying more visual information by adding the function of generating images continuously and interactively and overlaying or replacing the auxiliary image with the original display image, displaying the three-dimensional image intended by the operator 3. The designation method according to claim 2, wherein the coordinate point can be changed accurately and quickly according to a specific position.