WO1992022243A1 - Method and apparatus for archiving and displaying anatomico-physiological data - Google Patents

Abstract

Method and apparatus for archiving and simultaneous display of brain scan images and a plurality of brain maps. The brain maps are proportioned to the individual brain of the scan images by a three-dimensional alignment process (504). Two-dimensional and three-dimensional displays are supported.

Description

METHOD AND APPARATUS FOR ARCHIVING AND DISPLAYING ANATOMICO-PHYSIOLOGICAL DATA

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part application of U.S. Patent Application Serial No. 07/500,788, entitled Three -Dimensional Graphics Simulation and Actual Imaging Data Composi te Display, to Hardy, filed on March 28, 1990, which is a continuation-in-part of U.S. Patent Application Serial No. 07/290,316, entitled Method and Apparatus for

Video Presentation from a Variety of Scanner Imaging Sources , to Hardy, filed December 23, 1988, the teachings of both of which are incorporated herein by reference.

This application is also related to U.S. Patent Application Serial No. 07/428,242, entitled Three -Dimensional Laser Localization Apparatus and Method for Stereotactic Diagnoses or Surgery , to Hardy, et al. , filed October 27, 1989, and to U.S. Patent Application Serial No. 07/534,975, entitled Three-Dimensional Computer Graphics Simulation and Computerized Numerical Optimization for Dose Delivery and Treatment Planning, to Hardy, et al. , filed June 8, 1990, the teachings of both of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION Field of the Invention (Technical Field) : The present invention relates to a method and apparatus for displaying maps of anatomical brain structures, physiological and chemical topography, and other such data in combination with scanned images of individual human brains. The invention produces two-dimensional and three-dimensional displays, with maps proportioned properly according to landmarks in and around the scanned brain. The invention also permits display of a combination of two or more types of brain maps simultaneously and the archiving and cross- referencing of anatomico-physiological data in a normalized whole-brain mapping and imaging environment. This normalized mapping technique further permits the plotting, transposing and interrogation of data from various mapping sources or treatment modalities in the same imaging environment. Such examples also include but are not limited to: 1) Plotting known or scan determined metabolic and/or chemically specific regions or structures of the brain.

2) Plotting known or scan determined psycho—physical regions of the brain and other such data.

3) Plotting and determining the radiation dose to each area or structure of the brain during radiation treatment.

4) Plotting known or scan determined electromagnetic somatotopography of the brain.

Background Art: The prior art discloses three primary systems for mapping the human brain, all involving reference to books and charts in order to pinpoint anatomical structures and functions or responses within individual brain scan or other images, such as, but not limited to, computerized axial tomography (CT) , magnetic resonance imaging (MRI) , radloisotope imaging, and other similar digital imaging systems.

The first primary brain mapping system of the prior art is disclosed by J. Talairach & P. Tournoux, "Co-Planar Stereotaxic Atlas of the Human Brain," (New York; Theieme Medical Publishers; 1988). That book places 133 anatomical structures within a three-dimensional proportional grid subdividing the human brain.

The second system of the prior art Is disclosed by G. Schaltenbrand & P. Bailey, Introduction to Stereotaxis with an Atlas of the Human Brain (New York, Thieme, 1959), J.M. Van Buren & R.C. Borke,

Variations and Connections of the Human Thalamus (vols. 1 & 2 , New York, Springer, 1972), and G. Schaltenbrand & W. Wahren, Atlas for Stereotaxy of the Human Brain (2d ed. , Stuttgart, Thieme, 1977). These references consist of magnified photographs of human brainstem slices (including thalamus and lower brainstem regions) wherein subregional or subdivisions of larger structures are indicated by line drawings which represent the microscopic boundaries between such subregions or subdivisions. These mapping systems generally have transparent plastic sheet overlays which contain the line drawings and can be superimposed over the photographs so that such subdivisions can be discerned. The third system of the prior art is disclosed by T. Hardy, "Stereotactic CT Atlases," ch. 34 of L.D. Lunsford, ed. , Modern Stereotactic Surgery (Boston, Martinus Nijhoff, 1988) . This reference reports subdivisions of the brain by physiological responses according to electrical stimulation or recordings in and about the brain.

With the prior art, a brain surgeon would be required, in planning an operation (regardless whether stereotactic or otherwise) , to compare scans of the patient's brain with information from the above references, and would be required to construe certain anatomical structures within the scans based upon visual interrogation of the scans and the references. Such practitioners would also be required to infer or surmise the position of various physiological brain regions. For very precise work, this might involve calculations by hand to correlate the reference brain sizes and shapes with the size and shape of the patient's brain.

SUMMARY OF THE INVENTION (DISCLOSURE OF THE INVENTION)

The present invention presents a method and an apparatus for providing brain map data to a user comprising: digitally archiving brain map data; displaying on a display device one or more brain maps; and manipulating the brain maps on the display device.

In the preferred embodiment, manipulating comprises varying the size, shape, and location of the brain maps on the display device. The preferred embodiment additionally comprises displaying images of an individual patient's brain on the display device, wherein the brain maps are combined with the displayed images of the individual patient's brain to create a composite image on the display device including a two- dimensional overlayed composite image, a three-dimensional transparency composite image, and a three-dimensional image comprising three images of the patient's brain, one in the sagittal plane, one in the horizontal plane, and one in the verticofrontal plane. The brain maps are manipulatable to correspond in location, size, and shape to the images of the individual patient's brain on the display device.

The brain map data may comprise at least one member selected from the group consisting of Talairach-Tournoux anatomical data, Schaltenbrand and Bailey anatomical maps, Van Buren and Borke anatomical maps, Schaltenbrand and Wahren anatomical maps, electrophysiological response data, electromagnetic encephalography (EMEG) data, somatosensory evoked potentials data, electroencephalagram (EEG) data, metabolic brain scanning data, and blood vessel territorial supply data. The brain maps are independently manipulatable to correspond in size, shape, and location to one another on the display device and may be combined with one another to create a composite image on the display device (including two-dimensional overlayed composite image and three— dimensional transparency composite image) .

Manipulating may comprise manipulating the brain maps with reference to specified landmarks, including anatomical structures and reference points on a stereotactic frame. The anatomical structures tacked may comprise anterior commissure, posterior commissure, highest surface of parietal cortex, most posterior surface of occipital cortex, most anterior surface of frontal cortex, lowest surface of temporal cortex, left-most lateral surface, right-most lateral surface, thalamic height, fourth ventricle caudal floor fourth ventricle rostral floor, anterior pons wall, intercommissural plane, third ventricle width, lateral ventricle margin, thalamic width, lateral thalamic border, anterior brainstem margin, posterior brainstem margin, brainstem width, lateral brainstem margin. Manipulating may comprise tacking anatomical structures on the display device.

The preferred embodiment further comprises displaying and manipulating one or more simulated brain structures on the display device. The simulated brain structures may be combined with the brain maps to create a composite image on the display device, including a two- dimensional overlayed composite image and a three—dimensional transparency composite image. The simulated brain structures are manipulatable to correspond in location, size, and shape to the brain maps on the display device.

Structures within one of the brain maps on the display device may be selected, whereupon textual information concerning the structure is displayed on the display device, for instance nomenclature for the structure, nomenclature for substructures of the structure, nomenclature for structures containing the structure, medical information concerning the structure, and warnings and advice concerning the structure. Brain maps may be manipulated by enlarging the selected structure on the display device, showing greater detail of the selected structure.

A primary object of the present invention is to permit computer- controlled display of brain scans in combination with appropriately proportioned maps of anatomical brain structures, physiological and chemical topography, and other such data in combination with scanned images of individual human brains.

Another object of the present invention is to permit display of three-dimensional simulations of the locations of anatomical structures and functions, or physiological and chemical responses and functions within a patient's brain.

An additional object of the present invention is to permit cross- correlation and simultaneous display of anatomical brain maps from different prior art brain mapping systems.

Yet another object of the present invention is to permit the archiving of anatomico-physiological data in a normalized, brain mapping and imaging system.

A primary advantage of the present invention is that a brain surgeon or other health practitioners may locate anatomical structures, and determine their names and brief descriptions, within a brain scan without consulting a textual reference work.

Another advantage of the present invention is that calculations by hand to position instruments, beams, radioactive dosages, and the like, within a patient's brain are obviated.

An additional advantage of the present invention is that additional mapping data from anatomico-physiological interrogation of the brain can be archived in a normalized brain mapping and imaging system for cross-correlation and future reference.

Other objects, advantages, and novel features, and further scope of applicability of the present invention will be set forth in part in the detailed description to follow, taken in conjunction with the accompanying drawings, and in part will become apparent to those skilled in the art upon examination of the following, or may be learned by practice of the invention. The objects and advantages of the invention may be realized and attained by means of the Instrumentalities and combinations particularly pointed out in the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated into and form a part of the specification, illustrate several embodiments of the present invention and, together with the description, serve to explain the principles of the invention. The drawings are only for the purpose of illustrating a preferred embodiment of the invention and are not to be construed as limiting the invention.

Fig. 1 illustrates a three-dimensional ("3-D") Talairach-Tournoux type display of the invention;

Fig. 2 illustrates a two-dimensional ("2-D") anatomical brain map display of the Invention;

Fig. 3 Illustrates a two-dimensional electrophysiological display of the invention;

Fig. 4 illustrates a two-dimensional cross-correlation display of the invention;

Fig. 5 illustrates a three-dimensional cross-correlation display of the invention;

Figs. 6—10 illustrate the preferred tacking process of the Invention;

Fig. 11 is a block diagram of the preferred embodiment of the method of the present invention;

Figs. 12—17 are flowcharts representing the software embodiment of the invention; Fig. IT illustrates division of the two hemispheres of the brain (left and right) into proportional voxols;

Figs. 19 and 20 are charts of stimulation and recording data from the diencephalon; and

Fig. 21 illustrates a 3-D display of the position of two dipole moments in the brain from EMEG recording.

DESCRIPTION OF THE PREFERRED EMBODIMENTS (BEST MODES FOR CARRYING OUT THE INVENTION)

The whole brain mapping, archiving and display apparatus and method of the present invention comprise methods, hardware components and associated software, providing to neurosurgeons, radiologists, or other health practitioners the ability to display patients' brain scans simultaneously with maps of anatomical structures and/or brain functions or responses appropriately proportioned to the particular patient's brain scans. The invention is useful for all operations on the brain and interrogations of the brain's structures and functions, whether or not invasive, both in planning and during execution of operations or interrogations.

Throughout the specification and claims, the following terms are defined as follows: "Tacking" is an alignment process which consists of entering into a computer system the spatial position of a point, object, structure or surface. "Voxol" is a divisional unit of three-dimensional space which consists of either a cube or a parallelpiped. "Ventricles" are central cavities of the brain which constitute normal brain structures around which other constant structures are found. "Brainstem" is the central core structure of the brain, including the thalamus and basal ganglia, which is an upward continuation of the spinal cord. "Three primary brain mapping systems" include the Talairach-Tournoux whole brain proportional system, the brainstem anatomical atlas maps of Schaltenbrand and Bailey, Van Buren and Borke, and Schaltenbrand and Wahren, and the electrophysiological topographical maps of Hardy. "Mapping" is the process of identifying or localizing the position of anatomico-physiological data and structures or regions of the brain in a manner which allows such topography to be discerned and reproducible. "Normalizing" is the process of sizing the brain in a standard and reproducable fashion such that cross—referencing and comparisons are possible.

The preferred embodiment of the present invention permits simultaneous display, manipulation, and/or cross-correlation of brain mapping systems such that data from various mapping techniques can be related to each other in a normalized mapping environment. In each of the mapping systems of the preferred embodiment (the Talairach-Tournou , brainstem anatomical, and electrophysiological), a common mapping origin of a cartesian coordinate system is constructed about the third ventricle (also the fourth ventricle In the case of the brainstem anatomical and the electrophysiological mapping systems) , and the systems are organized in such a manner that they serve as standard referencing systems upon which other anatomico-physiological mapping data can be correlated. As an example, a health practitioner may display a scan Image of a particular horizontal slice of a patient's brain. The practitioner may then superimpose an anatomical map showing the positional organization of anatomical structures within the scanned image (Fig. 4). If the anatomical map is not sized properly for the particular patient, the practitioner may execute a resizing procedure to more precisely conform the anatomical map overlays with the particular brain being studied. The practitioner may then display electrophysiological mapping data upon the scan for a particular brain response, for example the location of a stimulus response resulting in contraction of the right thumb (Fig. 3) . Both mapping methods

(brainstem anatomical and electrophysiological) use the same coordinate reference system and may therefore be combined with each other or with the Talairach-Tournoux method, having the same coordinate reference system, for additional cross correlation and comparison (Fig. 5). In addition, anatomico-physiological data obtained by other authors which use either the same or similar nomenclature and/or similar topography or reference anatomy can be readily cross-correlated and archived in the whole brain mapping, archiving and Imaging system.

The invention is readily extendible to additional brain mapping systems developed by the art. For example, electromagnetic encephalography (EMEG) is a new electro-physiological mapping system in which electrical dipole moments can be detected by highly sensitive super-cooled electromagnetic detectors (SQUIDS) (see Sutherling, et al., "The magnetic and electric fields agree with intracranial localizations of somatosensory cortex," 38 Neurology 1705-14 [Nov. 1988]). Such electrical dipole moments can be discerned by these detectors as they are propagated through the brain, such that the electrical moment, for example of a finger movement or other such brain physiological activity, can be discerned against the brain's normal electrical background activity (Fig. 21). The current mapping system is ideal for localizing the anatomical electro-physiological topography of such responses and correlating them with prior knowledge of the brain's anatomico-physiological topography. Similar mapping data from other brain mapping sources, e.g., somatosensory evoked potentials, electroencephalography (EEG) , metabolic brain scanning (as in positron emission tomography and SPECT scanning) , blood vessel territorial supply (see G. Salamon & Y.P. Huang, Radiologic Anatomy of the Brain [New York, Springer—Verlag, 1976]) and other such mapping systems or data may be entered to the preferred embodiment of the present invention. It may then be displayed alone or simultaneously with other maps upon patient brain scans and/or cross-correlated.

The Talairach-Tournoux system of the prior art divides the brain into a three-dimensional ("3-D") grid system (Figs. 1 and 18) and is defined according to the maximum dimensions of the brain in the three cartesian planes of space. In two—dimensions, the rectangles of the grid represent the division of the cerebral mass into rectangular parallelepipeds (voxels) in three-dimension. These parallelepipeds in 3-D space are divided as follows:

- in the vertical direction, into 12 horizontal sectors, designated 1 through 12, superior to inferior 2.

- in the anteroposterior direction, into 9 frontal sectors, designated A to I 4. Additionally, E, which is the area located within the perpendiculars through the anterior commissure ("VAC") and posterior commissure ("VPC"), is divided into 3 sectors 6, allowing a more precise localization of the central gray nuclei. — in the transverse direction, into 4 sagittal sectors, designated a through d in both directions away from the midline 8.

Basing these divisions of the brain on any individual brain proportions, this proportional mapping system creates a normalized general mapping system valid for all brains. Such a system can be adapted to brains of all dimensions.

The prior art discloses an anatomical index identifying many structures (see Talairach & Tournoux at pp. 114-19). For each of the three planes of cartesian coordinate space, the following are indicated in the index:

— cortical areas

— gy i ^aτιd sulcl — bundles and ventricles

— deep gray nuclei, hypothalamic nuclei

The index gives the following data:

— section: sagittal, frontal, or horizontal - small letters (a through d) for sagittal sectors

— capital letters (A through I) for frontal sectors

— numbers (1 through 12) for horizontal sectors

— millimeter distance from the basal line

— midline for lateral measurement — vertical AC line (VAC) for the anteroposterior measurement (+ anterior, - posterior)

— basal line AC-PC for the vertical measurement (+ above, - below)

The method and apparatus of the present invention permits computer display of Talairach-Tournoux grid coordinates after brain sizing information has been entered. Once the proportional grid has been defined, any point in the scan can be identified as to the anatomical structures resident in that voxol of brain. This example constitutes a "frameless" coordinate system wherein anatomico-physiological data are localized by Identifying the proportional grid voxol (parallelepiped) in which such structures or data are found. If a patient's scanned images are taken with a stereotactic frame or other such reference markers in place, then the coordinate position can also be noted in relationship to the three planes of a cartesian coordinate system or any other coordinate system (for example, polar or cylindrical).

Since anatomical structures are most efficiently named on a computer display using abbreviations, there is also the need for a computer library listing of the international nomenclature. The preferred embodiment of the invention provides such a listing of structures or functions which are noted in the teachings of the primary prior art mapping systems (Talairach-Tournoux, anatomical and electrophysiological) .

The method and apparatus of the present invention also permit computer display of anatomical maps corresponding to horizontal, sagittal, and verticofrontal slices of the human brainstem. The line drawings of the prior art displaying brainstem anatomical structures corresponding to various slices of the -brain have been digitized (Fig. 2). The digitized maps may be resized to conform to a particular patient's brain by the process of tacking certain anatomical coordinate structures {e .g. , anterior commissure, posterior commissure, and other such anatomical landmarks) about the third ventricle and, in the case of lower brainstem maps, coordinate structures { e .g. , floor of fourth ventricle, ventricular apex and anterior pontine border) about the fourth ventricle within certain scans taken of the patient's brain.

After tacking, the digitized maps are resized before being placed as an overlay display superimposed upon a scan of a brain slice of the patient. This method of mapping creates a normalized anatomical brainstem mapping coordinate system of anatomical overlays valid for all brains.

Additionally, the method and apparatus of the present invention permit computer display of electrophysiological mapping data (Fig. 3). This mapping data consists of a set of known physiological responses to electrical stimulation and recording of the brain (Figs. 19 and 20).

For each physiological response (for example, the topographical position of stimulus or recorded responses representing sensation or movement of a limb or contraction of a muscle [Fig. 3]) data specifying the actual location within a brain where such responses occur upon electrical stimulation and/or recordings thereof is archived. A particular patient's brain may be sized, as with anatomical mapping, and such electrophysiological response data can be displayed upon slices of the patient's brain (Fig. 3) or within voxols of a three-dimensional display (Fig. 5) . Such data is plotted and stored as to a normalized coordinate system (previously described above for the associated brainstem anatomical maps and the Talairach-Tournoux method of whole brain proportioning) about the third ventricle. Display of electrophysiological data is important for localizing the anatomical structures associated with certain physiological functions. Furthermore, the display of electrophysiological data is of aid in planning operative procedures in, and physiological and chemical interrogations of, the brain.

Because these prior art mapping systems are based on the same anatomical landmarks {e.g. , coordinate structures about the third ventricle which include the anterior commissure and the posterior commissure) , it is possible to cross—correlate any one of these mapping systems with one another as well as other mapping systems. It is also possible to transform any such mapping data to other coordinate environments such as stereotactic frame or radiographically calibrated coordinate space, and therefore also display or cross—correlate such mapping data in either a two—dimensional or three-dimensional fashion. Likewise, since most other mapping systems utilize internationally recognized nomenclature for the identification of anatomico- physiological structures and the positional location of such structures are normalized Into the whole brain mapping, archiving and imaging environment of the present invention, then it is possible to cross- correlate data from other mapping systems into the imaging environment of the present invention.

The method and apparatus of the present invention store primary indices of anatomical structures and functions, each according to the primary mapping systems, within computer files in the following fashion: A. Talairach-Tournoux type system

Each location in the file contains a flag indicating whether the correspondingly numbered structure is found (1) or is not found (0) at that location, as exemplified below:

location in file grid location structure #

1 1 2 2

112 ab

223

The structure number corresponds to an index into an array of strings (the abbreviations for the name given by the international nomenclature of each structure) .

As shown in Fig. 13, searching of the index for anatomical structures in a given grid location 200 (cortical or subcortical area) is accomplished on initiation 202 by directly locating the correct grid locations 204 in the index file 206 and determining which structures are found in each of the three grid coordinates. Once the three grid coordinates (voxol) of a selected point are determined, the structures are determined as follows. The index file is opened 206 and each of the three grid coordinate entries are located and the structure list extracted 208. The list of structures located at each of the three grid coordinates 210 is then compared (by "AND"ing the three lists) and the structures located at the given voxol (located within all three coordinates) are thus determined 212.

Once the binary list of structures at a given point has been determined 214, the structure library file Is opened 214. Beginning with the first location in the binary list 216, and for each location 226, a loop is performed, after which the procedure is exited 228. In the loop, the value at location n of the binary list is extracted 218, its binary value determined 220, and If it is 1 then the structure name corresponding to the current location in the binary list is added to a list of structures at the point of interest 222 and the number of structures found is incremented 224.

As shown In Fig. 14, searching of the library 300 for the grid coordinates for specified anatomical structures 304 is accomplished 302 by opening the structure library file 306, and looping through the structure library until the file Is exhausted 314 or the requested structures are found 316, at which point the procedure is exited 324. Each name field 308 entry 310 is searched for a match with the specified structure name, until the field entries (all given structure names) are exhausted 314. When a structure is found in the library file 312, the voxol locations are extracted from the entry's location field 318 and are placed on a list 322 until exhausted 320.

As shown in Fig. 15, structures are displayed 400 once voxol locations have been determined 402 based upon the list of locations compiled 404. For each voxol 406, data is added to a display list of two—sided polygons 414. If the data 408 is based on the Talairach- Tournoux system, display coordinates are determined based on grid location (see Fig. 17) . If the data 408 is based on brain anatomical location and dimensions, display coordinates are determined with reference to tacked points 410. The polygons are then displayed 418 until all have been displayed 416, whereupon the display process Is complete 420.

As shown in Fig. 17, to determine the cartesian coordinates of any given Talairach-Tournoux voxol (Identified by three Talairach-Tournoux) grid coordinates, i . e . , "a-6—D") for display or cross correlation, it Is necessary to convert each coordinate into its representative location 600. Starting 602 with coordinate 3 604 ('A' through 'I' which divides the brain from anterior to posterior) the anterior-most coordinate of the voxol is determined by moving forward or backward along the AC—PC "plane" (from either the AC or the PC) the appropriate distance. The appropriate distance is based on the grid coordinate which determines the starting point and direction as follows: 'A' through 'D' : start at AC and move forward (anterior) 606;

'E' : start at PC and move forward (anterior) 608; and

'F' through 'I': start at PC and move backward (posterior) 610.

Once the anterior-posterior location of a voxol region is determined, the vertical (S-I) 612 and horizontal (R-L) 618 locations of the voxol are found in the same manner (614 or 616, and 620 or 622, or 624 and 626) for final localization of the spatial position of the voxol, whereupon the procedure is complete 630.

The anatomical structures selected (as well as the corresponding voxols) and any Talairach-Tournoux defined electrophysiological data selected are stored for access by the invention. Since it is not known ahead of time how many voxols or electrophysiological units need to be displayed, the best data structure for this information is a linked list. This dynamic structure is flexible enough to allow access and display of a large amount of data and to allow for future addition of additional mapping capabilities.

The selection of structures of interest to the brain surgeon is performed much the same way menu questions are selected within the menus disclosed by U.S. Patent Application Serial No. 07/500,788. The user simply touches the screen at the structure listing. Each mapping system has a library listing of structures from which these selections can be made. Because of some differences in nomenclature between the prior art atlases, the search performed for any particular structure will be according to a complete listing of all possible spellings or names of a given structure (taken directly from all of the libraries used) . Whenever a new mapping system and corresponding library is added, the same structure is used such that the new nomenclature can be immediately accessed and cross-correlated with other atlases or mapping data.

In the preferred embodiment, the method of the present invention requires definition of a coordinate reference system in three-dimensional space, based upon actual brain images acquired in all three views as follows:

- sagittal midline image, perpendicular to frontal and horizontal views — frontal image passing through the anterior commissure, perpendicular to sagittal and horizontal views

— horizontal Image along the anterior commisure—posterior commissural line, perpendicular to frontal and sagittal views

These images represent planes of a three-dimensional cartesian coordinate reference system arranged about the third ventricular core of the brain such that data from the reference coordinate environment can be readily cross— correlated or transformed to or from other reference environments.

Alignment is achieved by acquiring orthogonal images along the various reference planes of the coordinate system and performing the necessary tacking procedures 100 (Fig. 12). When tacking is initiated 102, the type of tacking needed is determined 104 based upon the mapping system in use. Starting with the first tacking point needed 106, tack points are requested 108 one by one 112 until no more tack points are needed 110. With all points tacked, the appropriate alignment is performed 114 and the procedure terminated 116.

The three—dimensional alignment is as follows for a Talairach-Tournoux alignment:

Sagittal (Fig. 6) : On a sagittal midline image the following points must be tacked:

ANTERIOR COMMISSURE 10 - POSTERIOR COMMISSURE 12

HIGHEST SURFACE OF PARIETAL CORTEX 14 MOST POSTERIOR SURFACE OF OCCIPITAL CORTEX 16 MOST ANTERIOR SURFACE OF FRONTAL CORTEX 18 LOWEST SURFACE OF TEMPORAL CORTEX 20

Frontal (Fig. 6): On a frontal image which passes through the anterior commissure the following points must be tacked:

ANTERIOR COMMISSURE 22

HIGHEST SURFACE OF PARIETAL CORTEX 24 LOWEST SURFACE OF TEMPORAL CORTEX 26 MOST LATERAL SURFACE (LEFT) 28 MOST LATERAL SURFACE (RIGHT) 30

Horizontal (Fig. 6): On a horizontal image through the inter- commissural plane the following points must be tacked:

.ANTERIOR COMMISSURE 32 POSTERIOR COMMISSURE 34

MOST .ANTERIOR SURFACE OF FRONTAL CORTEX 36 - MOST POSTERIOR SURFACE OF OCCIPITAL CORTEX 38 MOST LATERAL SURFACE (LEFT) 40 MOST LATERAL SURFACE (RIGHT) 42

Once tacking is completed, the method of the invention can determine the three-dimensional proportional voxols (and their associated Talairach-Tournoux grid coordinate system as well as the relationship of this coordinate system to any stereotactic frame or radiological reference system which may be in use) (Fig. 16) 500 and the anatomical brain coordinates according to the Talairach-Tournoux method. The normalization process preferably occurs as follows: Once all of the tack points are entered 100 (Fig. 12), a procedure is invoked 502 whereby the three-dimensional orientation of the normalized system is determined from the AC-PC plane (and the perpendiculars of this plane) 504. With this orientation known, the voxol size is determined 510 for each different area of the Talairach-Tournoux system (starting with the first area 506 and iterating 512 until the areas are exhausted 508 and 514) as follows:

'A'-'D' : area anterior of the vertical anterior commissure (VAC)

'E₁','E₂'_I 'E₃' : area between the vertical anterior commissure (VAC) and the vertical posterior commissure (VPC)

'F'-'I': area posterior of the vertical posterior commissure (VPC)

1-8: area superior to the anterior commissure-posterior commissural plane (AC-PC) 9—12: area Inferior to the anterior commissure-posterior commissural plane (AC—PC)

'a'-'d': area to the left and right of the anterior commissure- posterior commissural line (AC—PC)

The voxol size is determined 510 by taking the limits of each area and dividing by the appropriate number of voxols. All such determinations are based on the three-dimensional orientation of the anterior commissure— osterior commissural line and/or plane (AC-PC) .

B. Brainstem anatomical and electrophysiological mapping systems For the use of brainstem anatomical and electrophysiological brain maps, a complete two-dimensional alignment or three—dimensional alignment must also be performed for display. The images should be along the same planes as used for the above noted Talairach-Tournoux alignments. Depending on the digitized maps used (see atlases referenced in parentheses below) , the following structures must be tacked in the following planes:

Sagittal (Fig. 7):

Upper brainstem (Schaltenbrand & Bailey and Van Buren & Borke) :

ANTERIOR COMMISSURE 44 POSTERIOR COMMISSURE 46 THALAMIC HEIGHT 48

Upper & lower brainstem (Schaltenbrand & Wahren) : - ANTERIOR COMMISSURE 44

POSTERIOR COMMISSURE 46

THALAMIC HEIGHT 48

FOURTH VENTRICLE CAUDAL FLOOR 56

FOURTH VENTRICLE ROSTRAL FLOOR 58 - ANTERIOR PONS WALL 60

Frontal (Fig. 8) :

(Schaltenbrand & Bailey and Van Buren and Borke) :

INTERCOMMISSURAL PLANE 62 THALAMIC HEIGHT 64

THIRD VENTRICLE WIDTH/LATERAL VENTRICLE MARGIN 66

THALAMIC WIDTH/LATERAL THALAMIC BORDER 68

Horizontal (Fig. 9): Upper brainstem (Schaltenbrand & Bailey and Van Buren &

Borke) :

ANTERIOR COMMISSURE 70 POSTERIOR COMMISSURE 72

THIRD VENTRICLE WIDTH/LATERAL VENTRICLE MARGIN 74 - THALAMIC WIDTH/LATERAL THALAMIC BORDER 76

Lower brainstem (Fig. 10) (Schaltenbrand & Wahren) : ANTERIOR BRAINSTEM MARGIN 78 POSTERIOR BRAINSTEM MARGIN 80 BRAINSTEM WIDTH/LATERAL BRAINSTEM MARGINS 82

Once tacking is completed, the method of the invention can scale all structures based on their relationship to the anatomical landmarks which have been tacked on an alignment procedure and other map data from other authors can be proportioned, scaled or referenced in a like manner for cross-correlation.

These map alignments give normalized brain coordinate information necessary for the cross-correlation of different mapping systems. This permits accurate combinations (multiple overlays) of different mapping data superimposed upon actual brain scans. The present invention thus is useful for simultaneously displaying a plurality of different sets of mapping data upon a brain scan image (Figs. 3 and 4). Other mapping systems can be cross- correlated with maps in the present invention, for example but not limited to:

1. Psycho-physiological anatomical topography (see G. Schaltenbrand & A.E. Walker, eds. , Stereotaxy of the Human Brain : Anatomical , Physiological and Clinical Applications , p. 572 (2d rev. ed. , New York, Thieme, 1982);

2. Thalamocortical projection areas (according to Talairach & Tournoux) ; 3. Brain vascular territorial distribution (according to Salamon and Huang) ; and

4. Commonly used stereotactic therapeutic lesion sites (according to Schaltenbrand & Walker at pp. 5-7).

In each case a library is created such that mapping data is localized to specific regions of the brain which are readily Identifiable according to Brodmann's numerical topography of the brain (see K. Brodmann, Vergleichende Lokalisationslehre der Grosshirnrinde [Barth, Leipzig, 1909]) or recognized named anatomical structures (for example, internationally recognized brain nomenclature of the three prior art mapping systems discussed In depth herein) . Such brain topography is also resident in the libraries of the present invention's embodiment and data gathered from anatomico-physiological mapping or interrogation of the brain can be archived and cross—correlated in its normalized brain mapping and imaging environment. For example, data from EMEG, EEG, pre-operative and post-operative localization recordings and many other such similar mapping data can be added to the system for archiving and cross referencing (see Figs. 3, 4, 5, and 21).

Fig. 11 illustrates the preferred method of the invention at the highest level of abstraction. Images are scanned, acquired, converted to an appropriate storage format, stored, retrieved and multiply displayed, compared and manipulated, and sized or proportioned for mapping.

The preferred embodiment of the method and apparatus of the present Invention is thus useful to display any combination of normalized brain mapping data together with scans of particular patients' brains. Neurosurgeons or other such health practitioners no longer have to approximate locations of structural and functional areas of the brain, or employ textual reference works, while planning for or executing brain operations. By employing the present invention, such health practitioners may simulate, for example, the insertion of a probe and check which structures and functional areas will be affected by the probe's proposed trajectory. If an unexpected response occurs during an operation, the practitioner has quick access to needed information concerning the response using mapping data superimposed upon scans of the affected areas of the actual patient's brain.

Although the invention has been described with reference to these preferred embodiments, other embodiments can achieve the same results. Variations and modifications of the present invention will be obvious to those skilled in the art and it is intended to cover in the appended claims all such modifications and equivalents.

Claims

CLAIMS hat is claimed is:

1. An apparatus for providing brain map data to a user comprising: means for digitally archiving brain map data; means for displaying on a display device one or more brain maps; and means for manipulating said brain maps on said display device.

2. The apparatus of claim 1 wherein said manipulating means comprises means for varying the size of said brain maps on said display device.

3. The apparatus of claim 1 wherein said manipulating means comprises means for varying the shape of said brain maps on said display device.

4. The apparatus of claim 1 wherein said manipulating means comprises means for varying the location of said brain maps on said display device.

5. The apparatus of claim 1 further comprising means for displaying images of an individual patient's brain on said display device.

6. The apparatus of claim 5 wherein said brain maps are combined with said displayed Images of the individual patient's brain to create a composite image on said display device.

7. The apparatus of claim 6 wherein said composite image comprises a two-dimensional overlayed composite image.

8. The apparatus of claim 6 wherein said composite image comprises a three—dimensional transparency composite Image.

9. The apparatus of claim 6 wherein said composite image comprises a three-dimensional image comprising three images of the patient's brain, one in the sagittal plane, one in the horizontal plane, and one in the verticofrontal plane.

10. The apparatus of claim 5 wherein said brain maps are manipulatable to correspond in location, size, and shape to said images of the individual patient's brain on said display device.

11. The apparatus of claim 1 wherein said brain map data comprise at least one member selected from the group consisting of Talairach-Tournoux anatomical data, Schaltenbrand and Bailey anatomical maps, Van Buren and Borke anatomical maps, Schaltenbrand and Wahren anatomical maps, electrophysiological response data, electromagnetic encephalography (EMEG) data, somatosensory evoked potentials data, electroencephalagram (EEG) data, metabolic brain scanning data, and blood vessel territorial supply data.

12. The apparatus of claim 1 wherein said brain maps are independently manipulatable to correspond in size, shape, and location to one another on said display device.

13. The apparatus of claim 12 wherein said brain maps are combined with one another to create a composite image on said display device.

14. The apparatus of claim 13 wherein said composite image comprises a two-dimensional overlayed composite image.

15. The apparatus of claim 13 wherein said composite image comprises a three-dimensional transparency composite image.

16. The apparatus of claim 1 wherein said manipulating means comprises means for manipulating said brain maps with reference to specified landmarks.

17. The apparatus of claim 16 wherein said landmarks comprise anatomical structures and reference points on a stereotactic frame.

18. The apparatus of claim 17 wherein said anatomical structures comprise at least one member selected from the group consisting of anterior commissure, posterior commissure, highest surface of parietal cortex, most posterior surface of occipital cortex, most anterior surface of frontal cortex, lowest surface of temporal cortex, left—most lateral surface, right-most lateral surface, thalamic height, fourth ventricle caudal floor fourth ventricle rostral floor, anterior pons wall, intercommissural plane, third ventricle width, lateral ventricle margin, thalamic width, lateral thalamic border, anterior brainstem margin, posterior brainstem margin, brainstem width, lateral brainstem margin.

19. The apparatus of claim 17 wherein said manipulating means comprise means for tacking said anatomical structures on said display device.

20. The apparatus of claim 1 further comprising means for displaying and manipulating one or more simulated brain structures on said display device.

21. The apparatus of claim 20 wherein said simulated brain structures are combined with said brain maps to create a composite image on said display device.

22. The apparatus of claim 21 wherein said composite image comprises a two—dimensional overlayed composite image.

23. The apparatus of claim 21 wherein said composite image comprises a three-dimensional transparency composite image.

24. The apparatus of claim 20 wherein said simulated brain structures are manipulatable to correspond in location, size, and shape to said brain maps on said display device.

25. The apparatus of claim 1 further comprising means for selecting a structure within one of said brain maps on said display device.

26. The apparatus of claim 25 further comprising means for displaying textual information concerning said structure on said display device.

27. The apparatus of claim 26 wherein said textual information comprises at least one member selected from the group consisting of nomenclature for said structure, nomenclature for substructures of said structure, nomenclature for structures containing said structure, medical information concerning said structure, and warnings and advice concerning said structure.

28. The apparatus of claim 25 wherein said means for manipulating said brain maps comprises means for enlarging said selected structure on said display device, showing greater detail of said selected structure.

29. A method for providing brain map data to a user comprising the steps of: a) digitally archiving brain map data; b) displaying on a display device one or more brain maps; and c) manipulating the brain maps on the display device.

30. The method of claim 29 wherein manipulating the brain maps on the display device comprises varying the size of the brain maps on the display device.

31. The method of claim 29 wherein manipulating the brain maps on the display device comprises varying the shape of the brain maps on the display device.

32. The method of claim 29 wherein manipulating the brain maps on the display device comprises varying the location of the brain maps on the display device.

33. The method of claim 29 further comprising displaying images of an individual patient's brain on the display device.

34. The method of claim 33 further comprising combining the brain maps with the displayed images of the individual patient's brain to create a composite Image on the display device.

35. The method of claim 34 wherein combining the brain maps with the displayed images comprises creating a two-dimensional overlayed composite image.

36. The method of claim 34 wherein combining the brain maps with the displayed images comprises creating a three-dimensional transparency composite image.

37. The method of claim 34 wherein combining the brain maps with the displayed images comprises creating a three—dimensional image comprising three images of the patient's brain, one in the sagittal plane, one In the horizontal plane, and one in the verticofrontal plane.

38. The method of claim 33 wherein displaying images of an individual patient's brain on the display device comprises manipulating the brain maps to correspond In location, size, and shape to the images of the individual patient's brain on the display device.

39. The method of claim 29 wherein digitally archiving brain map data comprises digitally archiving at least one member selected from the group consisting of Talairach-Tournoux anatomical data, Schaltenbrand and Bailey anatomical maps, Van Buren and Borke anatomical maps, Schaltenbrand and Wahren anatomical maps, electrophysiological response data, electromagnetic encephalography (EMEG) data, somatosensory evoked potentials data, electroencephalagram (EEG) data, metabolic brain scanning data, and blood vessel territorial supply data.

40. The method of claim 29 wherein manipulating the brain maps on the display device comprises independently manipulating the brain maps to correspond in size, shape, and location to one another on the display device.

41. The method of claim 40 wherein independently manipulating the brain maps comprises combining the brain maps with one another to create a composite image on the display device.

42. The method of claim 41 wherein combining the brain maps with one another comprises creating a two—dimensional overlayed composite image.

43. The method of claim 41 wherein combining the brain maps with one another comprises creating a three-dimensional transparency composite image.

44. The method of claim 29 wherein manipulating the brain maps on the display device comprises manipulating the brain maps with reference to specified landmarks.

45. The method of claim 44 wherein manipulating the brain maps with reference to specified landmarks comprises manipulating the brain maps with reference to anatomical structures and reference points on a stereotactic frame.

46. The method of claim 45 wherein manipulating the brain maps with reference to anatomical structures and reference points on a stereotactic frame comprises manipulating the brain maps with reference to at least one member selected from the group consisting of anterior commissure, posterior commissure, highest surface of parietal cortex, most posterior surface of occipital cortex, most anterior surface of frontal cortex, lowest surface of temporal cortex, left-most lateral surface, right-most lateral surface, thalamic height, fourth ventricle caudal floor fourth ventricle rostral floor, anterior pons wall, intercommissural plane, third ventricle width, lateral ventricle margin, thalamic width, lateral thalamic border, anterior brainstem margin, posterior brainstem margin, brainstem width, lateral brainstem margin.

47. The method of claim 45 wherein manipulating the brain maps with reference to anatomical structures and reference points on a stereotactic frame comprises tacking the anatomical structures on the display device.

48. The method of claim 29 further comprising displaying and manipulating one or more simulated brain structures on the display device.

49. The method of claim 48 wherein displaying and manipulating one or more simulated brain structures comprises combining the simulated brain structures with the brain maps to create a composite image on the display device.

50. The method of claim 49 wherein combining the simulated brain structures with the brain maps comprises creating a two-dimensional overlayed composite Image.

51. The method of claim 49 wherein combining the simulated brain structures with the brain maps comprises creating a three-dimensional transparency composite Image.

52. The method of claim 48 wherein displaying and manipulating one or more simulated brain structures comprises manipulating the simulated brain structures to correspond in location, size, and shape to the brain maps on the display device.

53. The method of claim 29 further comprising selecting a structure within one of the brain maps on the display device.

54. The method of claim 53 further comprising displaying textual Information concerning the structure on the display device.

55. The method of claim 54 wherein displaying textual Information concerning the structure comprises displaying at least one member selected from the group consisting of nomenclature for the structure, nomenclature for substructures of the structure, nomenclature for structures containing the structure, medical information concerning the structure, and warnings and advice concerning the structure.

56. The method of claim 53 further comprising enlarging the selected structure on the display device, showing greater detail of the selected structure.