CN111210898A - Method and device for processing DICOM data - Google Patents
Method and device for processing DICOM data Download PDFInfo
- Publication number
- CN111210898A CN111210898A CN201911398553.6A CN201911398553A CN111210898A CN 111210898 A CN111210898 A CN 111210898A CN 201911398553 A CN201911398553 A CN 201911398553A CN 111210898 A CN111210898 A CN 111210898A
- Authority
- CN
- China
- Prior art keywords
- image
- dicom
- window
- description information
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000012545 processing Methods 0.000 title claims abstract description 26
- 230000009466 transformation Effects 0.000 claims abstract description 41
- 239000011159 matrix material Substances 0.000 claims description 42
- 230000036961 partial effect Effects 0.000 claims description 15
- 238000013519 translation Methods 0.000 claims description 12
- 230000011218 segmentation Effects 0.000 claims description 7
- 230000000007 visual effect Effects 0.000 claims description 7
- 238000009877 rendering Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 abstract description 8
- 238000003745 diagnosis Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 16
- 238000003860 storage Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 238000013507 mapping Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000007639 printing Methods 0.000 description 4
- 230000002829 reductive effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 240000004282 Grewia occidentalis Species 0.000 description 1
- CYTYCFOTNPOANT-UHFFFAOYSA-N Perchloroethylene Chemical compound ClC(Cl)=C(Cl)Cl CYTYCFOTNPOANT-UHFFFAOYSA-N 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Radiology & Medical Imaging (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the disclosure relates to a method and a device for processing DICOM data, wherein the method comprises the following steps: acquiring DICOM data displayed by a current window and a basic view angle of the window, wherein the DICOM data comprises DICOM images and description information; segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information; performing multi-plane reconstruction on the DICOM image according to a basic view angle and a preset transformation relation to obtain a two-dimensional image; carrying out zoom adjustment on the local image according to a preset zoom ratio to obtain an adjusted local image; and drawing and displaying the two-dimensional image and the adjusted local image in the virtual window according to the relative position, and outputting the image displayed in the virtual window. The method and the device can avoid local deformation caused by forcibly zooming the image according to the size of the window, and solve the problem of influence on analysis and diagnosis of doctors due to image deformation.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to a method and an apparatus for processing DICOM data.
Background
In the field of medical Imaging, the Digital Imaging and communications in Medicine (DICOM) format standard created by the american electrical manufacturing association (NEMA) is a file standard format widely used for medical image processing, storage, transmission, and printing. The standard format may be used to facilitate viewing of medical information, medical images, medical data transmissions, and the like. The DICOM image is an image obtained by examination of a patient, and can reflect a disease condition of the patient at the time of examination.
Each time a patient takes an exam signature (0020, 000D), DICOM images are obtained, sometimes even DICOM images of more than one sequence signature (0020, 000E), and of multiple sequences and even different exam modality signatures (0008, 0060). Sometimes the patient also needs to have the same type of examination at different times and obtain multiple different DICOM images for the physician to view and compare.
When a doctor views a DICOM image of a patient and diagnoses the DICOM image, a local part of the DICOM image needs to be enlarged, or sometimes a screenshot method needs to be adopted for saving a screen image of a fusion displayed image for later use. The image is stored by adopting the screenshot method, so that the display effect of the original DICOM image is influenced, the information displayed around the window influences the image reading due to the fact that the information cannot be adjusted, and after the screenshot is stored, the condition of stretching deformation sometimes exists in the process of printing and outputting, and the analysis and diagnosis result of a doctor is influenced.
Based on the above, in the prior art, the problem that the image saved by directly screenshot influences the analysis and diagnosis of the doctor exists.
The above drawbacks are expected to be overcome by those skilled in the art.
Disclosure of Invention
Technical problem to be solved
In order to solve the above problems in the prior art, the present disclosure provides a method and an apparatus for processing DICOM data, so as to overcome, at least to some extent, the problem that images saved in the existing direct screenshot affect analysis and diagnosis of a doctor.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or may be learned by practice of the disclosure.
(II) technical scheme
In order to achieve the above purpose, the present disclosure adopts a main technical solution including:
an embodiment of the present disclosure provides a method for processing DICOM data, including:
acquiring DICOM data displayed by a current window and a basic view angle of the window, wherein the DICOM data comprises DICOM images and description information;
segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information;
performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation to obtain a two-dimensional image;
carrying out zoom adjustment on the local image according to a preset zoom ratio to obtain an adjusted local image;
and drawing and displaying the two-dimensional image and the adjusted local image in a virtual window according to the relative position, and outputting the image displayed in the virtual window.
In an embodiment of the present disclosure, after obtaining the DICOM data displayed in the current window, the method further includes:
and acquiring a volume data set formed by pixel points in all DICOM images, wherein the volume data set comprises space coordinates from the first DICOM image to the center position of the first pixel at the upper left corner, the volume data size and the volume data number.
In an embodiment of the present disclosure, segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information includes:
segmenting the description information in the DICOM data according to the relative position of the DICOM image;
and using the description information block on the segmented relative direction as a local image.
In an embodiment of the present disclosure, after obtaining at least one local image corresponding to the description information, the method further includes:
when the description information picture block comprises a line of characters, taking the pixel height of the characters as the height of the local image, and taking the pixel length of the characters as the width of the local image;
when the description information image block comprises a plurality of lines of characters, the pixel height of the characters is taken as the height of the local image, and the maximum value of the pixel length of the plurality of lines of characters is taken as the width of the local image.
In an embodiment of the present disclosure, the multi-plane reconstruction includes at least one of scaling, translation, rotation, and window width and window level adjustment.
In an embodiment of the present disclosure, the preset transformation relationship includes:
according to the three-dimensional space transformation rule, determining a formula of a Matrix of Matrix transformation relation as follows:
a Matrix transformation relation Matrix is a translation Matrix and a scaling Matrix and a rotation Matrix;
and according to the Matrix transformation relation Matrix, taking a transformation relation Matrix of the relative coordinates of the basic visual angle and the DICOM image.
In an embodiment of the present disclosure, the method further includes:
and after the DICOM image is subjected to window width and window level adjustment, if the color information of the DICOM image changes, acquiring the adjusted window width and window level value.
In an embodiment of the disclosure, performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation, to obtain a two-dimensional image includes:
creating a virtual window, wherein the size of the virtual window is the same as that of an image to be output;
adding the volume data set to the virtual window as display data;
setting a corresponding camera view angle for the display data according to the basic view angle and the preset transformation relation;
and drawing window textures on the virtual window according to the camera shooting visual angle and the display data to obtain the two-dimensional image.
In an embodiment of the present disclosure, the drawing and displaying the two-dimensional image and the adjusted local image in the virtual window according to the relative position includes:
replacing the adjusted local image and the two-dimensional image according to the relative position of the description information and the DICOM image, and drawing on pixel points at the relative position by using the adjusted local image;
rendering and displaying the image of the virtual window after being drawn.
Another embodiment of the present disclosure also provides an apparatus for processing DICOM data, including:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring DICOM data displayed by a current window and a basic view angle of the window, and the DICOM data comprises DICOM images and description information;
the segmentation module is used for segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information;
the reconstruction module is used for performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation to obtain a two-dimensional image;
the zooming module is used for zooming and adjusting the local image according to a preset zooming proportion to obtain an adjusted local image;
and the drawing module is used for drawing and displaying the two-dimensional image and the adjusted local image in a virtual window according to the relative position and outputting the image displayed by the virtual window.
(III) advantageous effects
The beneficial effects of this disclosure are: on one hand, when the DICOM image is browsed, the local image corresponding to the description information and the DICOM image are divided and then independently zoomed, and then fused with the original DICOM image, so that the details of the original data can be reserved, local deformation caused by forcibly zooming the image according to the size of a window is avoided, and the problem that analysis and diagnosis of a doctor are influenced due to image deformation is solved; on the other hand, the two-dimensional image is combined with the adjusted image to be drawn and displayed in the virtual window, so that the description information can be zoomed according to the setting during display, the displayed information is reduced, the shielding of the image information is reduced, and the output image is optimized.
Drawings
Fig. 1 is a flowchart of a method for processing DICOM data according to an embodiment of the present disclosure;
FIG. 2 is a diagram illustrating an image displayed on a window according to an embodiment of the present invention;
FIG. 3 is a flowchart of step S150 according to an embodiment of the present invention;
fig. 4 is a detailed flow chart of DICOM data processing according to the image shown in fig. 2;
FIG. 5 is a schematic diagram of display data obtained in an embodiment of the present invention;
FIG. 6 is a diagram illustrating description information in accordance with an embodiment of the present invention;
FIG. 7 is a partial image corresponding to the description information block 2 in FIG. 6 according to an embodiment of the present invention;
FIG. 8 is a partial image corresponding to the description information block 7 in FIG. 6 according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of an image generated after a local image is fused with the image of FIG. 6 according to an embodiment of the present invention;
fig. 10 is a schematic diagram of an apparatus for processing DICOM data according to another embodiment of the present disclosure;
fig. 11 is a schematic structural diagram illustrating a computer system of an electronic device according to an embodiment of the present disclosure.
Detailed Description
For the purpose of better explaining the present disclosure, and to facilitate understanding thereof, the present disclosure will be described in detail below by way of specific embodiments with reference to the accompanying drawings.
All technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terminology used herein in the description of the disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
Based on the prior art, in the DICOM browsing process, when the currently browsed DCIOM image is to be saved and output, only the current screenshot of the window can be saved, and the description information displayed in the image window cannot be modified in content and relative size, but when the image is output in a printing function or in a report form, the size of the description information usually needs to be changed, even if an interpolation algorithm is used for processing, local deformation of the image inevitably occurs, and the analysis and diagnosis result of a doctor is influenced. Therefore, the present invention provides a method and a device for processing DICOM data, which are described in detail as follows:
fig. 1 is a flowchart of a method for processing DICOM data according to an embodiment of the present disclosure, as shown in fig. 1, specifically including the following steps:
as shown in fig. 1, in step S110, DICOM data displayed in a current window and a base view angle of the window are acquired, where the DICOM data includes a DICOM image and description information;
as shown in fig. 1, in step S120, the description information in the DICOM data is segmented to obtain at least one local image corresponding to the description information;
as shown in fig. 1, in step S130, performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relationship to obtain a two-dimensional image;
as shown in fig. 1, in step S140, performing scaling adjustment on the local image according to a preset scaling ratio to obtain an adjusted local image;
as shown in fig. 1, in step S150, the two-dimensional image and the adjusted local image are rendered and displayed in a virtual window according to relative positions, and an image displayed in the virtual window is output.
The specific implementation of the steps of the embodiment of fig. 1 is described in detail below:
in step S110, the DICOM data displayed in the current window and the base view angle of the window are acquired.
In an embodiment of the disclosure, the DICOM data includes a DICOM image and description information, where the description information is mainly used for storing information related to a medical image. After loading the DICOM data in this step, the method further includes: and acquiring a volume data set formed by pixel points in all DICOM images, wherein the volume data set comprises space coordinates from the first DICOM image to the center position of the first pixel at the upper left corner, the volume data size and the volume data number.
For example, the browsing software loads the local DICOM data by selecting a folder. The DICOM data are loaded, the DICOM images are analyzed in the loading process, and three-dimensional space information of the DICOM image volume data set is stored. Because the volume data is usually obtained by scanning with an instrument such as a CT and the like and then stored in pixel points of a picture, the volume data is composed of voxels, the voxels are basic volume elements, and the three-dimensional space information of the volume data set is the arrangement information and color information of the voxels in the three-dimensional space. Fig. 2 is a schematic diagram of an image displayed in the window in step S110 according to an embodiment of the present invention.
In addition, since the DICOM image is displayed in the window, the current view angle of the window is used as the basic view angle, and the subsequent view angle transformation is changed by using the current basic view angle as the original angle.
In step S120, the description information in the DICOM data is segmented to obtain at least one local image corresponding to the description information.
In an embodiment of the present disclosure, the description information needs to be segmented from the DICOM image in this step, where the relative position of the description information and the DICOM image may be: the left upper part, the upper right part, the right upper part, the right lower part, the lower left part and the left part are 8 different directions. When in segmentation, segmentation can be carried out on the basis of the image, namely, the description information in the DICOM data is segmented according to the relative position with the DICOM image; then, the description information block in the divided relative orientation is used as a local image.
In an embodiment of the present disclosure, after the dividing, it is further required to determine how to define the size of each description information tile, so that after obtaining at least one local image corresponding to the description information, the method further includes: calculating the width and height occupied by the description information of 8 directions positioned at the periphery and four corners of the DICOM image window, wherein the width and the height are all in pixel unit.
Because description information is divided into a plurality of cases, some cases are one line of characters, and some cases are multiple lines of characters, when the description information image block comprises one line of characters, the pixel height of the characters is taken as the height of a local image, and the pixel length of the characters is taken as the width of the local image; when the description information image block comprises a plurality of lines of characters, the pixel height of the characters is taken as the height of the local image, and the maximum value of the pixel length of the plurality of lines of characters is taken as the width of the local image.
Based on the above, the tile is used as the width and height of the partial image according to the determined width and height as the segmentation description information, and the pixel values of the width and height are used as the original scaling.
In step S130, performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation, so as to obtain a two-dimensional image.
In an embodiment of the present disclosure, the multi-plane reconstruction performed in this step includes at least one of scaling, translation, rotation, and window width and level adjustment.
In an embodiment of the present disclosure, the preset transformation relationship includes:
according to the three-dimensional space transformation rule, determining a formula of a Matrix of Matrix transformation relation as follows:
a Matrix transformation relation Matrix is a translation Matrix and a scaling Matrix and a rotation Matrix;
and according to the Matrix transformation relation Matrix, taking a transformation relation Matrix of the relative coordinates of the basic visual angle and the DICOM image.
In an embodiment of the present disclosure, the method further includes:
and after the DICOM image is subjected to window width and window level adjustment, if the color information of the DICOM image changes, acquiring the adjusted window width and window level value.
Because the window width refers to the CT value range displayed by the CT image, the width of the window width directly influences the definition and the contrast of the image, and the narrower the window width is, the smaller the displayed CT value range is, the stronger the contrast is, and the method is suitable for observing the tissue structure with closer density; conversely, the wider the window width, the larger the displayed CT value range, and the poorer the contrast, the more suitable for observing tissue structures with larger density differences. The window level (window center) refers to an average value or a center value within a window width range, so if the window width and the window level are adjusted once, the color of the DICOM image must also change accordingly, and therefore, the adjusted window width and the window level need to be recorded in this step, so as to record the color.
In step S140, the local image is scaled according to a preset scaling ratio, so as to obtain an adjusted local image.
In an embodiment of the present disclosure, since in the prior art, when the currently browsed DCIOM image is to be saved and output during DICOM browsing, only the current screenshot of the window can be saved, and the saved image can be used for a printing function or output in a report form. However, the image saved in this way is in a what-you-see-what-you-get form, the size of the image is determined according to the size of the window, the size of the displayed image cannot be modified, if the image size is forcibly zoomed, the image needs to be processed by using an interpolation algorithm, so that local deformation of the image is inevitably generated, and the analysis and diagnosis result of a doctor is influenced. Based on the above problem, the local image and the DICOM image are segmented based on the above steps, and the size of the segmented local image can be adjusted according to a preset scaling ratio, so that the adjusted local image (for example, information such as orientation information and patient name) can not be scaled in proportion to the DICOM image, thereby reducing the occlusion of the local image on the image and reducing the visible range of non-important information.
Further, since the segmented local images in this embodiment usually represent different types of description information, when the preset scaling is set, the scaling with the same or different size may be set for different local images according to requirements.
In step S150, the two-dimensional image and the adjusted local image are rendered and displayed in a virtual window according to the relative position, and an image displayed in the virtual window is output.
Fig. 3 is a flowchart of step S150 in an embodiment of the present invention, which specifically includes the following steps:
in step S301, a virtual window is created, wherein the size of the virtual window is the same as the size of the image to be output.
In step S302, the volume data set is added to the virtual window as display data.
In step S303, a corresponding camera angle is set for the display data according to the basic angle and the preset transformation relationship.
In step S304, a window texture is drawn in the virtual window according to the camera angle in combination with the display data, so as to obtain the two-dimensional image.
Based on the steps, a projection relation is established according to a three-dimensional space projection principle in computer graphics, and a reconstruction method of multi-planar reconstruction (MPR for short) is used. The MPR can superpose all axial images in a scanning range, and then carry out coronal, sagittal and any-angle oblique image reconstruction on tissues appointed by reconstruction lines marked by certain marked lines, can randomly generate new tomographic images without repeated scanning, and can expand and display the growth of a curved object in one image if curved surface reconstruction is adopted. When the size of the output image needs to be Width pixels and Height pixels, the position information, the view angle information, the scaling relation and the like of the image are utilized to calculate all pixel values of Width multiplied by Height pixels in the DICOM image actually corresponding to the output image, color mapping information is set for the pixel values, and the processed pixel set can form a two-dimensional image
In an embodiment of the present disclosure, the drawing and displaying the two-dimensional image and the adjusted local image in the virtual window according to the relative position includes:
replacing the adjusted local image and the two-dimensional image according to the relative position of the description information and the DICOM image, and drawing on pixel points at the relative position by using the adjusted local image;
rendering and displaying the image of the virtual window after being drawn.
Based on the above, taking the image shown in fig. 2 as an example, fig. 4 is a specific flowchart for processing DICOM data by combining the image shown in fig. 2, and includes the following steps:
step S1, the browsing software loads DICOM data.
And step S2, acquiring DICOM data three-dimensional information.
And step S3, displaying the DICOM data and acquiring a basic visual angle.
Next, the window image is transformed, mainly by dividing the DICOM image and the description information, and then processed separately.
Step S4, an image conversion operation is performed.
The operations of zooming, translation, rotation, window width and window level adjustment and the like can be carried out on the image in the window. After the above operations are performed, the content of the data displayed in the window is changed, and operations such as zooming, translating, rotating and the like are performed on the image, so that the view angle of the window is changed, that is, the operations change the relative position of the image and the viewpoint for viewing the image. And recording a relative coordinate transformation relation Matrix of the changed viewpoint and the image.
In this step, taking the translation operation as an example: setting the coordinate of a pixel A in a three-dimensional space as (X, Y, Z), performing translation on the pixel point, translating the pixel point by a units in the X direction, translating the pixel point by b units in the Y direction, translating the pixel point by c units in the Z direction, and setting the new coordinate of the pixel A after the translation as (X, Y, Z)1,Y1,Z1):
According to the three-dimensional space transformation rule, multiplying all the transformations by steps to obtain a total transformation matrix: a Matrix transformation relation Matrix is a translation Matrix and a scaling Matrix and a rotation Matrix; the Matrix transformation Matrix is a relative coordinate transformation relation Matrix of the viewpoint and the image, wherein one or more of translation, scaling and rotation can be selected.
And step S5, acquiring the size of the description information picture block.
And step S6, setting DICOM image output parameters.
In this step, based on the data saving operations in steps S4 and S5, the saving output parameters, such as the name of the generated DICOM image, the length of the DICOM image, the wide pixel value, the scaling percentage value of the image description information, the DICOM image saving path, and other related information, can be set through the operation interface of the software.
Next, the DICOM image (steps S7 and S8) and the description information are still processed separately (steps S9 and S10), as follows:
step S7, create a virtual window and set the window size.
In which a virtual window is set according to the parameters set at S6.
And step S8, setting display data.
And setting a volume data set formed by pixel points of the DICOM image into a window as display data, and recording a coordinate transformation matrix of the current window and position information of the current image.
And creating a virtual OpenGL window, setting the window size to be consistent with the size of the stored image, setting a volume data set formed by pixel points of the DICOM image into the window as display data, and setting the view angle of the camera by using the recorded viewpoint and the transformation matrix of the image.
Fig. 5 is a schematic diagram of display data obtained in an embodiment of the present invention.
Step S9 is to hide the image so that only the image description information is displayed on the image display window.
Fig. 6 is a schematic diagram of description information according to an embodiment of the present invention, where a pixel value of display data is temporarily set to 0, at this time, all of the DIOCM image display contents in the window are empty, the window completely displays a background, and the current window image is captured, that is, the information description image. The 8 positions of the descriptive information tile are shown in fig. 6.
And step S10, intercepting the partial image according to the size of the description information block.
In the step, the length and height occupied by the image window periphery and the four-corner description information image block are calculated, and the size of a rectangular bounding box of a character description block is obtained by taking a pixel as a unit, namely W x H. The width and the height of the character description information block are calculated and recorded, and the recorded value is used as the original zooming value.
And intercepting a local image at a corresponding position and a corresponding size on the information description image according to the width and the height of the recorded text description information block. Fig. 7 is a partial image corresponding to the description information block 2 in fig. 6 according to an embodiment of the present invention, and fig. 8 is a partial image corresponding to the description information block 7 in fig. 6 according to an embodiment of the present invention. Scaling the partial image according to the set description information scaling percentage,
and step S11, performing off-line rendering image combination, and replacing the window texture to be drawn of the virtual window with the zoomed partial image.
The window pattern to be drawn according to the OpenGL virtual window shown in fig. 6 is an image with a converted size. The color mapping information (recorded in the form of window width bed) recorded in step S3 is set in the display data, and the pixel value of the corresponding position point is assigned as the pixel value on the partial image in an alternative manner, so as to obtain fig. 9, where fig. 9 is a schematic diagram of an image generated after the partial image is fused with the image in fig. 6 in an embodiment of the present invention. In the pictures of fig. 2, 5, 6, 7, 8, and 9, a black border line is added to distinguish the picture boundaries, but the border line does not exist in the actual image.
And step S12, outputting and storing the finally generated image to be rendered of the virtual OpenGL window as a DICOM image, naming the generated image according to the DICOM image name input in the step S6, and storing the image to be rendered of the virtual OpenGL window under the DICOM storage path set in the step S6. .
Step S13, clear all the resources used and created by the virtual OpenGL window, and close the virtual OpenGL window.
Through the steps, the DICOM data in the browsing window can be output as an image with a specific size by using the original data on the basis of ensuring the data value as much as possible.
Further, the above method may also be applied to multimodal fusion data. When the window display data is multi-modal data, that is, the displayed data is two sets of data to be displayed in a fused manner, only the three-dimensional space information of the two sets of data needs to be stored in step S2, and the color mapping lookup table of the fused data needs to be stored, when the display data is set in step S8, the display data in the virtual window is set according to the sequence of loading the two sets of data by software, after the setting is completed, the color mapping lookup table is set to the second set of data, the rest steps do not need to be changed, and the steps are similar to the steps of the single-modal data method, and are not repeated here.
It should be noted that, in this embodiment, the output image is data to be rendered acquired in the virtual window, and therefore, the output image may also be output in different format types according to needs.
Based on the steps, the method and the mechanism for processing and outputting the DICOM image are established, firstly, a DIOCM image displayed in a current window is obtained: in the image browsing process, if the browsed DICOM image needs to be output and stored, window viewport information where the image to be output and stored is located is obtained, and the spatial position information where the currently displayed image is located is recorded, and is used for setting relevant attributes such as output image size, zooming, color mapping configuration information and the like when the output image is generated. Secondly, acquiring description information of the displayed DICOM image: and hiding the data information of the window to obtain an information image only with image information. And (3) cutting the information image, and cutting the information of each block along the maximum text surrounding frame to form one or more local images. The relative position information of all the partial information and the partial image information are associated and recorded for re-laying out the image description information when generating the output image. Finally, an output image is constructed: the projection relation is established according to the three-dimensional space projection principle in computer graphics, and the reconstruction method is based on multi-planar reconstruction (MPR). When the size of the output image needs to be Width pixels and Height pixels, all pixel values of Width multiplied by Height pixels in the DICOM image actually corresponding to the output image are calculated by utilizing position information, visual angle information, scaling relation and the like of the image, color mapping information is set for the pixel values, and the processed pixel set can form a two-dimensional image. The recorded local image information is zoomed according to the set zoom ratio, then the local image and the generated two-dimensional image are fused with corresponding pixel points according to the position of the local image relative to the original image, so that a new image can be generated, and the image with the corresponding format is generated according to the required output format and is stored in a specified path
In summary, with the method for processing DICOM data provided by the embodiment of the present disclosure, on one hand, when a DICOM image is browsed, the local image corresponding to the description information and the DICOM image are divided and then independently zoomed, and then fused with the original DICOM image, so that details of the original data can be retained, local deformation caused by forcibly zooming the image according to the size of the window is avoided, and the problem of influence on analysis and diagnosis of a doctor due to image deformation is solved; on the other hand, the two-dimensional image is combined with the adjusted image to be drawn and displayed in the virtual window, so that the description information can be zoomed according to the setting during display, the displayed information is reduced, the shielding of the image information is reduced, and the output image is optimized.
Corresponding to the above method, fig. 10 is a schematic diagram of an apparatus for processing DICOM data according to another embodiment of the present disclosure, and as shown in fig. 10, the apparatus 100 includes: an acquisition module 110, a segmentation module 120, a reconstruction module 130, a scaling module 140, and a rendering module 150.
The obtaining module 110 is configured to obtain DICOM data displayed in a current window and a basic view angle of the window, where the DICOM data includes a DICOM image and description information; the segmentation module 120 is configured to segment description information in the DICOM data to obtain at least one local image corresponding to the description information; the reconstruction module 130 is configured to perform multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation, so as to obtain a two-dimensional image; the scaling module 140 is configured to perform scaling adjustment on the local image according to a preset scaling ratio to obtain an adjusted local image; the drawing module 150 is configured to draw and display the two-dimensional image and the adjusted local image in a virtual window according to the relative position, and output an image displayed in the virtual window.
In summary, the technical effects of the apparatus for processing DICOM data provided by the embodiments of the present disclosure refer to the technical effects of the above method, and are not described herein again.
Referring now to FIG. 11, shown is a block diagram of a computer system 1100 suitable for use in implementing an electronic device of an embodiment of the present invention. The computer system 1100 of the electronic device shown in fig. 11 is only an example, and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.
As shown in fig. 11, the computer system 1100 includes a Central Processing Unit (CPU)1101, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1102 or a program loaded from a storage section 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data necessary for system operation are also stored. The CPU 1101, ROM 1102, and RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.
The following components are connected to the I/O interface 1105: an input portion 1106 including a keyboard, mouse, and the like; an output portion 1107 including a signal output unit such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 1108 including a hard disk and the like; and a communication section 1109 including a network interface card such as a LAN card, a modem, or the like. The communication section 1109 performs communication processing via a network such as the internet. A driver 1110 is also connected to the I/O interface 1105 as necessary. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1110 as necessary, so that a computer program read out therefrom is mounted into the storage section 1108 as necessary.
In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the invention include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 1109 and/or installed from the removable medium 1111. The above-described functions defined in the system of the present application are executed when the computer program is executed by a Central Processing Unit (CPU) 1101.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present invention may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is enabled to implement the online platform data transmission method in the embodiment.
For example, the electronic device may implement the following as shown in fig. 1: step S110, DICOM data displayed by a current window and a basic view angle of the window are obtained, wherein the DICOM data comprise DICOM images and description information; step S120, segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information; step S130, performing multi-plane reconstruction on the DICOM image according to a basic view angle and a preset transformation relation to obtain a two-dimensional image; step S140, carrying out zoom adjustment on the local image according to a preset zoom ratio to obtain an adjusted local image; and S150, drawing and displaying the two-dimensional image and the adjusted local image in a virtual window according to the relative position, and outputting the image displayed in the virtual window.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method of processing DICOM data, comprising:
acquiring DICOM data displayed by a current window and a basic view angle of the window, wherein the DICOM data comprises DICOM images and description information;
segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information;
performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation to obtain a two-dimensional image;
carrying out zoom adjustment on the local image according to a preset zoom ratio to obtain an adjusted local image;
and drawing and displaying the two-dimensional image and the adjusted local image in a virtual window according to the relative position, and outputting the image displayed in the virtual window.
2. The method of claim 1, after obtaining DICOM data currently displayed in a window, further comprising:
and acquiring a volume data set formed by pixel points in all DICOM images, wherein the volume data set comprises space coordinates from the first DICOM image to the center position of the first pixel at the upper left corner, the volume data size and the volume data number.
3. The method of claim 1, wherein segmenting the descriptive information in the DICOM data to obtain at least one partial image corresponding to the descriptive information comprises:
segmenting the description information in the DICOM data according to the relative position of the DICOM image;
and using the description information block on the segmented relative direction as a local image.
4. The method of claim 3, wherein after obtaining at least one partial image corresponding to the descriptive information, further comprising:
when the description information picture block comprises a line of characters, taking the pixel height of the characters as the height of the local image, and taking the pixel length of the characters as the width of the local image;
when the description information image block comprises a plurality of lines of characters, the pixel height of the characters is taken as the height of the local image, and the maximum value of the pixel length of the plurality of lines of characters is taken as the width of the local image.
5. The method of claim 1, wherein the multi-planar reconstruction includes at least one of scaling, translation, rotation, and window width and level adjustment.
6. The method of claim 5, wherein the predetermined transformation relationship comprises:
according to the three-dimensional space transformation rule, determining a formula of a Matrix of Matrix transformation relation as follows:
a Matrix transformation relation Matrix is a translation Matrix and a scaling Matrix and a rotation Matrix;
and according to the Matrix transformation relation Matrix, taking a transformation relation Matrix of the relative coordinates of the basic visual angle and the DICOM image.
7. The method of processing DICOM data as claimed in claim 6, further comprising:
and after the DICOM image is subjected to window width and window level adjustment, if the color information of the DICOM image changes, acquiring the adjusted window width and window level value.
8. The method of claim 2, wherein performing a multi-planar reconstruction of the DICOM image from the base view in combination with a predetermined transform relationship to obtain a two-dimensional image comprises:
creating a virtual window, wherein the size of the virtual window is the same as that of an image to be output;
adding the volume data set to the virtual window as display data;
setting a corresponding camera view angle for the display data according to the basic view angle and the preset transformation relation;
and drawing window textures on the virtual window according to the camera shooting visual angle and the display data to obtain the two-dimensional image.
9. The method of claim 8, wherein rendering and displaying the two-dimensional image and the adjusted partial image in a virtual window in relative position comprises:
replacing the adjusted local image and the two-dimensional image according to the relative position of the description information and the DICOM image, and drawing on pixel points at the relative position by using the adjusted local image;
rendering and displaying the image of the virtual window after being drawn.
10. An apparatus for processing DICOM data, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring DICOM data displayed by a current window and a basic view angle of the window, and the DICOM data comprises DICOM images and description information;
the segmentation module is used for segmenting the description information in the DICOM data to obtain at least one local image corresponding to the description information;
the reconstruction module is used for performing multi-plane reconstruction on the DICOM image according to the basic view angle and a preset transformation relation to obtain a two-dimensional image;
the zooming module is used for zooming and adjusting the local image according to a preset zooming proportion to obtain an adjusted local image;
and the drawing module is used for drawing and displaying the two-dimensional image and the adjusted local image in a virtual window according to the relative position and outputting the image displayed by the virtual window.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911398553.6A CN111210898B (en) | 2019-12-30 | 2019-12-30 | Method and device for processing DICOM data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911398553.6A CN111210898B (en) | 2019-12-30 | 2019-12-30 | Method and device for processing DICOM data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111210898A true CN111210898A (en) | 2020-05-29 |
CN111210898B CN111210898B (en) | 2023-08-01 |
Family
ID=70786524
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911398553.6A Active CN111210898B (en) | 2019-12-30 | 2019-12-30 | Method and device for processing DICOM data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111210898B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112820385A (en) * | 2021-02-01 | 2021-05-18 | 赛诺联合医疗科技(北京)有限公司 | Medical image browsing method, client and system |
CN113823385A (en) * | 2021-09-03 | 2021-12-21 | 青岛海信医疗设备股份有限公司 | Method, device, equipment and medium for modifying DICOM image |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104361336A (en) * | 2014-11-26 | 2015-02-18 | 河海大学 | Character recognition method for underwater video images |
US20170069085A1 (en) * | 2015-09-04 | 2017-03-09 | Canon Kabushiki Kaisha | Medical image processing apparatus, medical image processing method, and medical image processing system |
CN106910210A (en) * | 2017-03-03 | 2017-06-30 | 百度在线网络技术(北京)有限公司 | Method and apparatus for generating image information |
CN108962354A (en) * | 2018-07-03 | 2018-12-07 | 成都市九阵科技有限公司 | A kind of DICOM browsing image method |
CN109360233A (en) * | 2018-09-12 | 2019-02-19 | 沈阳东软医疗系统有限公司 | Image interfusion method, device, equipment and storage medium |
CN109635805A (en) * | 2018-12-11 | 2019-04-16 | 上海智臻智能网络科技股份有限公司 | Image text location method and device, image text recognition methods and device |
CN109919146A (en) * | 2019-02-02 | 2019-06-21 | 上海兑观信息科技技术有限公司 | Picture character recognition methods, device and platform |
-
2019
- 2019-12-30 CN CN201911398553.6A patent/CN111210898B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104361336A (en) * | 2014-11-26 | 2015-02-18 | 河海大学 | Character recognition method for underwater video images |
US20170069085A1 (en) * | 2015-09-04 | 2017-03-09 | Canon Kabushiki Kaisha | Medical image processing apparatus, medical image processing method, and medical image processing system |
CN106910210A (en) * | 2017-03-03 | 2017-06-30 | 百度在线网络技术(北京)有限公司 | Method and apparatus for generating image information |
CN108962354A (en) * | 2018-07-03 | 2018-12-07 | 成都市九阵科技有限公司 | A kind of DICOM browsing image method |
CN109360233A (en) * | 2018-09-12 | 2019-02-19 | 沈阳东软医疗系统有限公司 | Image interfusion method, device, equipment and storage medium |
CN109635805A (en) * | 2018-12-11 | 2019-04-16 | 上海智臻智能网络科技股份有限公司 | Image text location method and device, image text recognition methods and device |
CN109919146A (en) * | 2019-02-02 | 2019-06-21 | 上海兑观信息科技技术有限公司 | Picture character recognition methods, device and platform |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112820385A (en) * | 2021-02-01 | 2021-05-18 | 赛诺联合医疗科技(北京)有限公司 | Medical image browsing method, client and system |
CN113823385A (en) * | 2021-09-03 | 2021-12-21 | 青岛海信医疗设备股份有限公司 | Method, device, equipment and medium for modifying DICOM image |
CN113823385B (en) * | 2021-09-03 | 2024-03-19 | 青岛海信医疗设备股份有限公司 | Method, device, equipment and medium for modifying DICOM image |
Also Published As
Publication number | Publication date |
---|---|
CN111210898B (en) | 2023-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111192356B (en) | Method, device, equipment and storage medium for displaying region of interest | |
US8294706B2 (en) | Volume rendering using N-pass sampling | |
US10692272B2 (en) | System and method for removing voxel image data from being rendered according to a cutting region | |
US8244018B2 (en) | Visualizing a 3D volume dataset of an image at any position or orientation from within or outside | |
US10275930B2 (en) | Combined intensity projection | |
CN103325139B (en) | Medical image-processing apparatus and medical image processing method | |
JPH08138078A (en) | Image processing device | |
CN111598989B (en) | Image rendering parameter setting method and device, electronic equipment and storage medium | |
CN111430012A (en) | System and method for semi-automatically segmenting 3D medical images using real-time edge-aware brushes | |
JP2006526834A (en) | Adaptive image interpolation for volume rendering | |
CN114694805A (en) | Medical image rendering method, device, equipment and medium | |
CN111210898B (en) | Method and device for processing DICOM data | |
JP4122314B2 (en) | Projection image processing method, projection image processing program, and projection image processing apparatus | |
US7289131B2 (en) | Method of rendering a graphics image | |
US20050237336A1 (en) | Method and system for multi-object volumetric data visualization | |
US12073508B2 (en) | System and method for image processing | |
US9035945B1 (en) | Spatial derivative-based ray tracing for volume rendering | |
JP4668289B2 (en) | Image processing apparatus and method, and program | |
JP7131080B2 (en) | volume rendering device | |
US9082217B1 (en) | Avoidance-based ray tracing for volume rendering | |
JP2019205791A (en) | Medical image processing apparatus, medical image processing method, program, and data creation method | |
US11158114B2 (en) | Medical imaging method and apparatus | |
JP7223312B2 (en) | volume rendering device | |
US20230064516A1 (en) | Method, device, and system for processing medical image | |
CN114005513A (en) | MIP projection CPU algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |