KR20200144244A - Electronic device that enable automatic matching of chart areas and legend areas in chart images embedded in electronic document and operating method thereof - Google Patents

Abstract

Disclosed are an electronic device enabling automatic matching for a chart area and a legend area in a chart image inserted in an electronic document and an operating method thereof. In the present invention, by presenting the electronic device enabling automatic matching for a chart area and a legend area in a chart image inserted in an electronic document, and an operation method thereof, even when the chart image is made of the same series color such as grayscale and it is difficult to identify data series, a plurality of data series are respectively detected in the chart area and the legend area in the chart image. By displaying a connection line between the same data series or applying the same RGB color, it is possible to support a user to easily identify a data series from the chart area.

Description

ELECTRONIC DEVICE THAT ENABLE AUTOMATIC MATCHING OF CHART AREAS AND LEGEND AREAS IN CHART IMAGES EMBEDDED IN ELECTRONIC DOCUMENT AND OPERATING METHOD THEREOF}

The present invention relates to an electronic device that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document, and an operating method thereof.

In recent years, as computers, smartphones, tablet PCs, etc. are widely spread, various types of electronic document-related programs are being released that enable users to view, create, and edit electronic documents using such electronic devices.

Examples of such electronic document related programs include a word processor that supports basic document creation and editing, data input, arithmetic operations, spreadsheets that assist data management, and presentation programs to assist presenters' presentations.

Relatedly, electronic document related programs provide a chart generation function that allows a user to easily create a chart based on the data when a user inputs predetermined data on the electronic document.

Specifically, when a chart is created as a user inputs predetermined data, electronic document-related programs not only support changing the chart type into various forms such as pie, donut, radial, and bar, but also support each other indicating data series. Various designs are provided so that different color combinations can be changed.

Therefore, the user can select various types of charts such as pie, donut, radial, bar, etc. to suit the purpose of the document, and the division of each data series in the chart area and the legend area is designed with a combination of colors according to user preference. You can choose.

However, if the user edits the document by inserting the image containing the chart, not the chart created by entering data on the electronic document, the chart is only an image on the electronic document, so the above electronic document related programs It is impossible to apply various designs provided.

For example, when a grayscale chart image is inserted, each data series constituting the chart is divided according to the brightness of black and white, but the difference will become unclear as the number of data series increases, so the user can choose between the chart area and the legend area. It will not be easy to grasp the matching of data series in. Nevertheless, since the grayscale chart image is only an image, not a chart, the design cannot be changed even if the color applied to the data series is similar and it is difficult to distinguish.

Therefore, even when a chart image is inserted in an electronic document, there is a need for a study on a technology that enables automatic matching between the chart area and the legend area.

The present invention provides an electronic device that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document, and an operation method thereof, so that the chart image is composed of the same color as a grayscale to identify the data series. Even in this difficult case, a plurality of data series are detected in the chart area and the legend area in the chart image, respectively, and displayed as a connecting line between the same data series or the same RGB color is applied, so that the user can easily identify the data series from the chart area. We want to support you.

An electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention is provided by a user in the chart area and the legend area constituting the chart image inserted in the electronic document. When a matching command between the same data series is received, a guide message display unit for displaying a guide message instructing to designate each of the chart area and the legend area among the chart images, and the chart area and the chart area from the user in response to the guide message. When a legend area is designated, a pixel value similarity between a plurality of first pixels constituting the chart area is measured, and then a pixel value similarity between the plurality of first pixels is a set of pixels within a predetermined reference value A first object detection unit that detects a plurality of first objects from the chart area by designating as one object, and when the plurality of first objects are detected, a pixel value between a plurality of second pixels constituting the legend area A second object detection unit configured to detect a plurality of second objects from the legend area by measuring a similarity and then designating a set of pixels whose pixel value similarity between the plurality of second pixels is within the reference value as one object, After measuring a color histogram of each of the plurality of first objects and a color histogram of each of the plurality of second objects, a color histogram of each of the plurality of first objects and the plurality of second objects A similarity calculation unit that calculates color histogram similarity between color histograms for each, an object that matches each of the plurality of first objects, one of the plurality of second objects whose color histogram similarity is calculated, one by one And a matching unit and a connection line display unit for displaying a connection line indicating that a data series is the same between the matched objects among the plurality of first objects and the plurality of second objects.

In addition, according to an embodiment of the present invention, a method of operating an electronic device that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document is a chart constituting a chart image inserted into an electronic document from a user. When a matching command between the same data series is received in an area and a legend area, displaying a guide message instructing to designate each of the chart area and the legend area among the chart images, and the chart from the user in response to the guide message When an area and the legend area are designated, a pixel value similarity between a plurality of first pixels constituting the chart area is measured, and a pixel value similarity between the plurality of first pixels is within a preset reference value. Detecting a plurality of first objects from the chart area by designating as one object, and when the plurality of first objects are detected, measuring a pixel value similarity between a plurality of second pixels constituting the legend area Thereafter, detecting a plurality of second objects from the legend area by designating a set of pixels whose pixel value similarity between the plurality of second pixels is within the reference value as one object, and the plurality of first objects After measuring the color histogram of each of the plurality of second objects and the color histogram of each of the plurality of second objects, between the color histogram of each of the plurality of first objects and the color histogram of each of the plurality of second objects Computing a color histogram similarity of, for each of the plurality of first objects, matching an object whose color histogram similarity is calculated to be maximum among the plurality of second objects one by one, and the plurality of first objects And displaying a connection line indicating the same data series between the matched objects among the plurality of second objects and the plurality of second objects.

The present invention provides an electronic device that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document, and an operation method thereof, so that the chart image is composed of the same color as a grayscale to identify the data series. Even in this difficult case, a plurality of data series are detected in the chart area and the legend area in the chart image, respectively, and displayed as a connecting line between the same data series or the same RGB color is applied, so that the user can easily identify the data series from the chart area. You can apply to help.

1 is a diagram illustrating a structure of an electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention.
2 to 4 are views for explaining an electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention.
5 is a flowchart illustrating a method of operating an electronic device enabling automatic matching between a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. This description is not intended to limit the present invention to a specific embodiment, it is to be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention. While describing each drawing, similar reference numerals have been used for similar components, and unless otherwise defined, all terms used in the present specification including technical or scientific terms refer to common knowledge in the technical field to which the present invention belongs. It has the same meaning as commonly understood by someone who has it.

In this document, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, in various embodiments of the present invention, each component, functional blocks or means may be composed of one or more sub-components, and the electrical, electronic, and mechanical functions performed by each component are electronic. A circuit, an integrated circuit, and an application specific integrated circuit (ASIC) may be implemented with various known devices or mechanical elements, and may be implemented separately or two or more may be integrated into one.

On the other hand, the blocks of the attached block diagram and the steps in the flowchart are computer program instructions that are mounted on a processor or memory of equipment capable of processing data such as a general-purpose computer, a special-purpose computer, a portable notebook computer, and a network computer to perform specified functions. It can be interpreted as meaning. Since these computer program instructions can be stored in a memory provided in a computer device or in a memory readable by a computer, the functions described in the blocks in the block diagram or in the steps in the flowchart are produced as a product containing the instruction means to perform this. It could be. In addition, each block or each step may represent a module, segment, or part of code including one or more executable instructions for executing the specified logical function(s). In addition, it should be noted that in some alternative embodiments, functions mentioned in blocks or steps may be executed in a different order. For example, two blocks or steps shown in succession may be performed substantially simultaneously or may be performed in reverse order, and in some cases, some blocks or steps may be omitted.

1 is a diagram illustrating a structure of an electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention.

Referring to FIG. 1, an electronic device 110 that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention includes a guide message display unit 111 and a first An object detection unit 112, a second object detection unit 113, a similarity calculation unit 114, an object matching unit 115, and a connection line display unit 116 are included.

When a matching command between the same data series is received from the user in the chart area and the legend area constituting the chart image inserted in the electronic document, the guide message display unit 111 prompts the user to designate the chart area and the legend area respectively among the chart images. Display an instructing guide message.

For example, as shown in FIG. 2, it is assumed that a chart image 210 for'global HPC performance ratio' is inserted on an electronic document.

2, the guide message display unit 111 is the same in the chart area 211 and the legend area 212 constituting the chart image 210 regarding the'global HPC performance ratio' inserted in the electronic document from the user. When a matching command between data series is received, a guide message instructing to designate each of the chart area 211 and the legend area 212 among the chart image 210 regarding the'global HPC performance ratio' may be displayed.

When the chart area and the legend area are designated by the user in response to the guide message, the first object detection unit 112 measures a pixel value similarity between a plurality of first pixels constituting the chart area, and then the A plurality of first objects are detected from the chart area by designating a set of pixels whose pixel value similarity between the plurality of first pixels is within a predetermined reference value as one object.

Here, the pixel means a point of light and dark as the smallest unit constituting a screen in a television or a transmission picture. Further, the pixel value is a value that can be held for each pixel, and can be considered to mean a set of values allocated for each of the three primary colors of light, RED, GREEN, and BLUE.

And, according to an embodiment of the present invention, when the pixel value similarity is calculated as the pixel value similarity between the first pixel and the second pixel, the RGB color table of each of the first pixel and the second pixel is calculated. It may be a degree of cosine similarity between 3D vectors including constituting RED color values, GREED color values, and BLUE color values as components.

Here, the RED, GREEN, and BLUE color values constituting the RGB color table may be expressed in different colors by having values ranging from 0 to 255, and the cosine similarity may be performed according to Equation 1 below. .

Here, S is a vector A and a cosine similarity between B has a value between -1 to 1, meaning that the value is larger and similar vectors, A _i is the i th component of the vector A, B _i is the vector B i Means the second ingredient. That is, as the colors between any two pixels are similar, the value of the pixel value similarity will be calculated larger.

For example, suppose that a pixel value similarity between pixel 1 whose RGB color table is '255', '0', and '0' and pixel 2 whose RGB color table is '0', '255', and '0' is calculated, The pixel value similarity is a three-dimensional vector ('255', '0', '0') including the RED color value, the GREED color value, and the BLUE color value of the pixel 1 as components, and the RED color value of the pixel 2 , Since the cosine similarity between ('0', '255', '0') which is a three-dimensional vector including the GREED color value and the BLUE color value as a component, according to Equation 1, the pixel value similarity is 0 Can be.

In addition, the reference value is a value that can be set in advance by the developer. Even when the number of data series constituting the chart is large and the difference in pixel values between the data series is not large, the reference value is a value that is sufficiently small to be classified into different objects. Can be set.

And, according to an embodiment of the present invention, when the chart area includes a background or text unnecessary for detection of the plurality of first objects, the first object detection unit 112 A first object measuring unit 117 may be included to detect objects.

When the chart area and the legend area are designated by the user in response to the guide message, the first object measurement unit 117 is configured to perform a first predetermined background color in the plurality of first pixels constituting the chart area. After excluding pixels having the same pixel value as the second pixel value previously designated as the pixel value and the text color, the plurality of first pixels excluding pixels having the same pixel value as the first pixel value and the second pixel value are excluded. The similarity of pixel values between pixels is measured.

For example, referring to FIG. 2, when a guide message instructing to designate the chart area 211 and the legend area 212 of the chart image 210 related to the'global HPC performance ratio' is displayed, the user may The chart area 211 and the legend area 212 may be designated among the chart image 210 related to the'global HPC performance ratio', such as a rectangular area indicated by a blue line at 2.

In this case, the first pixel value pre-designated as the background color is '255', '255', and '255', which are pixel values representing white, and the second pixel value pre-designated as the text color is '0' representing black, Assuming that '0' and '0' are assumed, the first object measurement unit 117 determines the chart area 211 and the legend area 212 by the user in response to the guide message, and the chart area 211 Pixels constituting a white background of the plurality of first pixels and pixels constituting a black text portion written as '46%', '34%', and '20%' in the pie chart After excluding the pixels, the pixels constituting the white background portion and the pixels constituting the black text portion marked with '46%', '34%' and '20%' in the pie chart are excluded. The degree of similarity of pixel values between one pixel can be measured.

After that, the first object detection unit 112 designates a set of pixels whose pixel value similarity between the plurality of first pixels is within the reference value as one object, and thus, as shown in FIG. A plurality of first objects 213, 214, and 215 may be detected from 211.

When the plurality of first objects are detected, the second object detection unit 113 measures a pixel value similarity between the plurality of second pixels constituting the legend area, and then measures the pixel value similarity between the plurality of second pixels. By designating a set of pixels within the reference value as one object, a plurality of second objects are detected from the legend area.

And, according to an embodiment of the present invention, when the legend area includes a background or text unnecessary for detection of the plurality of second objects, the second object detection unit 113 A second object measurement unit 118 may be included to detect objects.

The second object measuring unit 118 excludes pixels having the same pixel value as the first pixel value and the second pixel value from the plurality of second pixels constituting the legend area, and then the first pixel value. And a pixel value similarity between the plurality of second pixels excluding pixels having the same pixel value as the second pixel value.

For example, as in the previous example, the first pixel value is '255', '255', and '255' which are pixel values representing white, and the second pixel value is '0', '0', which represents black, Assuming that it is '0', referring to FIG. 3, the second object measuring unit 118 includes pixels constituting a white background portion of the plurality of second pixels constituting the legend area 212 and ' After excluding the pixels constituting the black text part marked with'Korea','USA', and'Europe', the pixels constituting the white background part and the black text marked'Korea','USA' and'Europe' The degree of similarity of pixel values between the plurality of second pixels excluding pixels constituting the color text portion may be measured.

Thereafter, the second object detection unit 113 designates a set of pixels whose pixel value similarity between the plurality of second pixels is within the reference value as a single object, so that the plurality of second objects from the legend area 212 Fields 216, 217, 218 can be detected.

The similarity calculation unit 114 measures a color histogram of each of the plurality of first objects and a color histogram of each of the plurality of second objects, and then measures the color histogram of each of the plurality of first objects and the A color histogram similarity between color histograms for each of the plurality of second objects is calculated.

Here, the color histogram refers to a distribution of intensity values for pixels in an image. In the color histogram, the horizontal axis represents the intensity value of the 256-gray-level image, and the vertical axis represents the frequency of each intensity value. In addition, the color histogram may be expressed as a set of values representing the frequency of a plurality of intensity values.

In this case, according to an embodiment of the present invention, when the color histogram similarity calculates the color histogram similarity between the first color histogram and the second color histogram, each of the first color histogram and the second color histogram is calculated. It refers to a vector similarity between vectors including a plurality of component color histogram numerical values as components, and may be calculated according to Equation 2 below.

Here, the plurality of color histogram numerical values mean a frequency for each intensity value.

Here, M is a vector similarity between two vectors, S is a cosine similarity between two vectors, D is a Euclidean distance between two vectors, and S is a cosine similarity between the two vectors. According to 1, the Euclidean distance D between the two vectors can be calculated according to Equation 3 below.

In Equation 3, D denotes the Euclidean distance, and A _i and B _i denote the i-th components included in the two vectors. Generally, as the Euclidean distance between two vectors is smaller, the two vectors can be regarded as similar vectors, and as the Euclidean distance between two vectors is larger, the two vectors can be considered to be dissimilar vectors.

The object matching unit 115 matches each of the plurality of first objects, one of the plurality of second objects, one object whose color histogram similarity is calculated to be maximum.

Thereafter, the connection line display unit 116 displays a connection line indicating the same data series between the plurality of first objects and the matched objects among the plurality of second objects.

For example, referring to FIG. 3, as in the previous example, a plurality of first objects 213, 214, 215 are detected in the chart area 211, and a plurality of second objects 216 are detected in the legend area 212. , 217, 218), the object matching unit 115 for each of the plurality of first objects 213, 214, 215, the color of the plurality of second objects 216, 217, 218 Objects with the maximum histogram similarity can be matched one by one.

Specifically, the color histogram among the plurality of second objects (216, 217, 218) for object 1 (213), which occupies a ratio of '34%' of the plurality of first objects (213, 214, 215) The object for which the degree of similarity is calculated is the object 2 (216) corresponding to'Korea', and the object 3 (214) occupying a ratio of '20%' among the plurality of first objects (213, 214, 215) , Among the plurality of second objects (216, 217, 218), the object whose color histogram similarity is calculated to be the maximum is the object 4 (217) corresponding to'USA', and the plurality of first objects (213, 214, 215), among the plurality of second objects 216, 217, and 218, the object whose color histogram similarity is calculated to be the maximum is'Europe'. It may be object 6 (216).

That is, the object matching unit 115 matches object 1 (213) with object 2 (216), object 3 (214) with object 4 (217), and object 5 (215) with object 6 (218). I can.

Thereafter, the connection line display unit 116 matches object 1 213 and object 2 216 among the plurality of first objects 213, 214, and 215 and the plurality of second objects 216, 217, 218 , A connection line 219 shown in red indicating that the data series is the same between the object 3 214 and the object 4 217, and the object 5 215 and the object 6 218 may be displayed.

In this case, according to an embodiment of the present invention, the electronic device 110 that enables automatic matching of the chart area and the legend area in the chart image inserted in the electronic document is matched by applying RGB colors to each data series. It may include a color application unit 119 for a user who prefers to.

After the connection line is displayed, when a color matching command between the same data series is received from the user, the color application unit 119 removes the connection line, and then, the plurality of first objects and the plurality of second objects The color of the object between the matched objects is applied with the same color randomly determined.

For example, referring to FIG. 4, after the connection line is displayed, when a color matching command between the same data series is received from the user, the color application unit 119 removes the connection line first, and then the plurality of first objects 213, Among the 214, 215) and a plurality of second objects 216, 217, 218, objects 1 (213) and 2 (216) matched with each other are blue, and objects 3 (214) and 4 (217) are red. A green color may be randomly determined and applied between the object 5 215 and the object 6 218.

In addition, according to an embodiment of the present invention, the electronic device 110 that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document is the plurality of second objects located in the legend area. After copying the text corresponding to each of the plurality of second objects, a text arrangement unit for placing the text on an object whose color histogram similarity is calculated to be maximum among the plurality of first objects ( (Not shown) may be additionally provided.

5 is a flowchart illustrating a method of operating an electronic device enabling automatic matching between a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention.

In step S510, when a matching command between the same data series in the chart area and the legend area constituting the chart image inserted in the electronic document is received from the user, instructing to designate the chart area and the legend area respectively among the chart images. Display a guide message.

In step S520, when the chart area and the legend area are designated by the user in response to the guide message, a pixel value similarity between a plurality of first pixels constituting the chart area is measured, and then the plurality of first pixels are measured. A plurality of first objects are detected from the chart area by designating a set of pixels whose pixel value similarity between one pixel is within a preset reference value as one object.

In step S530, when the plurality of first objects are detected, a pixel value similarity between a plurality of second pixels constituting the legend area is measured, and then a pixel value similarity between the plurality of second pixels is the reference value. By designating a set of pixels within the range as one object, a plurality of second objects are detected from the legend area.

In step S540, after measuring a color histogram for each of the plurality of first objects and a color histogram for each of the plurality of second objects, a color histogram for each of the plurality of first objects and the plurality of The color histogram similarity between the color histograms for each of the second objects of is calculated.

In step S550, an object whose color histogram similarity is calculated to be maximum among the plurality of second objects is matched one by one with respect to each of the plurality of first objects.

In step S560, a connection line indicating the same data series between the plurality of first objects and the matching objects among the plurality of second objects is displayed.

At this time, according to an embodiment of the present invention, in step S520, when the chart area and the legend area are designated by the user in response to the guide message, the plurality of first pixels constituting the chart area After excluding pixels having the same pixel value as the first pixel value preset as the background color and the second pixel value preset as the text color, pixels having the same pixel value as the first pixel value and the second pixel value are It may include measuring the similarity of pixel values between the excluded first pixels.

Further, in step S530, after excluding pixels having the same pixel value as the first pixel value and the second pixel value from the plurality of second pixels constituting the legend area, the first pixel value and the It may include measuring a pixel value similarity between the plurality of second pixels excluding pixels having the same pixel value as the second pixel value.

Further, according to an embodiment of the present invention, after the connection line is displayed, when a color matching command between the same data series is received from the user, the electronic device removes the connection line, and then the plurality of first objects and the It may include the step of applying a color of the object with the same color randomly determined between objects matched with each other among the plurality of second objects.

In addition, according to an embodiment of the present invention, when the color histogram similarity calculates the color histogram similarity between the first color histogram and the second color histogram, each of the first color histogram and the second color histogram is calculated. It refers to a vector similarity between vectors including a plurality of component color histogram numerical values as components, and may be calculated according to Equation 1 above.

In addition, according to an embodiment of the present invention, when the pixel value similarity is calculated to calculate the pixel value similarity between the first pixel and the second pixel, the RGB color table of each of the first pixel and the second pixel is calculated. It may be a degree of cosine similarity between 3D vectors including constituting RED color values, GREED color values, and BLUE color values as components.

In the above, a method of operating an electronic device enabling automatic matching between a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention has been described with reference to FIG. 5. Here, the operation method of the electronic device that enables automatic matching between the chart area and the legend area in the chart image inserted in the electronic document according to an embodiment of the present invention is inserted into the electronic document described with reference to FIGS. 1 to 4. Since it may correspond to the configuration of the operation of the electronic device 110 that enables automatic matching between the chart area and the legend area in the chart image, a more detailed description thereof will be omitted.

The method of operating an electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention is a computer program stored in a storage medium for execution through a combination with a computer. It can be implemented as

In addition, a method of operating an electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document according to an embodiment of the present invention is in the form of a computer program command to be executed through a combination with a computer. It can be implemented as a computer-readable medium and recorded. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, in the present invention, specific matters such as specific components, etc., and limited embodiments and drawings have been described, but this is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , If a person of ordinary skill in the field to which the present invention belongs, various modifications and variations are possible from this description.

Therefore, the spirit of the present invention is limited to the described embodiments and should not be defined, and all things that are equivalent or equivalent to the claims as well as the claims to be described later fall within the scope of the spirit of the present invention. .

110: An electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document
111: guide message display unit 112: first object detection unit
113: second object detection unit 114: similarity calculation unit
115: object matching unit 116: connection line display unit
117: first object measuring unit 118: second object measuring unit
119: color application unit

Claims (12)

When a matching command between the same data series in the chart area and the legend area constituting the chart image inserted in the electronic document is received from the user, a guide message instructing to designate the chart area and the legend area among the chart images is displayed. A guide message display unit;
When the chart area and the legend area are designated by the user in response to the guide message, a pixel value similarity between a plurality of first pixels constituting the chart area is measured, and then pixels between the plurality of first pixels A first object detector configured to detect a plurality of first objects from the chart area by designating a set of pixels whose value similarity is within a predetermined reference value as one object;
When the plurality of first objects are detected, a pixel value similarity between a plurality of second pixels constituting the legend area is measured, and a pixel value similarity between the plurality of second pixels is within the reference value. A second object detection unit configured to detect a plurality of second objects from the legend area by designating as one object;
After measuring a color histogram of each of the plurality of first objects and a color histogram of each of the plurality of second objects, a color histogram of each of the plurality of first objects and the plurality of second objects A similarity calculation unit for calculating a color histogram similarity between each color histogram;
An object matching unit for matching an object whose color histogram similarity is calculated to be maximum among the plurality of second objects for each of the plurality of first objects; And
A connection line display unit for displaying a connection line indicating the same data series between the plurality of first objects and the matched objects among the plurality of second objects
An electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document including a. The method of claim 1,
The first object detection unit
When the chart area and the legend area are designated by the user in response to the guide message, a first pixel value and a text color pre-designated as a background color in the plurality of first pixels constituting the chart area After excluding pixels having the same pixel value as the second pixel value, measuring the pixel value similarity between the plurality of first pixels excluding pixels having the same pixel value as the first pixel value and the second pixel value 1st object measurement unit
Including,
The second object detection unit
A pixel equal to the first pixel value and the second pixel value after excluding pixels having the same pixel value as the first pixel value and the second pixel value from the plurality of second pixels constituting the legend area A second object measuring unit that measures the similarity of pixel values between the plurality of second pixels excluding pixels having values
An electronic device that enables automatic matching of a chart area and a legend area in a chart image inserted in an electronic document including a. The method of claim 1,
After the connection line is displayed, when a color matching command between the same data series is received from the user, the color of the object between the plurality of first objects and the plurality of second objects matched with each other after removing the connection line A color application unit that applies the same color randomly determined
An electronic device that enables automatic matching of the chart area and the legend area in the chart image inserted in the electronic document further comprising. The method of claim 1,
Assuming that the color histogram similarity is calculated for the color histogram similarity between the first color histogram and the second color histogram, a plurality of color histogram numerical values constituting each of the first color histogram and the second color histogram are used as components. An electronic device capable of automatically matching a chart area and a legend area in a chart image inserted into an electronic document calculated according to Equation 1 below.
[Equation 1]

Here, M is the vector similarity between two vectors, S is the cosine similarity between the two vectors, and D is the Euclidean distance between the two vectors. The method of claim 1,
When the pixel value similarity is calculated to calculate the pixel value similarity between the first pixel and the second pixel, the RED color value, the GREED color value, and the BLUE constituting the RGB color table of each of the first pixel and the second pixel An electronic device that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document, which is a degree of cosine similarity between 3D vectors including color values as components. When a matching command between the same data series in the chart area and the legend area constituting the chart image inserted in the electronic document is received from the user, a guide message instructing to designate the chart area and the legend area among the chart images is displayed. step;
When the chart area and the legend area are designated by the user in response to the guide message, a pixel value similarity between a plurality of first pixels constituting the chart area is measured, and then pixels between the plurality of first pixels Detecting a plurality of first objects from the chart area by designating a set of pixels whose value similarity is within a predetermined reference value as one object;
When the plurality of first objects are detected, a pixel value similarity between a plurality of second pixels constituting the legend area is measured, and a pixel value similarity between the plurality of second pixels is within the reference value. Detecting a plurality of second objects from the legend area by designating as one object;
After measuring a color histogram of each of the plurality of first objects and a color histogram of each of the plurality of second objects, a color histogram of each of the plurality of first objects and the plurality of second objects Calculating a color histogram similarity between the color histograms for each;
Matching an object whose color histogram similarity is calculated to be maximum among the plurality of second objects for each of the plurality of first objects, one by one; And
Displaying a connection line indicating the same data series between the plurality of first objects and the matched objects among the plurality of second objects
A method of operating an electronic device enabling automatic matching between a chart area and a legend area in a chart image inserted in an electronic document including a. The method of claim 6,
The step of detecting the plurality of first objects
When the chart area and the legend area are designated by the user in response to the guide message, a first pixel value and a text color pre-designated as a background color in the plurality of first pixels constituting the chart area After excluding pixels having the same pixel value as the second pixel value, measuring the pixel value similarity between the plurality of first pixels excluding pixels having the same pixel value as the first pixel value and the second pixel value step
Including,
The step of detecting the plurality of second objects
After excluding pixels having the same pixel value as the first pixel value and the second pixel value from the plurality of second pixels constituting the legend area, a pixel equal to the first pixel value and the second pixel value Measuring a pixel value similarity between the plurality of second pixels excluding pixels having values
A method of operating an electronic device enabling automatic matching between a chart area and a legend area in a chart image inserted in an electronic document including a The method of claim 6,
After the connection line is displayed, when a color matching command between the same data series is received from the user, the color of the object between the plurality of first objects and the plurality of second objects matched with each other after removing the connection line Applying the same color randomly determined
The method of operating an electronic device that enables automatic matching between the chart area and the legend area in the chart image inserted in the electronic document further comprising. The method of claim 6,
Assuming that the color histogram similarity is calculated for the color histogram similarity between the first color histogram and the second color histogram, a plurality of color histogram numerical values constituting each of the first color histogram and the second color histogram are used as components. A method of operating an electronic device enabling automatic matching between a chart area and a legend area in a chart image inserted into an electronic document calculated according to Equation 1 below, which means a vector similarity between vectors included.
[Equation 1]

Here, M is the vector similarity between two vectors, S is the cosine similarity between the two vectors, and D is the Euclidean distance between the two vectors. The method of claim 6,
When the pixel value similarity is calculated to calculate the pixel value similarity between the first pixel and the second pixel, the RED color value, the GREED color value, and the BLUE constituting the RGB color table of each of the first pixel and the second pixel A method of operating an electronic device that enables automatic matching between a chart area and a legend area in a chart image inserted in an electronic document, which is a degree of cosine similarity between 3D vectors including color values as components. A computer-readable recording medium recording a computer program for executing the method of any one of claims 6 to 10 through combination with a computer. A computer program stored in a storage medium for executing the method of any one of claims 6 to 10 through combination with a computer.

Images