KR101378618B1 - Image processing apparatus and method - Google Patents

Abstract

The present invention relates to an apparatus and method for extracting an arbitrary color from an image photographed by a mobile terminal. The image processing apparatus according to an embodiment corresponds to a pixel received from pixels on a screen displaying a preview image of the mobile terminal. Acquiring color information of a preview data pixel, determining an extraction range of a color to be extracted from the preview data based on the color information of the preview data pixel, and performing color information of each of the pixels constituting the preview data; The pixels to be grayed may be determined by comparing the extracted range of the determined color.

Description

[0001] IMAGE PROCESSING APPARATUS AND METHOD [0002]

The present invention relates to an apparatus and method for extracting an arbitrary color from an image photographed by a mobile terminal.

In the prior art, it is possible to extract from an image captured only for a predetermined color provided by an imaging device such as a digital camera or a DSLR. For example, it is possible to extract from an image captured only for a specific color preset in a digital camera such as red, green, blue, and yellow.

In addition, in the case of extracting a specific color, all of the specific colors on the photographing screen may be extracted, and the specific color may be extracted even at a location not desired by the user.

An object of the present invention is to provide a method of extracting, in real time, a color similar to an arbitrary color selected by a user among various colors shown in a preview image of a mobile terminal based on color information.

In addition, the present invention is to provide a method for extracting a color similar to the color matched to a particular focus display portion of the screen in real time based on the color information among the various colors shown in the preview image of the mobile terminal.

In addition, the present invention is to provide a method for extracting a color similar to any color only in a specific region by designating a specific region of the preview image.

An image processing apparatus according to an embodiment may include a color information acquisition unit configured to obtain color information of a preview data pixel corresponding to an input pixel among pixels of a screen displaying a preview image of a mobile terminal; A color extraction range determination unit which determines an extraction range of a color to be extracted from the preview data based on the color information, and a pixel to be extracted by determining whether the color information of each pixel constituting the preview data is included in the extracted range of the color; It includes a control unit for determining the.

The color information may be one of an RGB (RGB) value and a YUV (YUV, luma chroma) value.

According to another exemplary embodiment, an image processing apparatus may include a first coordinate acquisition unit configured to acquire coordinates of a pixel received by a touch input among pixels of a screen displaying a preview image of the mobile terminal, a resolution of the screen, and a resolution of the preview image. A second coordinate obtaining unit obtaining the coordinates of the preview data pixel corresponding to the coordinates of the touch input pixel, and converting a data format of an image captured by the mobile terminal into the data format including the color information; The apparatus may further include a data format converter for converting and an algi ratio separator for separating the red component value, the green component value, and the blue component value of each pixel of the image photographed by the mobile terminal.

According to another exemplary embodiment, an image processing apparatus may include a first coordinate acquisition unit configured to acquire coordinates of a pixel received by a touch input among pixels of a screen displaying a preview image of the mobile terminal, a resolution of the screen, and a resolution of the preview image. A second coordinate obtaining unit obtaining the coordinates of the preview data pixel corresponding to the coordinates of the touch input pixel, and converting a data format of an image captured by the mobile terminal into the data format including the color information; The apparatus further includes a data format converter for converting and a Y-YV separator for separating the luminance component value, the difference value between the luminance component and the blue component, and the difference value between the luminance component and the red component of each pixel of the image photographed by the mobile terminal. can do.

The color extraction range determiner determines a ranking by comparing the sizes of the red component values, the green component values, and the blue component values of the preview data pixel, and the minimum extraction range of the red component values based on the determined rank. A first green coefficient and a green are determined to determine the first red coefficient to determine and a second red coefficient to determine the maximum extraction range of the red component value, and to determine the minimum extraction range of the green component value based on the determined rank. Determining a second green coefficient that determines a maximum extraction range of the component value, and determining a first blue coefficient that determines the minimum extraction range of the blue component value and a maximum extraction range of the blue component value based on the determined rank It may include a coefficient determiner for determining the second blue coefficient.

As the determined rank is higher, the coefficient determiner may determine a larger value of a coefficient value for determining the minimum extraction range and a coefficient value for determining the maximum extraction range.

The control unit may be configured to determine whether the red component value, the green component value, and the blue component value of each pixel constituting the preview data are the minimum extraction range, maximum extraction range, and minimum green component value of the red component value determined by the color extraction range determination unit. Determination unit for determining whether it is included in the extraction range and the maximum extraction range, the minimum extraction range and the maximum extraction range of the blue component value and the pixels constituting the preview data, the red component value, green component value, blue component value of the pixels The color of the pixels not included in the minimum extraction range and the maximum extraction range of the red component value, the minimum extraction range and the maximum extraction range of the green component value, the minimum extraction range and the maximum extraction range of the blue component value is previewed. preview) may include a color conversion unit for converting a color different from the color of the data pixel.

The image processing apparatus according to another exemplary embodiment may further include a sensitivity controller configured to adjust at least one of a minimum value and a maximum value of the color extraction range.

According to another exemplary embodiment, an image processing apparatus may include a processing area determining unit configured to determine an area in which the control unit operates, and a color of pixels of an area in which the control unit does not operate in the screen of the preview data pixel. The apparatus may further include a color converting unit converting the color into a different color.

The image processing apparatus according to another exemplary embodiment may further include a display unit configured to display color information acquired by the color information acquisition unit and a sensitivity adjustment bar for adjusting the sensitivity of the color information on the screen.

The image processing apparatus according to another exemplary embodiment may further include a color converter configured to convert the colors of the pixels extracted by the controller into at least one of pre-stored colors.

The color information acquisition unit obtains color information of preview data pixels corresponding to two or more pixels sequentially input from pixels of a screen displaying a preview image of the mobile terminal, and the color extraction range determiner The extraction ranges of two or more colors to be extracted from the preview data are determined based on the color information of the preview data pixels, and the controller is configured to determine the color information of each of the pixels of the preview data. The pixels to be extracted may be determined by determining whether they are included in the extraction range.

The first coordinate acquirer may acquire coordinates of a pixel matching a preset focus among pixels of a screen displaying a preview image of the mobile terminal.

According to an embodiment, an image processing method may include obtaining color information of a preview data pixel corresponding to an input pixel among pixels of a screen displaying a preview image of a mobile terminal, and applying the color information of the preview data pixel. Determining an extraction range of a color to be extracted from the preview data based on the determination, and determining pixels to be extracted by determining whether color information of each of the pixels constituting the preview data is included in the extraction range of the determined color. .

The determining of the extraction range of the color may include determining a ranking by comparing the sizes of the red component values, the green component values, and the blue component values of the preview data pixel, and extracting the minimum of the red component values based on the determined ranking. Determining a first red coefficient for determining a range and a second red coefficient for determining a maximum extraction range of the red component value, and a first green coefficient for determining a minimum extraction range of the green component value based on the determined rank And determining a second green coefficient that determines the maximum extraction range of the green component value and the maximum extraction of the first blue coefficient and the blue component value that determine the minimum extraction range of the blue component value based on the determined rank. And determining a second blue coefficient for determining the range.

The determining of the first red coefficient, the second red coefficient, the first green coefficient, the second green coefficient, the first blue coefficient, and the second blue coefficient may include determining the minimum extraction as the determined rank is higher. The value of the coefficient determining the range and the value of the coefficient determining the maximum extraction range can be largely determined.

The determining of the pixels to be extracted may include a red component value, a green component value, and a blue component value of each of the pixels constituting the preview data, the minimum extraction range and the maximum extraction range of the determined red component value, and the minimum of the green component value. Determining whether it is included in an extraction range and a maximum extraction range, a minimum extraction range and a maximum extraction range of a blue component value, and among the pixels constituting the preview data, a red component value, a green component value, and a blue component value of the pixels And extracting pixels included in the minimum and maximum extraction ranges of the red component value, the minimum and maximum extraction ranges of the green component value, and the minimum and maximum extraction ranges of the blue component values. have.

The present invention can provide a method of extracting a color similar to any color selected by a user in real time based on color information among various colors shown in a preview image of a mobile terminal.

In addition, the present invention may provide a method of extracting, in real time, a color similar to a color matched to a specific focus display portion of a screen among various colors shown in a preview image of a mobile terminal based on color information.

In addition, the present invention may provide a method of extracting a color similar to an arbitrary color only in a specific area by designating a specific area of the preview image.

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.
2 is a block diagram of an image processing apparatus according to another exemplary embodiment.
3 is a block diagram of an image processing apparatus according to another exemplary embodiment.
4 is a diagram illustrating coordinates of preview data pixels acquired by an image processing apparatus according to an embodiment of the present invention.
FIG. 5 is a diagram for describing a process of determining whether to convert color of pixels having different colors in the image processing apparatus according to an exemplary embodiment.
6 is a flowchart of an image processing method according to an embodiment of the present invention.
7 and 8 are diagrams for describing a process of extracting color by an area designation method in an image processing apparatus according to an embodiment of the present invention.
9 illustrates a preview image in which two or more colors are extracted by an image processing apparatus according to an embodiment of the present invention.
10 illustrates a case in which the color extracted by the image processing apparatus according to the exemplary embodiment is converted into another color.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 1, an image processing apparatus according to an exemplary embodiment may include a first coordinate acquirer 110, a second coordinate acquirer 120, a data format converter 130, and an RGB (red green blue). The separation unit 140 may include a color information acquisition unit 150, a color extraction range determination unit 160, a control unit 170, a sensitivity control unit 180, and a display unit 190.

The first coordinate acquiring unit 110 may acquire the coordinates of the touch input pixel among the pixels of the screen displaying the preview image of the mobile terminal. The preview image refers to an image which is previously displayed before finally storing the image photographed by the camera of the mobile terminal. The preview image may be stored in a buffer.

In this case, the first coordinate refers to the coordinate of the pixel received by the touch input. For example, the screen may mean a liquid crystal display (LCD) window or organic light emitting diodes (OLED) window of the mobile terminal. The mobile terminal uses mobile communication, and may mean an electronic device that users can carry.

Among the pixels on the screen, when a touch input is received from the user, the first coordinate obtaining unit 110 may obtain the coordinates of the pixel to which the touch is input.

The first coordinate obtaining unit 110 may obtain the coordinates of the pixel matching the preset focus among the pixels of the screen displaying the preview image of the mobile terminal. In this case, the first coordinate refers to the coordinate of the pixel matching the preset focus. For example, the focus may be set to a cross mark in the center of the screen. When the user points the focus to a specific object and focuses the first coordinate acquiring unit 110, the first coordinate acquiring unit 110 may acquire coordinates of a pixel matching the focused portion. Even when there is no touch input, the first coordinate acquiring unit 110 may acquire the coordinates of the object focused on the focus. That is, coordinates may also be obtained through the focus set on the LCD window where no touch input is performed.

After obtaining the color information of the captured image, the image processing apparatus may display the color information for each region, for each photographing object, or for a portion displaying the same color on the screen. At this time, the numbers match the color information, and the numbers may be displayed on the screen. For example, assuming that there is a red apple and a yellow banana in the captured image, the image processing apparatus may display red on an area corresponding to the apple and yellow on an area corresponding to the banana. Alternatively, if red means a number 1 and yellow means a number 2, the image processing apparatus may display 1 in an area corresponding to an apple and 2 in an area corresponding to a banana. Can be.

The first coordinate acquirer 110 may acquire coordinates of pixels corresponding to an area where a touch is continued, that is, an area in which dragging is performed. For example, assuming that the photographed video includes headphones and a headphone string, when the user drags on an area corresponding to the headphone and headphone string on the screen, the first coordinate acquiring unit 110 may display the headphone and headphone string. The coordinates of the pixels corresponding to the area corresponding to may be obtained.

The second coordinate acquirer 120 may acquire the coordinates of the preview data pixel corresponding to the coordinates of the pixel received by the touch input based on the resolution of the screen and the resolution of the preview image. The resolution of the screen and the resolution of the preview image may be different. Therefore, the pixel coordinates of the screen acquired by the first coordinate acquisition unit 110 need to be adjusted to the pixel coordinates of the preview image. For example, if the resolution of the screen is 1024 * 720 and the resolution of the preview image is 640 * 480, the second coordinate acquisition unit 120 downscales the pixel coordinates x1 and y1 of the acquired screen according to the difference in resolution. x2 and y2 can be obtained. An example of calculating x2, y2 by scaling pixel coordinates x1, y1 may be associated with the example of FIG. 4.

The data format converter 130 may convert a data format of an image photographed by the mobile terminal into a data format including color information. In general, data of an image photographed by a mobile terminal is not a format including color information. For example, the line packet 422 format may be used as a data format of an image photographed by a mobile terminal. The data format converter 130 may convert the data format input from the camera sensor into a data format that is easy for color detection. For example, RGB and YUV may be included in the data format for easy color detection. In addition, the data format converter 130 may convert the data converted into the RGB format into a type that is easily processed into RGB colors. For example, RGB565, RGB888 can be included in the type that is easy to color processing.

The RGB green red separation unit 140 may separate the red component value, the green component value, and the blue component value of each pixel of the image photographed by the mobile terminal. The RGB green red separation unit 140 separates the red component value, the green component value, and the blue component value for each pixel based on the color information of each pixel obtained by the data format converter 130. can do.

The color information acquisition unit 150 may acquire color information of a preview data pixel corresponding to the input pixel among pixels of the screen displaying the preview image of the mobile terminal.

In this case, the color information may be one of an RGB value and a redma blue (YUV) value. The example of FIG. 1 considers the case where the color information is an Algi ratio value, and the example of FIG. 2 considers the case where the color information is a Y-YV value.

The color extraction range determiner 160 may determine an extraction range of the color to be extracted from the preview data based on the color information of the preview data pixel. The image processing apparatus may extract not only pixels that match the obtained color information from the preview image, but may extract pixels having a color similar to the obtained color information. The color extraction range determiner 160 may determine the range of the similar color. The color extraction range determiner 160 may determine min and max values of the red component values to be extracted. The color extraction range determiner 160 may determine min and max values of the green component values to be extracted. The color extraction range determiner 160 may determine min and max values of the blue component values to be extracted.

The color extraction range determiner 160 may include a size comparison unit 161 and a coefficient determiner 163.

The size comparison unit 161 may compare the sizes of the red component value, the green component value, and the blue component value of the preview data pixel to determine the rank. That is, it may be determined which value among the red component value, the green component value and the blue component value is the largest and smallest in the preview data pixel. The preview data pixel means a pixel constituting the preview image.

The coefficient determiner 163 determines a first red coefficient for determining the minimum extraction range of the red component value and a second red coefficient for determining the maximum extraction range of the red component value based on the rank determined by the size comparison unit 161. Can be. The min value of the red component value may be determined by the first red factor, and the max value of the red component value may be determined by the second red factor.

The coefficient determination unit 163 determines a first green coefficient that determines the minimum extraction range of the green component value and a second green coefficient that determines the maximum extraction range of the green component value based on the ranking determined by the size comparison unit 161. Can be. The min value of the green component value may be determined by the first green coefficient, and the max value of the green component value may be determined by the second green coefficient.

The coefficient determiner 163 determines a first blue coefficient that determines the minimum extraction range of the blue component values and a second blue coefficient that determines the maximum extraction range of the blue component values based on the rank determined by the size comparison unit 161. Can be. The min value of the blue component value may be determined by the first blue coefficient, and the max value of the blue component value may be determined by the second blue coefficient.

The higher the rank determined by the size comparator 161 is, the greater the value of the coefficient determining the minimum extraction range and the maximum extraction range of each color component is obtained. You can decide. For example, if the red component value has the highest rank, the coefficient value for determining the minimum extraction range and the coefficient value for determining the maximum extraction range are larger than the coefficient value of the green component value and the coefficient value of the blue component value. Can be.

The controller 170 may determine pixels to be extracted by determining whether color information of each pixel constituting the preview data is included in the extraction range of the color determined by the color extraction range determiner 160. In addition, the controller 170 compares the color information of each pixel constituting the preview data with the extraction range of the color determined by the color extraction range determiner 160 and converts the color of the preview data pixel into a different color. You can decide which pixels to do. In this case, the other color may include a color preset in the mobile terminal, gray, or a single color.

The controller 170 may include a determiner 171 and a color converter 173.

The determination unit 171 determines that the red component value, the green component value, and the blue component value of each pixel constituting the preview data are the minimum and maximum extraction ranges of the red component value determined by the color extraction range determination unit 160, and green. It may be determined whether it is included in the minimum extraction range and the maximum extraction range of the component value, the minimum extraction range and the maximum extraction range of the blue component value.

Among the pixels constituting the preview data, the color converting unit 173 may include a red component value, a green component value, and a blue component value of the pixels as the minimum and maximum extraction ranges of the red component value, the minimum extraction range of the green component values, and The color of the pixels that are not included in the maximum extraction range, the minimum extraction range of the blue component value, and the maximum extraction range may be converted to a color different from that of the preview data pixel.

In the pixels constituting the preview data, the controller 170 includes all of the red component values, the green component values, and the blue component values of the pixels between the min and max values of the red component values, and between the min and max values of the green component values. The color of the pixels included between the min and max values of the blue component value may be extracted.

The sensitivity controller 180 may adjust at least one of the minimum value and the maximum value of the color extraction range. The sensitivity controller 180 may adjust the contrast of the color. At this time, the adjustment of the contrast can be made through the adjustment of each of the red component value, green component value, blue component value of the color component. The sensitivity adjusting unit 180 may adjust at least one of the minimum value and the maximum value of the extraction range of the red component value. The sensitivity adjusting unit 180 may adjust at least one of the minimum value and the maximum value of the extraction range of the green component value. The sensitivity adjusting unit 180 may adjust at least one of the minimum value and the maximum value of the extraction range of the blue component value.

The display 190 may display a sensitivity adjustment bar for adjusting the sensitivity of the color information and the color information acquired by the color information acquisition unit 150 on the screen. For example, the color information and sensitivity adjustment bar may be displayed in a specific area of the LCD window.

The color information acquisition unit 150 may acquire color information of preview data pixels corresponding to two or more pixels sequentially input from pixels on the screen displaying the preview image of the mobile terminal. In this case, two or more pixels may have different color information. For example, one pixel may have yellow information and the other pixel may have red information.

The color extraction range determiner 160 may determine extraction ranges of two or more colors to be extracted from the preview data based on the color information of the preview data pixels.

The controller 170 determines whether the color information of each of the pixels constituting the preview data is included in the extraction ranges of two or more colors determined by the color extraction range determiner 160 to be different from the color of the preview data pixel. You can determine which pixels to convert to color. Alternatively, the controller 170 may determine pixels to be extracted by determining whether the color information of each pixel constituting the preview data is included in the extraction range of two or more colors determined by the color extraction range determiner 160.

The controller 170 is responsible for overall control of the image processing apparatus, and includes a first coordinate acquirer 110, a second coordinate acquirer 120, a data format converter 130, and an RGB (red green blue). The separator 140, the color information acquirer 150, the color extraction range determiner 160, the sensitivity adjuster 180, and the display 190 may perform the functions. In the embodiment of FIG. 1, these are separately constructed and described in order to separately describe each function. Therefore, in the case of actually implementing a product, all of them may be configured to be processed by the controller 170, and only some of them may be configured to be processed by the controller 170.

2 is a block diagram of an image processing apparatus according to another exemplary embodiment.

Referring to FIG. 2, an image processing apparatus according to another exemplary embodiment may include a first coordinate acquirer 210, a second coordinate acquirer 220, a data format converter 230, and YUB (luma chroma). ) May include a separator 240, a color information acquirer 250, a color extraction range determiner 260, a controller 270, a sensitivity adjuster 280, and a display 290.

The first coordinate acquiring unit 210 may acquire the coordinates of the touch input pixel among the pixels of the screen displaying the preview image of the mobile terminal. In this case, the screen may mean, for example, a liquid crystal display (LCD) window or an organic light emitting diode (OLED) window of the mobile terminal. The mobile terminal uses mobile communication, and may mean an electronic device that users can carry.

The second coordinate acquirer 220 may acquire the coordinates of the preview data pixel corresponding to the coordinates of the pixel input by the touch based on the resolution of the screen and the resolution of the preview image. The resolution of the screen and the resolution of the preview image may be different. Therefore, the pixel coordinates of the screen acquired by the first coordinate acquisition unit 210 need to be adjusted to the pixel coordinates of the preview image.

The data format converter 230 may convert a data format of an image photographed by the mobile terminal into a data format including color information. In general, data of an image photographed by a mobile terminal is not a format including color information. For example, the line packet 422 format may be used as a data format of an image photographed by a mobile terminal. The data format converter 130 may convert the data format input from the camera sensor into a data format that is easy for color detection. For example, YUV can be included in a data format that is easy for color detection.

YUV (luma chroma) separation unit 240 is the luminance component value (Y), the difference between the luminance component and the blue component (U) of each pixel of the image captured by the mobile terminal and the luminance component and the red component The difference (V) can be separated. The YUB (luma chroma) separating unit 240 is based on the color information of each pixel obtained by the data format converter 230, the luminance component value, the difference between the luminance component and the blue component for each pixel and The difference between the luminance component and the red component can be separated.

The color information acquisition unit 250 may acquire color information of a preview data pixel corresponding to the input pixel among the pixels of the screen displaying the preview image of the mobile terminal.

The color extraction range determiner 260 may determine an extraction range of the color to be extracted from the preview data based on the color information of the preview data pixel. The image processing apparatus may extract not only pixels that match the obtained color information from the preview image, but may extract pixels having a color similar to the obtained color information.

The color extraction range determiner 260 may determine a range of similar colors. The color extraction range determiner 260 may determine min and max values of luminance component values to be extracted. The color extraction range determiner 260 may determine min and max values of the difference between the luminance component and the blue component to be extracted. The color extraction range determiner 260 may determine min and max values of the difference between the luminance component and the red component to be extracted.

The controller 270 may determine the pixels to be extracted by determining whether the color information of each pixel constituting the preview data is included in the extraction range of the color determined by the color extraction range determiner 260.

Among the pixels constituting the preview data, the controller 270 may include a luminance component value, a difference value between the luminance component and a blue component, a difference value between the luminance component and the red component, between min and max values of the luminance component value, Colors of pixels included between the min and max values of the difference between the luminance component and the blue component and between the min and max values of the difference between the luminance component and the blue component may be extracted.

The sensitivity controller 280 may adjust at least one of the minimum value and the maximum value of the color extraction range. The sensitivity controller 280 may adjust the contrast of the color. In this case, the adjustment of the contrast may be performed by adjusting the luminance component value of the color component, the difference value between the luminance component and the blue component, and the difference value between the luminance component and the red component.

The display unit 290 may display a sensitivity adjustment bar for adjusting the sensitivity of the color information and the color information acquired by the color information acquisition unit 250 on the screen. For example, color information and sensitivity adjustment bars may be displayed in specific areas of the OLED window.

The controller 270 is responsible for the overall control of the image processing apparatus, and includes a first coordinate acquirer 210, a second coordinate acquirer 220, a data format converter 230, and YUB (luma chroma). The separation unit 240, the color information acquisition unit 250, the color extraction range determination unit 260, the sensitivity control unit 280, and the display unit 290 may perform the functions. In the embodiment of FIG. 2, this configuration is illustrated separately to describe each function. Therefore, in the case of actually implementing a product, all of them may be configured to be processed by the controller 270, and only some of them may be configured to be processed by the controller 270.

3 is a block diagram of an image processing apparatus according to another exemplary embodiment.

Referring to FIG. 3, an image processing apparatus according to another exemplary embodiment may include a color information acquirer 310, a color extraction range determiner 320, a controller 330, a processing region determiner 340, and a color converter. And may include 350.

The color information acquisition unit 310 may acquire color information of a preview data pixel corresponding to the input pixel among pixels of the screen displaying the preview image of the mobile terminal.

The color extraction range determiner 320 may determine an extraction range of the color to be extracted from the preview data based on the color information of the preview data pixel. The image processing apparatus may extract not only pixels that match the obtained color information from the preview image, but may extract pixels having a color similar to the obtained color information.

The controller 330 may determine pixels to be extracted by determining whether color information of each pixel constituting the preview data is included in the extraction range of the color determined by the color extraction range determiner 320. The controller 330 may determine whether the color information of each pixel constituting the preview data is included in the extraction range of the color determined by the color extraction range determiner 320, and extract the included color. The controller 330 may store the pixels converted to a color different from the color of the preview data pixel and the pixels corresponding to the extracted color.

The processing region determiner 340 may determine an area in which the controller 330 operates on the screen. The area determined by the processing area determiner 340 may be displayed on the screen.

The controller 330 determines whether the color information of each of the pixels included in the region determined by the processing region determiner 340 on the screen is included in the extraction range of the color determined by the color extraction range determiner 320 and extracts the pixels to be extracted. You can decide.

Even though there are several pixels having the same color on the screen, the controller 330 may extract only the color of the region determined by the processing region determiner 340 and convert the colors of the remaining regions into other colors.

The controller 330 determines whether the color information of each of the pixels is included in the extraction range of the color determined by the color extraction range determiner 320 only for the region selected by the user, even though there are several pixels having the same color on the screen. To determine the pixels to be extracted.

The area determined by the processing area determiner 340 may be determined in various shapes such as a rectangle, a circle, and a polygon, and the size may be variably adjusted. Also, the first determined area may be moved to another position on the screen by a drag input of the user.

The color converter 350 may convert the colors of the pixels of the region in which the controller 330 does not operate on the screen into colors different from the colors of the preview data pixels.

The color converter 350 may convert the colors of the pixels extracted by the controller 330 into at least one of pre-stored colors. Among the pre-stored colors, the colors already extracted by the controller 330 may be included.

The controller 330 may perform a palette function. The controller 330 may store the extracted color in a palette, drive the palette in an application program such as a message, a notepad, or an editor, and use the color stored in the palette.

Conventionally, when drawing a text or a picture in a message, a notepad, an editor, etc., only the color provided by the terminal could be used.

By storing and using the color extracted using the color extraction function in a palette, there is an advantage that a variety of colors can be used in addition to the colors basically provided by the mobile terminal. That is, the user may extract and store the color of a favorite object using a color extraction function, and then use various colors in a message, a notepad, an editor, and the like.

4 is a diagram illustrating coordinates of preview data pixels acquired by an image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 4, when an arbitrary color is touched in the LCD window 410, the image processing apparatus converts the coordinates (x1, y1) of the LCD window 410 into the coordinates (x2, y2) of the preview image 420. Can be calculated

The resolution of the LCD window 410 and the resolution of the preview image 420 of the mobile terminal may not be the same. For example, the resolution of the LCD window 410 may be 1024 * 720, and the resolution of the preview image 420 may be 640 * 480. The image processing apparatus considers the resolution of the LCD window 410 and the resolution and ratio of the preview image 420 of the mobile terminal, and the coordinate (x2) of the preview image 420 at the coordinates (x1, y1) of the LCD window 410. , y2) can be obtained.

FIG. 5 is a diagram for describing a process of determining whether to convert color of pixels having different colors in the image processing apparatus according to an exemplary embodiment.

Referring to FIG. 5, it is assumed that the color of the pixel 510 represents red, the color of the pixel 520 represents blue, and the color of the pixel 530 represents green.

When the pixel 510 is selected through touch input or focus, the image processing apparatus may determine a red component value (hereinafter referred to as R), a green component value (hereinafter referred to as G), and a blue component value (hereinafter referred to as B) of the pixel 510. Can be obtained).

The image processing apparatus may separate the obtained RGB into R / G / B for each component and compare the sizes to determine the ranking.

The image processing apparatus may first filter the color of the input coordinate and the color of a series different from 100% according to the R / G / B ranking. Since the color of the pixel 510 is red, R will be the largest among R / G / B. Since the color of the pixel 520 is blue, B may be the largest among R / G / B. Since the color of the pixel 530 is green, G is largest among R / G / B.

The image processing apparatus may determine that the G and the B are the largest of the pixels of the preview data other than R, and are not the red series. Therefore, the image processing apparatus may convert the color of the pixel 520 and the color of the pixel 530 into a color different from the color of the preview data pixel. In this case, the other color may include a color preset in the mobile terminal, gray, or a single color.

In addition, the image processing apparatus may determine an extraction range for each R / G / B according to the R / G / B ranking. The extraction range may be determined by min and max values of R / G / B.

The min value and max value may be determined according to the magnitude of the coefficient. The coefficient for determining the min value of R may be set to r1, and the coefficient for determining the max value may be set to r2. The coefficient for determining the min value of G may be set to g1, and the coefficient for determining the max value may be set to g2. The coefficient for determining the min value of B may be set to b1, and the coefficient for determining the max value may be set to b2.

Assuming that the rank of R / G / B of the pixel 510 is R> G> B, the coefficients may be determined in the order of r1> g1> b1 and r2> g2> b2. Assuming that the rank of R / G / B of the pixel 510 is R> B> G, coefficients may be determined in the order of r1> b1> g1 and r2> b2> g2.

The magnitude of the coefficient may be determined differently according to the environment of the mobile terminal. In this case, the environment may include the type of the mobile terminal, the state of the camera sensor mounted on the mobile terminal, the type, the state of the LCD window, the resolution, and the like. For example, if r1, g1, b1 determined according to the R / G / B ranking, if r1 is 100 in the A terminal, it may be 110 in the B terminal.

The image processing apparatus may determine the color extraction range in real time according to the rank of R / G / B. The color extraction range can be expressed by the following equation.

R_min = R-r1-a1

R_max = R + r2 + a2

G_min = G-g1-a1

G_max = G + g2 + a2

B_min = B-b1-a1

B_max = B + b2 + a2

R_min is the minimum extraction range of R, R_max is the maximum extraction range of R, G_min is the minimum extraction range of G, G_max is the maximum extraction range of G, B_min is the minimum extraction range of B, B_max is B It means the maximum extraction range.

a1 and a2 mean coefficients corresponding to the sensitivity adjustment level. a1 and a2 may have the same value or may be different from each other. Also, a1 and a2 applied to R_min, R_max, G_min, G_max, B_min, and B_max may have different values.

The image processing apparatus may compare the color extraction range with the color information of all pixels of the preview image, and perform extraction or color conversion of gray.

6 is a flowchart of an image processing method according to an embodiment of the present invention.

In operation 610, the image processing apparatus may acquire an RGB value of the input position pixel.

In operation 615, the image processing apparatus may separate the obtained RGB values into R, G, and B values.

In operation 620, the image processing apparatus may compare the sizes of the separated R, G, and B.

In operation 625, the image processing apparatus may determine the order of R> G> B as a result of comparing the separated sizes of R, G, and B.

In operation 630, the image processing apparatus may determine the order of G> B> R as a result of comparing the separated sizes of R, G, and B.

In operation 635, the image processing apparatus may determine the order of B> R> G as a result of the size comparison of the separated R, G, and B.

The result of the size comparison of R, G, and B is not limited to the case determined in steps 625, 630, and 635. That is, in the relation of R, G, and B, various cases may further occur. For example, R> B> G, G> R> B, B> G> R, a case may occur.

In operation 640, the image processing apparatus may determine a coefficient for determining min / max of each of the R / G / Bs according to the R / G / B size order. Since the image processing apparatus has an order of R> G> B, the coefficient may be determined to have an order of r1> g1> b1 and r2> g2> b2.

In operation 645, the image processing apparatus may determine a coefficient for determining min / max of each of the R / G / Bs according to the R / G / B size order. Since the image processing apparatus has a sequence of G> B> R, the coefficient may be determined to have a sequence of g1> b1> r1 and g2> b2> r2.

In operation 650, the image processing apparatus may determine a coefficient for determining min / max of each of the R / G / Bs according to the R / G / B size order. Since the image processing apparatus has a sequence of B> R> G, the coefficient may be determined to have a sequence of b1> r1> g1 and b2> r2> g2.

In operation 655, the image processing apparatus may finally determine R_min, R_max, G_min, G_max, B_min, and B_max based on the determined coefficient. The a1 and a2 values are coefficients corresponding to the sensitivity adjustment level.

In operation 660, the image processing apparatus determines whether the RGB values of all the pixels of the preview data are included in the color extraction range by using the determined R_min, R_max, G_min, G_max, B_min, and B_max, and determines whether the pixels included in the color extraction range are included in the color extraction range. Color can be extracted.

7 and 8 are diagrams for describing a process of extracting color by an area designation method in an image processing apparatus according to an embodiment of the present invention.

More specifically, Figure 7 shows the result of the general color extraction method. As a result of the general color extraction method, if the color to be extracted from the entire screen, the corresponding color can be extracted for all positions.

Referring to FIG. 7, when red is extracted, all of the red of the A area 710, the B area 720, and the C area 730 may be extracted. However, in the process of taking a picture, there may be a case where only the A area 710 is extracted from the A area 710, the B area 720, and the C area 730.

In the current color extraction method, when the red color is extracted, the A area 710, the B area 720, and the C area 730 are all extracted. Therefore, after taking a picture, the B area 720 is edited and candidate-corrected. And the C region 730 has to be processed in gray.

Referring to FIG. 8, the image processing apparatus may set the color extraction region 810 and extract pixels 820 of a desired color only within the color extraction region 810.

Since all pixels other than the color extraction area 810 are grayed out, only red corresponding to the A area 710 of FIG. 7 may be extracted.

Since only the red color of the A region 710 can be extracted and photographed immediately in the camera preview state of the mobile terminal, a post-processing operation for removing the red color of the B region 720 and the C region 730 is omitted as shown in FIG. 7. The advantage is that you can.

9 illustrates a preview image in which two or more colors are extracted by an image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 9, (a) shows a preview image from which red and yellow are extracted from the captured image, and (b) shows a preview image from which purple, green and blue are extracted from the captured image.

The image processing apparatus may extract two or more colors at the same time. When two buttons, color 1 and color 2 are set, the image processing apparatus may extract the first color when a color 1 button and an arbitrary position of the screen are touched by the user. In addition, the image processing apparatus may extract the second color when the color 2 button and other arbitrary positions of the screen are touched.

Control bars for sensitivity adjustment on the screen of the mobile terminal may be displayed independently synchronized when the colors 1 and 2 are displayed on the screen. That is, the control bar for color 1 may be displayed when color 1 is activated, and the control bar for color 2 may be displayed when color 2 is activated.

Bright and dark shades exist in a single color, so a single color extraction may not be perfect. Therefore, in this case, when two or more color extraction methods are used, even if one color is extracted, each of the bright and dark portions can be extracted more completely.

10 illustrates a case in which the color extracted by the image processing apparatus according to the exemplary embodiment is converted into another color.

Referring to FIG. 10, when a desired color portion is touched by the user in the preview screen, the image processing apparatus may display the palette 1020 on the preview screen.

The image processing apparatus may convert the color of the touched point by using the color selected in the palette 1020. For example, when red is touched and extracted, the image processing apparatus may convert red to blue when blue is input from the palette 1020.

The color conversion function may also set the area 1010 to be converted only within the area.

The present invention provides a color extraction area designation function so that when a specific color is extracted, only the color is extracted within the designated area, so that the color of this part is treated as a color different from the specific color even though there is the same color outside the designated area. to provide.

The methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

Claims (17)

A display unit which displays a preview image;
A color information obtaining unit obtaining color information of a preview data pixel corresponding to an input pixel among pixels of a screen displaying the preview image;
A color extraction range determiner which compares sizes of color component values of the preview data pixels based on the obtained color information, and determines an extraction range of colors to be extracted from the preview data by using a ranking determined according to a comparison result; And
A controller for determining pixels to be extracted by determining whether color information of each pixel constituting the preview data is included in the extracted range of the color;
And the image processing apparatus. The method of claim 1,
The color information
It is characterized in that one of the RGB (RGB, Red Green Blue) value and YUV (YUV, luma chroma) value
Image processing apparatus. 3. The method of claim 2,
A first coordinate acquiring unit which acquires coordinates of pixels touched from among pixels of a screen displaying a preview image of the mobile terminal;
A preview data second coordinate acquisition unit configured to acquire coordinates of the preview data pixel corresponding to the coordinates of the touch input pixel based on the resolution of the screen and the resolution of the preview image;
A data format converter for converting a data format of an image photographed by the mobile terminal into a data format including the color information; And
An algi ratio separator for separating the red component value, the green component value and the blue component value of each pixel of the image photographed by the mobile terminal
Further comprising: 3. The method of claim 2,
A first coordinate acquiring unit which acquires coordinates of pixels touched from among pixels of a screen displaying a preview image of the mobile terminal;
A preview data second coordinate acquisition unit configured to acquire coordinates of the preview data pixel corresponding to the coordinates of the touch input pixel based on the resolution of the screen and the resolution of the preview image;
A data format converter for converting a data format of an image photographed by the mobile terminal into a data format including the color information; And
Y-YV separator for separating the luminance component value, the difference between the luminance component and the blue component, and the difference between the luminance component and the red component of each pixel of the image photographed by the mobile terminal
Further comprising: The method of claim 1,
The color extraction range determiner
A size comparison unit comparing a size of a red component value, a green component value, and a blue component value of the preview data pixel to determine a rank; And
Determining a first red coefficient which determines the minimum extraction range of the red component value and a second red coefficient that determines the maximum extraction range of the red component value based on the determined rank,
Determining a first green coefficient that determines the minimum extraction range of the green component value and a second green coefficient that determines the maximum extraction range of the green component value based on the determined rank,
A coefficient determination unit that determines a first blue coefficient that determines the minimum extraction range of the blue component value and a second blue coefficient that determines the maximum extraction range of the blue component value based on the determined rank
And the image processing apparatus. 6. The method of claim 5,
The coefficient determination unit
The higher the determined rank is, the larger the value of the coefficient determining the minimum extraction range and the value of the coefficient determining the maximum extraction range are determined.
Image processing apparatus. The method of claim 1,
The control unit
The red component value, the green component value, and the blue component value of each of the pixels constituting the preview data are the minimum and maximum extraction ranges of the red component value determined by the color extraction range determiner, the minimum extraction range of the green component values, and A determination unit determining whether the maximum extraction range, the minimum extraction range of the blue component value, and the maximum extraction range are included; And
Among the pixels constituting the preview data, the red component value, the green component value, and the blue component value of the pixels are the minimum and maximum extraction ranges of the red component value, the minimum and maximum extraction ranges of the green component value. And a color converter configured to convert colors of pixels not included in the minimum extraction range and the maximum extraction range of the blue component value into colors different from those of the preview data pixel.
And the image processing apparatus. The method of claim 1,
Sensitivity control unit for adjusting at least one of the minimum value and the maximum value of the extraction range of the color
Further comprising: The method of claim 1,
A processing area determiner configured to determine an area in which the controller is to operate on the screen; And
A color conversion unit for converting the color of the pixels of the region in which the control unit does not operate on the screen to a color different from the color of the preview data pixel
Further comprising: The method of claim 1,
A display unit configured to display a sensitivity adjustment bar for adjusting the sensitivity of the color information acquired by the color information acquisition unit and the color information on the screen;
Further comprising: The method of claim 1,
A color converter converting the colors of the pixels extracted by the controller into at least one of pre-stored colors
Further comprising: The method of claim 1,
The color information obtaining unit obtains color information of preview data pixels corresponding to two or more pixels sequentially input from pixels of a screen displaying a preview image of a mobile terminal,
The color extraction range determiner determines extraction ranges of two or more colors to be extracted from the preview data based on color information of the preview data pixels,
The controller determines whether to extract pixels by determining whether color information of each pixel constituting the preview data is included in the extracted ranges of two or more colors.
Image processing apparatus. The method of claim 3,
The first coordinate acquiring unit
Acquiring the coordinates of the pixel corresponding to the preset focus displayed on the screen among the pixels displaying the preview image of the mobile terminal
Image processing apparatus. Displaying a preview image;
Acquiring color information of a preview data pixel corresponding to an input pixel among pixels of a screen displaying the preview image;
Comparing the magnitudes of the color component values of the preview data pixels based on the obtained color information, and determining an extraction range of colors to be extracted from the preview data by using the ranking determined according to the comparison result; And
Determining pixels to be extracted by determining whether color information of each pixel constituting the preview data is included in the extracted range of the color;
And an image processing method. 15. The method of claim 14,
Determining the extraction range of the color
Determining a rank by comparing sizes of red component values, green component values, and blue component values of the preview data pixel;
Determining a first red factor determining the minimum extraction range of the red component value and a second red factor determining the maximum extraction range of the red component value based on the determined rank;
Determining a first green coefficient that determines the minimum extraction range of the green component value and a second green coefficient that determines the maximum extraction range of the green component value based on the determined rank; And
Determining a first blue coefficient that determines the minimum extraction range of the blue component value and a second blue coefficient that determines the maximum extraction range of the blue component value based on the determined rank
And an image processing method. 16. The method of claim 15,
The determining of the first red factor, the second red factor, the first green factor, the second green factor, the first blue factor, and the second blue factor may include:
The higher the determined rank is, the larger the value of the coefficient determining the minimum extraction range and the value of the coefficient determining the maximum extraction range are determined.
Image processing method. 15. The method of claim 14,
The determining of the pixels to extract is
A red component value, a green component value, and a blue component value of each of the pixels constituting the preview data are the minimum and maximum extraction ranges of the determined red component value, the minimum and maximum extraction ranges of the green component value, and the blue component. Determining whether the value is included in a minimum extraction range and a maximum extraction range; And
Among the pixels constituting the preview data, the red component value, the green component value, and the blue component value of the pixels are the minimum and maximum extraction ranges of the red component value, the minimum and maximum extraction ranges of the green component value. Extracting pixels included in a minimum extraction range and a maximum extraction range of the blue component value;
And an image processing method.

Images