KR20060011639A - Method for display the image in wireless terminal - Google Patents

Abstract

According to an aspect of the present invention, a method of displaying image data in a portable terminal includes: capturing a moving image, detecting a movement of a subject in the captured moving image data when selecting a motion tracking menu from the captured moving image; And a process of recognizing the movement path of the subject, and outputting and displaying image data information of the subject on which the movement is detected according to the recognized movement path.

Handwriting, M-JPEG, Video, Position Tracking, Color Tracking

Description

How to display image data on a mobile terminal {METHOD FOR DISPLAY THE IMAGE IN WIRELESS TERMINAL}             

1 is a view showing the configuration of a portable terminal according to an embodiment of the present invention.

2 is a diagram illustrating a configuration of a general M-JPEG encoder.

3 is a flowchart illustrating a process of displaying image data using a handwriting mode in a portable terminal according to a first embodiment of the present invention.

4 is a flowchart illustrating a process of displaying image data using a handwriting mode in a portable terminal according to a second embodiment of the present invention.

FIG. 5 is a flowchart illustrating a process of displaying image data using a handwriting mode in a portable terminal according to a third embodiment of the present invention; FIG.

6 is a flowchart illustrating a process of performing the handwriting mode of the present invention.

7 is an exemplary view showing image data using motion tracking or color tracking in the handwriting mode of the present invention.

The present invention relates to a method of displaying image data, and more particularly, to a method of displaying a still image or a moving image by recognizing a position variation of a specific color or shape among optically input image data and connecting the changed positions.

Since the development of wired telephones, communication technology has made rapid progress from radios capable of talking at short distances without a wired connection between two parties, to cordless phones for 900MHz and mobile phones capable of making calls even in high-speed cars.

In particular, in recent years, the function of the portable terminal, which has only stayed in simple voice transmission, has been gradually expanded to enable the transmission of text messages and various information, as well as the Internet connection, and equipped with a camera function so that the user can take a picture anytime and anywhere.

A portable terminal equipped with such a camera function receives an image of a subject through a CCD sensor and displays the image of the subject on a display unit.

However, since a portable terminal having a conventional camera function displays only an optical image photographed by the camera, the information contained in the factual information is excellent while not sufficiently conveying the emotions and feelings intended to be conveyed by the user or the photographed subject. There was a problem.

Accordingly, an object of the present invention relates to a method for displaying image data in a portable terminal, and in particular, recognizes a positional change of a specific color or shape among optically input image data and connects the changed position to display a still image or a video. It is about how to.

In order to achieve the above object, the present invention provides a method of displaying image data in a portable terminal, the process of capturing a video and detecting a movement of a subject in the captured video data when selecting a motion tracking menu from the captured video. And a process of recognizing a movement path of the detected subject, and outputting and displaying image data information of the subject on which the movement is detected according to the recognized movement route.

DETAILED DESCRIPTION Hereinafter, detailed descriptions of preferred embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that in the following description, only parts necessary for understanding the operation and action according to the present invention will be described, and descriptions of other parts will be omitted so as not to distract from the gist of the present invention.

According to an exemplary embodiment of the present invention, description of specific details such as a transmission speed of a video signal of a camera, a video signal size, and a video signal size of a display unit will be omitted. It will be apparent to those skilled in the art that the present invention may be readily practiced without these specific details and by modifications thereof.                     

In addition, according to an embodiment of the present invention, the handwriting mode is a mode for recognizing a position change of a specific color or shape among optical image data input through a camera and connecting the changed position to display a still image or a video. it means.

1 is a diagram illustrating a configuration of a portable terminal according to an embodiment of the present invention.

Referring to FIG. 1, the RF unit 21 performs communication of a portable telephone. The RF unit 21 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal.

Modem 23 includes a transmitter for encoding and modulating the transmitted signal, a receiver for demodulating and decoding the received signal, and the like.

The audio processor 25 may configure a codec, and the codec includes a data codec for processing packet data and an audio codec for processing audio signals such as voice. The audio processor 25 converts and reproduces the digital audio signal received from the modem 23 through the audio codec, or converts the transmitted analog audio signal generated from a microphone into a digital audio signal through the audio codec. Performs the function to send to 23. The codec may be provided separately or included in the controller 10.

The keypad 27 has keys for inputting numeric and text information and function keys for setting various functions. In addition, the keypad 27 may include a handwriting mode key, a video recording key, and the like according to an embodiment of the present invention.                     

The memory 29 may be composed of program memory and data memories. The program memory may include a program for controlling a general operation of the portable phone, a program for controlling a general operation of camera shooting in a camera shooting mode, and an optically input image in a handwriting mode according to an embodiment of the present invention. Programs that display position or moving images by recognizing color or shape positional changes are stored. When the handwriting mode is selected from among the stored image data, programs that process the stored image data in the handwriting mode are stored. In addition, the data memory temporarily stores data generated during the execution of the programs.

The controller 10 performs a function of controlling the overall operation of the portable telephone. In addition, the controller 10 may include the modem 23. In addition, the controller 10 displays a handwriting menu when selecting a handwriting mode according to an embodiment of the present invention, and when selecting a motion among the handwriting menus, compares each frame with a size value of a pixel whose position of a specific shape changes. Recognize color value and position value. In addition, when selecting a color from the hand-painted menu, by comparing the respective frames to recognize the size value, color value and position value of the pixel to change the position of a specific color. In addition, the controller 10 may include the modem 23 and a codec.

The camera 50 photographs image data and includes a camera sensor that converts the photographed optical signal into an electrical signal. It is assumed here that the camera sensor is a CCD sensor.

The signal processor 60 converts the video signal output from the camera 50 into an image signal. The signal processor 60 may be implemented as a digital signal processor (DSP). The image processor 70 performs a function of generating screen data for displaying an image signal output from the signal processor 60.

The image processor 70 transmits an image signal received under the control of the controller 10 in accordance with the standard of the display unit 80, and compresses and decompresses the image data using an image coater. It is assumed here that the image codec is an M-JPEG codec. Also, the start address value of the image data output to the display unit 80 is transmitted or the start address value is changed and set under the control of the control unit 10.

The display unit 80 displays image data output from the image processing unit 70. The display unit 80 may use an LCD. In this case, the display unit 80 may include an LCD controller, a memory capable of storing image data, and an LCD display device. In this case, when the LCD is implemented by using a touch screen method, the keypad 27 and the LCD may be input units. The display unit 80 includes an image data display unit for outputting the image data.

Referring to the operation of the portable telephone with reference to FIG. 1, when the user sets a dialing mode after performing a dialing operation through the keypad 27, the controller 10 detects this and processes the dial information received through the modem 23. After that, the RF unit 21 converts the signal into an RF signal and outputs the RF signal. After the counter subscriber generates a response signal, it detects it through the RF unit 21 and the modem 23. Thereafter, a user establishes a voice call path through the audio processor 25 to perform a communication function. In addition, in the incoming mode, the controller 10 detects the incoming mode through the modem 23 and generates a ring signal through the audio processor 25. Thereafter, when the user responds, the controller 10 detects this, and a voice call path is formed through the audio processor 25 to perform a communication function. In the outgoing and incoming modes, voice communication is described as an example, but a data communication function for communicating packet data and image data in addition to the voice communication may be performed. In addition, when performing a standby mode or text communication, the controller 10 displays text data processed through the modem 23 on the display 80.

Also, the portable terminal may perform an operation of capturing a person or an environment and displaying or transmitting the image on a video screen. First, the camera 50 may be mounted on a portable terminal or connected to a predetermined location outside. That is, the camera 50 may be an external camera or an internal camera. In addition, the camera 50 may use a charge coupled device (CCD) sensor. The image captured by the camera 50 is converted into an electrical signal by an internal CCD sensor and then applied to the signal processor 60. Then, the signal processor 60 converts the image signal into digital image data and outputs the image signal to the image processor 70. The image processing unit 70 compresses and expands the image data and displays the same on the display unit 80. In addition, in the handwriting mode, the controller 10 recognizes a positional change of a specific color or shape of an image captured by the camera 50 and displays the still image or a moving image on the display unit 80.

2 is a diagram illustrating a configuration of a general M-JPEG encoder.

Referring to FIG. 2, the M-JPEG image codec 200 includes a discrete cosine transform (DCT) unit 201, a quantization 202, and an entropy coder 203. The discrete cosine transform unit 201 divides and processes the input image into one block unit composed of 8 ㅧ 8 pixels. In other words, by using the cosine signal as a basis function for each block, a video signal having a high correlation between adjacent pixels is generally transformed into a frequency domain having no correlation with each other. Therefore, the DCT coefficient representing the low frequency component has a large value, and the DCT coefficient representing the high frequency component has a very small value.

Quantization 202 is a process of reducing the number of bits of significant digits by dividing a DCT coefficient value obtained through the discrete cosine transform 101 by a quantization coefficient according to each frequency. Therefore, high frequency coefficients having relatively small values become nearly zero by quantization.

The entropy coder 203 makes the quantized discrete cosine transform frequency coefficient values into a bit string consisting of 0 and 1 in consideration of their occurrence probability. That is, a process of encoding components whose spatial redundancy has been removed by discrete cosine transform and quantization.

Referring to FIG. 2, the operation of M-JPEG encoding the image data is performed. The M-JPEG image codec 200 receives image data from the signal processor 60. The input image data provides 64 DCT functions through a discrete cosine transform unit 201 to convert the image data from the spatial domain to the frequency domain. The 64 DCT coefficient values obtained through the discrete cosine are divided into quantization coefficient values through quantization 202 to reduce the number of significant digits. Thereafter, the quantized DCT coefficients are encoded and compressed into bit forms of 0 and 1 according to their probability distribution through entropy coder 203. In addition, decoding which decodes the data encoded in the bit form of 0 and 1 into the original image data is performed by performing the above processes in reverse.

3 is a flowchart illustrating a process of displaying image data using the handwriting mode in a portable terminal according to a first embodiment of the present invention, and FIG. 6 is a flowchart illustrating a process of performing the handwriting mode of the present invention. . 7 is an exemplary diagram showing image data using motion tracking in the handwriting mode of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1, 6, and 7.

Referring to FIG. 3, when the user inputs a camera menu key using the keypad 27 in the standby state of step 301, the controller 10 detects and displays the same in step 303. The key for driving the camera mode may be located on a navigation key of the keypad 27 or may be displayed by selecting a menu using a menu key.

When the user selects the video recording menu from the displayed camera menu by using the keypad 27, the controller 10 detects it in step 305 and proceeds to step 307 to enter the video recording mode. When the user starts shooting in the video recording mode in step 307, the control unit 10 transmits the image signal acquired by the camera 50 to the image processing unit 70 as the image data through the signal processing unit 60, as shown in FIG. Display. The controller 10 compresses the acquired image data by the image processor 70 and stores the image data in the memory 29 until a moving image recording end key is input.

Then, when the user selects the handwriting menu using the keypad 27, the controller 10 detects it in step 309 and enters the handwriting mode, and in step 311, controls the memory 29 and the display unit 80 to display the handwriting menu. . When the user selects the motion tracking from the handwriting menu using the keypad 27, the controller 10 detects it in step 313 and proceeds to step 321 to process the captured image data in the handwriting mode. However, if the user selects the color tracking from the handwriting menu using the keypad 27, the control unit 10 detects this in step 315 and displays the color menu in step 317. When the user selects a specific color from the color menu by using the keypad 27, the controller 10 detects it in step 319 and proceeds to step 321 to process the captured image data in the handwriting mode. In more detail with reference to step 321, the controller 10 controls the image processor 70 to decode the compressed image data to extend the image data in step 601. The controller 10 sequentially compares the decoded image data for each frame in step 603 and detects the change in step 605 if there is a change. In operation 607, the controller 10 recognizes the changed image data information, that is, a pixel size value, a color value, and a position value. Here, if the motion tracking is selected from the handwriting menu, the position of the specific shape is compared for each frame, and if the position of the specific shape is changed, the pixel size value, color value, and image data information of the changed specific shape are changed. Recognize the position value. In operation 609, the controller 10 controls the image processor 70 and the display 80 to output the changed pixels to the display 80 according to the recognized size value, color value, and position value as shown in FIG. 7B. .

 In addition, if the color tracking is selected in the hand-painting menu, the position of the specific color is changed by comparing the position of the specific color for each frame. And position values. In operation 609, the controller 10 controls the image processor 70 and the display 80 to output the changed pixels to the display 80 according to the recognized size value, color value, and position value as shown in FIG. 7C. .

Here, each of the changed pixels may be output in one frame and displayed as a still image, and each of the changed pixels may be output in multiple frames and displayed in a moving image.

4 is a flowchart illustrating a process of displaying image data using the handwriting mode in a portable terminal according to a second embodiment of the present invention, and FIG. 6 is a flowchart illustrating a process of performing the handwriting mode of the present invention. . 7 is an exemplary diagram showing image data using motion tracking in the handwriting mode of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1, 6, and 7.

    Referring to FIG. 4, when the user inputs a camera menu key using the keypad 27 in the standby state in step 401, the controller 10 detects this in step 403. The key for driving the camera mode may be located on a navigation key of the keypad 27 or may be displayed by selecting a menu using a menu key.

When the user inputs a video viewing menu key using the keypad 27, the controller 10 detects this in step 405 and proceeds to step 407 to control the memory 29 and the display unit 80 to display the stored video list. When the user selects the image data to be processed in the handwriting mode from the displayed video list by using the keypad 27, the controller 10 detects it in step 409 and controls the memory 29 and the display unit 80 in step 411 to select the selected video. Is displayed as shown in FIG. When the user selects the handwriting menu using the keypad 27, the controller 10 detects this in step 413 and controls the memory 29 and the display unit 80 in step 415 to display the handwriting menu. When the user selects the motion tracking from the handwriting menu using the keypad 27, the controller 10 detects it in step 417 and proceeds to step 425 to process the selected image data in the handwriting mode.

However, when the user selects the color tracking from the handwriting menu using the keypad 27, the controller 10 detects this in step 419 and displays the color menu in step 421. When the user selects a specific color from the color menu using the keypad 27, the controller 10 detects it in step 423 and proceeds to step 425 to process the selected image data in the handwriting mode. In more detail with reference to step 425, the controller 10 controls the image processor 70 to decode the compressed image data to extend the image data in step 601. The controller 10 sequentially compares the decoded image data for each frame in step 603 and detects the change in step 605 if there is a change. In operation 607, the controller 10 recognizes the size value, color value, and position value of the changed pixel. Here, if motion tracking is selected from the handwriting menu, the position of the specific shape is compared for each frame, and if the position of the specific shape is changed, the size value, color value, and position value of the changed pixel are recognized. In operation 609, the controller 10 controls the image processor 70 and the display 80 to output the changed pixels to the display 80 according to the recognized size value, color value, and position value as shown in FIG. 7B. .

 In addition, if the color tracking is selected in the hand-painting menu, the position of the specific color is changed by comparing the position of the specific color for each frame. In step 607, the controller 10 determines the size value, the color value, and the position value of the changed pixel. Recognize. In operation 609, the controller 10 controls the image processor 70 and the display 80 to output the changed pixels to the display 80 according to the recognized size value, color value, and position value as shown in FIG. 7C. .

Here, each of the changed pixels may be output in one frame and displayed as a still image, and each of the changed pixels may be output in multiple frames and displayed in a moving image.

5 is a flowchart illustrating a process of displaying image data using the handwriting mode in a portable terminal according to a third embodiment of the present invention, and FIG. 6 is a flowchart illustrating a process of performing the handwriting mode of the present invention. . 7 is an exemplary diagram showing image data using motion tracking in the handwriting mode of the present invention.                     

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1, 6, and 7.

Referring to FIG. 5, when the user inputs a camera menu key using the keypad 27 in the standby state in step 501, the controller 10 detects this in step 503. The key for driving the camera mode may be located on a navigation key of the keypad 27 or may be displayed by selecting a menu using a menu key.

When the user inputs a video menu key using the keypad 27, the controller 10 detects this in step 505 and proceeds to step 507 to control the memory 29 and the display unit 80 to display a video menu. When the user selects a hand drawing from the video menu using the keypad 27, the controller 10 detects it in step 509 and enters the hand drawing mode, and in step 511 controls the memory 29 and the display unit 80 to draw a hand drawing menu. Is displayed. When the user selects the motion tracking from the handwriting menu using the keypad 27, the controller 10 detects this in step 513 and proceeds to step 521 to enter the video recording mode. However, if the user selects the color tracking from the handwriting menu using the keypad 27, the controller 10 detects it in step 515 and displays the color menu in step 517. When the user selects a specific color from the color menu using the keypad 27, the controller 10 detects it in step 519 and proceeds to step 521 to enter the video recording mode. When the user starts shooting in the moving picture photographing mode in step 521, the controller 10 transmits the image signal acquired by the camera 50 to the image processing unit 70 through the signal processing unit 60 as image data, and then displays on the display unit A of FIG. Mark it together. The controller 10 compresses the acquired image data by the image processor 70 and stores the image data in the memory 29 until a moving image recording end key is input.

When the user inputs the video recording end key using the keypad 27, the controller 10 detects this in step 523 and proceeds to step 525 to process the stored image data in the handwriting mode. In more detail with reference to step 525, the control unit 10 controls the image processing unit 70 to decode the compressed image data to extend the image data in step 601. The controller 10 sequentially compares the decoded image data for each frame in step 603 and detects the change in step 605 if there is a change. In operation 607, the controller 10 recognizes the size value, color value, and position value of the changed pixel. Here, if motion tracking is selected from the handwriting menu, the position of the specific shape is compared for each frame, and if the position of the specific shape is changed, the size value, color value, and position value of the changed pixel are recognized. In operation 609, the controller 10 controls the image processor 70 and the display 80 to output the changed pixels to the display 80 according to the recognized size value, color value, and position value as shown in FIG. 7B. .

 In addition, if the color tracking is selected in the hand-painting menu, the position of the specific color is changed by comparing the position of the specific color for each frame. In step 607, the controller 10 determines the size value, the color value, and the position value of the changed pixel. Recognize. In operation 609, the controller 10 controls the image processor 70 and the display 80 to output the changed pixels to the display 80 according to the recognized size value, color value, and position value as shown in FIG. 7C. do.

Here, each of the changed pixels may be output in one frame and displayed as a still image, and each of the changed pixels may be output in multiple frames and displayed in a moving image.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by the equivalents of the claims.

As described in detail above, the present invention, in a portable terminal having a camera function, designates a specific shape or a specific color to photographed or stored video data, tracks a position where the specified specific shape or specific color moves, and connects the location. By displaying a curve or a figure as a still image or a video, the user who takes a video or a subject to be photographed can sufficiently transmit the emotions and feelings to be delivered.

Claims (8)

In the method for displaying image data in a portable terminal, The process of shooting a video, Detecting a movement of a subject in the captured video data when selecting a motion tracking menu from the captured video; Recognizing a movement path of the detected subject; And outputting and displaying image data information of a subject in which the movement is detected according to the recognized movement route. The method of claim 1, wherein the detecting of the movement of the subject from the captured video data comprises: Comparing the frames constituting the captured video data with each other; And detecting the image data information corresponding to the moving subject in each of the compared frames. The method of claim 1, wherein the recognizing a movement path of the detected subject comprises: And recognizing by connecting the position values of pixels in the image data information corresponding to the moving subject. The method of claim 1, wherein the outputting and displaying the image data information comprises: And outputting the detected image data information as one frame and displaying the detected image data as a still image. The method of claim 1, wherein the outputting and displaying the image data information comprises: And outputting the detected image data information in at least one frame to display the detected video data information. The method of claim 1, further comprising: displaying a color list when a color tracking menu is selected in the captured video; Detecting a movement of the selected specific color in the stored video data when selecting a specific color from the displayed color list; Recognizing the detected motion path of the specific color; And outputting and displaying the image data information of the specific color in which the motion is detected according to the recognized motion path of the specific color. The method as claimed in claim 1, further comprising the step of outputting and displaying the image data information of the subject on which the movement is detected and storing the captured video when a storage key is input. In the method for displaying image data in a portable terminal, When selecting a motion tracking menu, enters a mode for detecting a movement of a subject from video data and waits for the video data selection; Detecting a movement of the subject in the selected video data when selecting the video data; Recognizing a movement path of a subject in which the movement is detected; And outputting and displaying image data information of a subject in which the movement is detected according to the recognized movement route.

Images