KR102167774B1 - Telephone application image control method, program and computer readable recording medium - Google Patents

Abstract

The present invention relates to a telephone application image processing method capable of generating a new image while a telephone application is executed. The telephone application image processing method comprises the steps of: displaying an image area, a keypad area, and a number display area by executing a telephone application; displaying an image in the image area; and displaying a number displayed on the image area as the number display area by a touch input performed on the keypad area.

Description

Telephone application image control method, program and computer readable recording medium}

The present invention relates to image processing of a phone application, and more particularly, to a method, a program, and a computer-readable recording medium for displaying an image in a predetermined image area and correcting the displayed image while the phone application is executed.

To make a call using a mobile phone, it is essential to use a phone application.

While the phone application is running, the user searches for and selects a number stored in the mobile phone, or directly inputs the number through the keypad and sends it.

Until now, the method of searching for a number stored in a mobile phone has been improved in relatively various ways.

However, the method of directly entering a number that is not stored is mainly focused on visual changes such as the shape, size, arrangement, and color of the keypad buttons.

For example, in order to enter a phone number used for one-time sending of business cards, prints, etc., including courier service, quick service, delivery agency, parking request, and one-time transmission of a parked person, the user visually inputs the desired phone number To confirm. From this point on, the user's gaze is repeatedly performed to watch the phone number that does not need to be memorized, the keypad of the mobile phone, and the number entered through the keypad alternately. The shift of the user's distracting gaze and the complex input operation of the keypad inevitably have a high error rate. Moreover, there is a need to develop a technology capable of improving such inconvenience to users who need to frequently send one-time numbers or have poor eyesight.

The prior art can be used to be displayed higher than the phone app as an image editing function separate from the phone app, but the image cannot be re-edited in the upper displayed state, and there is a problem of executing individually, and the image to be edited is There is a problem in that it is inconvenient to run a separate app that generates an image, and a considerable amount of time is wasted for various operations.

Accordingly, there is a need to develop a technology that can operate more efficiently and intuitively in the process of entering a phone number using a keypad of a phone app.

While the phone application is running, an image can be photographed and displayed, or a stored image can be displayed.

In addition, the displayed image can be corrected while the phone application is running.

In addition, the displayed image can be converted into text and displayed while the phone application is running.

In order to achieve the above object, an image processing method of a phone application according to an embodiment of the present invention includes an image area in which an image is displayed, a keypad area, and a number displayed by the keypad input while the phone application is executed on a display. What is claimed is: 1. A method for processing an image of a phone application including an area, the method comprising: (a) displaying an image area, a keypad area, and a number display area by executing the phone application; (b) displaying an image in the image area; (c) displaying a number displayed in the image area as the number display area by a touch input performed on the keypad, wherein the image area, the keypad area, and the number display area are displayed at a predetermined position on the display. I can.

In addition, the image may be an image captured by the function of the phone application in step (b).

Alternatively, as for the image, the image last stored before step (a) is first displayed in step (b), and another image previously stored by the user may be selected and displayed.

In addition, step (b), while maintaining the size of the image area, the keypad area, and the number display area, adjust the scale of the image displayed in the image area by a pinch input performed in the image area, or touch An image correction step of moving a part of the image out of the image area by a drag input may be included.

Alternatively, in response to a touch input performed on the image area, the image is expanded and displayed over the entire display, and the image area, the keypad area, and the number display area are not displayed, and the border of the image area is the expanded image. Displaying a correction frame separated from and; Adjusting the scale of the expanded image by a pinch input performed while maintaining the touch input, or moving at least a part of the image out of the correction frame to the correction frame by a touch drag input; In response to the release of the touch input, the correction frame is redisplayed as an image region, and the keypad region and the numeric display region are redisplayed, and the image in the correction frame is displayed as the redisplayed image region, , The size and position of the correction frame may be fixed so as not to be changed by a touch input.

Alternatively, in response to a touch input performed on the image area, the image is expanded and displayed over the entire display, and the image area, the keypad area, and the number display area are not displayed, and the border of the image area is the expanded image. Displaying a correction frame separated from and; Adjusting the scale of the expanded image with a pinch input performed while maintaining the touch input, or moving the correction frame to at least a part of the image with a touch drag input, but leaving the display at the edge of the display Moving an area out of the image in a direction opposite to the first direction by a touch drag input input in one direction; And in response to the release of the touch input, the correction frame is re-displayed as an image region, and the keypad region and the number display region are re-displayed, and the image in the correction frame is displayed as the re-displayed image region. And, the first direction is at least one of a top, bottom, left, and right direction of the display, and the size of the correction frame may not be changed.

As another example, in the image processing method of a phone application in which an image area in which an image is displayed, a keypad area in a state in which the phone application is executed, a numeric display area and a text conversion button area displayed by the keypad input are distinguished, (a) Displaying an image area, a keypad area, a number display area, and a text conversion button area by executing the phone application; (b) displaying an image in the image area; (c) converting the image into text through a character recognition program; And (d) automatically displaying the converted text in the number display area, wherein the image is an image captured by the function of the phone application in step (b), the image area, the keypad area, The number display area and the character conversion button area may be displayed at predetermined positions. In addition, the character recognition program may include an optical character reader (OCR) program.

According to the present invention, there is an advantage in that a keypad can be input while correcting an image displayed in a predetermined area while a phone application is running.

In addition, there is an advantage in that a new image can be created while the phone application is running.

In addition, it is possible to quickly, accurately and conveniently enter a phone number on a mobile phone.

1 is a block diagram illustrating a display device for executing a phone application according to an embodiment of the present invention.
2, 3, and 10 are flowcharts illustrating a method of processing an image of a phone application according to an embodiment of the present invention.
4 to 9 and 11 are views showing an example of an image processing method of a phone application according to an embodiment of the present invention.

For a detailed description of the present invention to be described later, reference is made to the accompanying drawings, which illustrate specific embodiments in which the present invention may be practiced. These embodiments are described in detail sufficient to enable a person skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different from each other, but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described in the present specification may be implemented in other embodiments without departing from the spirit and scope of the present invention in relation to one embodiment. In addition, it should be understood that the arrangement of individual components in each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Therefore, the detailed description to be described below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, those that have equivalent or equivalent modifications to those claimed by the claims can be said to belong to the scope of the present invention. have. The same reference numerals referenced or illustrated in a plurality of drawings refer to the same elements, and the term “and/or” may include any one of a plurality of items and all combinations of one or more of them. The first component and the second component used to distinguish different components are not limitedly interpreted as terms themselves, and the following first component is a second component without departing from the technical idea of the present invention. It can be expressed as

The display having a touch panel described in the present specification includes an OLED that displays objects such as various software programs, icons, texts and images, TFT-LCDs, e-ink displays, touch displays with touch panels, Includes smart boards and prompters.

1 is a block diagram illustrating a display device according to an embodiment of the present invention.

Referring to FIG. 1, the display 100 includes a display unit 110, an input unit 120, a control unit 130, and a storage unit 140. The display unit 110 may be a panel that displays the above-described object according to a user's input performed on the input unit 120. The input unit 120 may be configured as a touch panel that provides a user input interface. In addition, the display unit 110 and the input unit 120 may be separated and interlocked in a wired or wireless form, or may be combined into one. The input signal generated to be displayed on the display unit 110 is an input signal through the input unit 120 by a user's finger or a touch pen, or is generated by a wired/wireless mouse, a touch pad, a remote controller, etc., and the control unit 130 ) May be an input signal that communicates with wired or wirelessly.

The control unit 130 may be configured to include hardware including at least one processor and an operating system (OS), and determine an input signal through the input unit 120 and display it on the display unit 110, but execute a phone application. And applications and programs related to image processing may be displayed on the display unit 110 in a form created, processed, and regenerated through the storage unit 140 so that an application and a program related to the image processing are operated and displayed. The storage unit 140 may store a phone application and an image processing method of the phone application according to the present specification, a camera, image storage, image editing, OCR, QR, and bar code recognition commands, data, and programs. A camera, a program for storing images and editing images, and an application may be in a form that is distinct from a phone application, or may be a module type included in a phone application.

Image processing method of phone application

2, 3, and 10 are schematic flowcharts illustrating a method of processing an image of a phone application (hereinafter, a phone application) according to an embodiment of the present invention.

4 to 9 and 11 are diagrams showing an example of an image processing method of a phone app according to an embodiment of the present invention.

In step S201 of FIG. 2, an image area, a keypad area, and a number display area are divided and displayed by execution of the phone app.

Referring to FIG. 4A, the phone app executed by the user is executed and displayed on the display 100, and the camera 401 function and the storage 402 are displayed in the image area (1), It may be divided into a keypad area 2 and a number display area 3 and configured at a predetermined position. In this case, the location of each area and the size of each area may be displayed differently from the illustrated form, and the camera 401 function and the storage 402 may be composed of buttons of a keypad different from the drawing. In addition, it may include images such as a navigation menu, time, battery, etc. that are not related to the phone app, and may be displayed and configured by including a search and selection button for a contact stored in a call history related to the phone app.

In step S203 of Fig. 2, an image is displayed as an image area while the phone app is executed.

In (a) of FIG. 4, with the touch input 403 for executing the function of the camera 401, the physical telephone number 404 printed or written in (b) is touched and photographed. In this case, the location where the touch input is performed may be indicated by a photographing button or may be an undefined location on the image area 1. In addition, when photographing in an environment in which the amount of light is insufficient, the camera flash may be automatically operated based on a preset illuminance or may be selectively operated by a user.

Although not shown, as a touch input 403 for executing the camera 401 in FIG. 4A, the standby state is the entire screen of the display 100, or at least the size of the image area 1 is The border of the area 1 may be displayed by highlighting it with a color, a shade, a border line, etc. so as to distinguish it from the entire image.

In (d) of FIG. 4, numbers in the image area 1 can be displayed as a number display area 3 by a touch input 406 performed in the keypad area 2. In (e) of FIG. 4, the number in the image area 1 can be transmitted as the keypad area 2 and the number indicated by the number display area 3 as a user input.

In step S201 of FIG. 2 according to an embodiment of the present invention, the image displayed in the image area 1 may be an image created before or immediately before execution of the phone app, and the created image is edited or edited. In the previous state, it can be automatically displayed as the image area 1 by being executed as a phone app menu in the image editing menu list.

According to an embodiment of the present invention with reference to FIG. 5, step S203 of FIG. 2 automatically transfers the image 501 last stored on the device 100 to the image area 1 at the same time as the phone app is executed. It can be set to be displayed or blank.

Also, regardless of the display of the last stored image 501, one or more images stored by the storage touch input 502 may be displayed as the image area 1. The user may perform a touch input 503 for selecting one image in (b) of FIG. 5 and display the image area 1 in (c).

Alternatively, the user may touch the storage 504 of (c) again to select another image and display it as the image area 1.

In this way, the phone app is not hidden or terminated in the background, and the saved image is searched and checked, or the last saved image is set to be displayed automatically, so that the user does not have to separately record or memorize the phone number. There is an advantage in that it is possible to check the number for making a call efficiently.

In step S205 of FIG. 2, whether to input a touch for correcting a displayed image is selected.

At this time, if image correction is not performed, the process proceeds to step S209 of FIG.

In step S209 of FIG. 2, a number displayed on the image area by a touch input performed on the keypad is displayed as the number display area.

And, when the input is normally completed, the image processing method of the phone app of the present invention is terminated.

If a touch input for correcting the image displayed in step S205 of FIG. 2 is performed, the process proceeds to step S207 of FIG.

In step S207 of FIG. 2, while maintaining the size of the image area, the keypad area, and the number display area, the image outside the image area is adjusted by a pinch input performed in the image area, or by a touch drag input. Perform image correction to move a part of it.

The pinch input is divided into an input where two touch points are separated from each other (zoom-in) and an input that is close to each other (zoom-out).

6A and 6B, as shown in (a), when the image is displayed 601 small enough to be difficult to identify, the user inputs a pinch zoom-in 602 within the image area (1). The size shown in the image area (1) can be enlarged based on the location where) is performed and displayed as shown in (b).

Alternatively, although not shown, a size displayed in the image area 1 may be reduced and displayed based on a position in the image area 1 where a pinch zoom-out input is performed. In addition, a part of an image having a size outside the image area 1 by a touch drag input performed within the image area 1 may be moved to the image area 1 according to the direction and degree of the touch drag input.

As described above, there is an advantage in that a user can perform a complex operation of correcting an image while performing a function while the keypad area and the number display area are displayed.

In step S209 of FIG. 2, a number displayed on the image area may be displayed as the number display area by a touch input performed on the keypad.

As shown in FIGS. 4A and 4B, the number of the image area 1 may represent a number inputted in the keypad area 2 as a number display area 3.

If the step of step S209 is normally performed, the image processing method of the phone app of the present invention ends.

3 is a schematic flowchart showing an image processing method of a phone app according to another embodiment of the present invention.

Step S301 of FIG. 3 is the same as step S201 of FIG. 2, and step S303 of FIG. 3 is the same as step S203 of FIG. 2, and a duplicate explanation will be omitted.

Step S305 of FIG. 3 selects whether to input a touch for correcting the displayed image.

If the touch input for correcting the image displayed in step S305 of FIG. 3 is not performed, the process proceeds to step S313 of FIG.

In step S313 of FIG. 3, a number displayed on the image area by a touch input performed on the keypad is displayed as the number display area.

And, when the input is normally completed, the image processing method of the phone app of the present invention is terminated.

If the touch input for correcting the image displayed in step S305 of FIG. 3 is performed, the process proceeds to step S307 of FIG.

In step S307 of FIG. 3, in response to a touch input performed on the image area, the image is expanded and displayed over the entire display, and the image area, the keypad area, and the number display area are not displayed, and the image area The border of is displayed as a correction frame that is distinguished from the expanded image.

Referring to Figs. 7A to 7C, as in (a), in response to the touch input 702, the keypad area 2 and the numeric display area 3 on the display 100 are (a) ), it may not be displayed separately on the display 100, and may not be temporarily displayed so that an image is displayed. In addition, in response to the touch input 704, the image area 1 is displayed as a correction frame 4, and the correction frame 4 is highlighted by the size of the frame of the image area 1, but is displayed in the entire display. It is displayed to be distinguished from the image, and may be fixed so as not to be moved by a user's touch input. In this case, the correction frame 4 may be displayed in a color or shade distinguished from the image, but the size and position may not be moved by a user's input.

In step S309 of FIG. 3, the scale of the expanded image is adjusted by a pinch input performed while maintaining the touch input, or at least a part of the image out of the correction frame is moved to the correction frame by a touch drag input. .

7A to 7C, as shown in (a) and (b), the image is moved to the touch position 703 of (b) where the touch is stopped at the touch input 702 to start correction. The entire image 701 of (a) is moved to the position of the entire image 704 of (b) in the corresponding direction and size.

In step S311 of FIG. 3, in response to the release of the touch input, the correction frame is converted back to the image area, and the image in the correction frame is displayed as the converted image area.

As shown in (C) of FIG. 7, the image area 1, the keypad area 2, and the number display area 3 can be separated and displayed again on the display at the same time as the touch input is released.

In addition, the touch input starts in the image area 1, but can be released in an area other than the image area 1, and the image moves in the direction and distance from the location where the touch input is started to the location where the touch input is released. , It can be corrected by adjusting the scale.

Another example of a touch input for correcting a displayed image according to an embodiment of the present invention will be described.

The correction frame 4 displayed in response to a touch input performed on the image area may be expanded on the display by a touch drag input and moved to at least a partial position of the displayed image.

8A to 8C, the image area 1 is switched to the correction frame 4 in response to the touch input 801 of (a), and the correction frame 4 is It is possible to move from the touch position 801 of (a) to the touch position 802 of (b) by a touch drag input. At this time, when a part of the image area corresponding to the moved position is included in the correction frame 4 and the touch input 802 is released, the image area 1 and the keypad area 2 as shown in (c). And the number display area 3 is re-switched and displayed on the display, and the image contained in the correction frame 4 and the correction frame 4 of (b) is simultaneously moved to the position of the image area (1) of (c). I can.

When the correction is completed and the touch input is released, the correction frame 4 is converted back to the image area 1, and the keypad area 2 and the numeric display area 3 can be displayed again as shown in (c). .

In addition, the scale of the expanded image is adjusted by a pinch input performed while maintaining the touch input, or the correction frame is moved to at least a part of the image by a touch drag input, An area outside the image may be moved in a direction opposite to the first direction by a touch drag input input in a direction.

According to an embodiment of the present invention, referring to FIGS. 9A to 9C, as shown in (a), the correction frame 4 moves the display from the edge of the display in the direction in which the touch input 901 is dragged. By inputting to visually move in the outward direction, as shown in (b), the image may be moved in a direction opposite to the direction of the dragging touch input 902 to be displayed on the display. In addition, the touch drag direction may be at least one of up, down, left, and right of the display.

In response to the release of the touch input, the correction frame may be re-displayed as an image region, the keypad region and the numeric display region may be re-displayed, and the image in the correction frame may be displayed as a re-displayed image region. The position of the correction frame may be moved by a user's touch and drag input, but the size may not be changed or deformed.

In step S313 of FIG. 3, a number displayed on the image area by a touch input performed on the keypad is displayed as the number display area.

As shown in Figs. 4D and 4E, a number touched in the keypad area 2 is displayed as a number display area 3, and the image processing method of the phone app of the present invention is terminated.

10 is a schematic flowchart illustrating a method of processing an image of a phone app according to an example of the present invention.

In step S1001 of FIG. 10, an image area, a keypad area, a number display area, and a text conversion button area are displayed by executing the phone app.

As shown in FIG. 11A, an image area 1, a keypad area 2, a number display area 3, and a character conversion button area 1001 may be displayed on the display.

Step S1002 of FIG. 10 is omitted for the same reason as step S203 of FIG.

In step S1003 of FIG. 10, it is selected whether to convert the displayed image into text.

If the displayed image is not converted to text in step S1003 of FIG. 10, the process proceeds to step S1006 of FIG.

In step S1006 of FIG. 10, a description that is duplicated for the same reason as step S209 of FIG. 2 will be omitted.

If the image displayed in step S1003 of FIG. 10 is converted to text, the process proceeds to step S1004 of FIG.

In step S1004 of FIG. 10, the image is converted into text through a character recognition program.

As shown in (a) of FIG. 11, the text conversion button 1101 is touched and input 1102 so that the image of the image area 1 is converted into text.

11 shows the image displayed as the image area 1 by numbers, but it may be a QR code or a barcode, and the character recognition program executed by the character conversion button 1101 recognizes the QR code or barcode and converts it into text. It can be a program.

In step S1005 of Fig. 10, the converted text is automatically displayed in a number display area.

As shown in (b) of FIG. 11, the image converted to text can be automatically displayed in the number display area 3, and the image processing method of the phone app of the present invention is terminated.

On the other hand, in all the above-described embodiments of the invention, the image area 1 is capable of repeatedly generating, displaying, and correcting an image while the phone app is running, and the step before the call by the user, the recipient It may be set by a developer or a user to maintain the activated state in any one or more of a step connected to the phone, a busy call, and a call ending step.

According to an embodiment of the present invention, the image processing method of the phone app may be implemented as a computer program stored in a medium for executing at least one of the above embodiments through a combination of hardware.

In addition, according to an embodiment of the present invention, the image processing method of the above phone app is implemented in the form of a program command that can be executed through various computer means for performing at least one of the above embodiments, and is a computer-readable recording medium. Can be written on. The computer-readable recording medium may include a program command, a data file, a data structure, or the like alone or in combination. The program codes or instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks, and Hardware devices specially configured to store and execute programs such as ROM, RAM, flash memory and the like are included. Examples of the program instructions include machine language codes such as those produced by a compiler and high-level language codes that can be executed by a computer using an interpreter and the like. The computer-readable recording medium may be a non-transitory computer-readable medium. The hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

1: image area
2: keypad area
3: Number display area
4: correction frame
100: device

Claims (10)

A method for processing an image of a phone application including an image area in which an image is displayed, a keypad area, and a number display area in which numbers input from the keypad area are displayed in a state in which the phone application is executed on a display,
Displaying an image area, a keypad area, and a number display area by executing the phone application;
Displaying an image in the image area; And
Including the step of displaying a number displayed in the image area as the number display area by a touch input performed in the keypad area,
Displaying an image in the image area,
In response to a touch input performed on the image area while the image is displayed, the image is expanded and displayed to a preset size outside the image area, and the border of the image area is a correction frame distinguished from the expanded image. Displayed steps;
Adjusting at least a part of the expanded image to be included in the correction frame by a first touch input performed while maintaining the touch input; And
And simultaneously redisplaying the correction frame as an image area upon release of the touch input and displaying an image included in the correction frame as the re-displayed image area,
The image processing method of the phone application in which the image area, the keypad area, and the number display area are displayed at a predetermined position on the display The method of claim 1,
The image displayed in the image area is an image generated by a shooting function or a pre-stored image, an image processing method of a phone application The method of claim 1,
An image processing method of a phone application in which the preset size at which the image is expanded is the entire size of the display The method of claim 1,
The first touch input is a pinch input for adjusting the scale of the expanded image or a drag input for moving the correction frame as a part of the expanded image. The method of claim 1,
The first touch input is a pinch input for adjusting the scale of the expanded image or a drag input for moving at least a part of the expanded image out of the correction frame to the correction frame. The method of claim 1,
The first touch input is a pinji input that adjusts the scale of the expanded image or a touch drag input that moves the correction frame to at least a part of the expanded image, and inputs it from the edge of the display in a first direction away from the display. A drag input for moving an image out of the display in a direction opposite to the first direction, and the first direction is any one of up, down, left, and right directions of the display. The method of claim 1,
A character conversion button area for executing at least one character recognition function among OCR, QR code and barcode is further included and displayed on the display,
The character recognition function is a function of converting an image displayed in the image area into a character so that it can be displayed in the number display area. An image processing apparatus for a phone application that displays, including an image area, a keypad area, and a number display area in which numbers input from the keypad area are displayed in a state where a phone application is executed on a display,
An input unit for generating a touch input signal;
A display unit that displays the image area, the keypad area, and the number display area;
Control unit; And
Including a storage unit,
The storage unit includes and stores a program configured to be executed by the control unit, and the program includes instructions for performing the method of any one of claims 1 to 7. A computer-readable recording medium recording a program for performing any one of claims 1 to 7 A computer program stored in a medium for executing the method of any one of claims 1 to 7 through combination with hardware

Images