JP5185150B2 - Portable device and operation control method - Google Patents

Description

  The present invention relates to a portable device and an operation control method using a touch panel display, and more particularly to a portable device and an operation control method with good touch input operability in a state where an image is displayed.

  In recent years, portable devices equipped with touch panel displays capable of displaying images have become widespread. The touch panel display is generally composed of a display device such as an LCD (Liquid Crystal Display) that performs display, and a touch sensor that has translucency and detects touch input. Hereinafter, the display device is referred to as “display”, and the touch sensor is referred to as “touch panel”.

  Patent Document 1 describes a configuration in which, when an image is displayed on a touch panel display, when a place where focus and metering are desired is touched, the touch position is detected and the focus is adjusted to a corresponding place in the object scene. ing.

  Patent Document 2 describes a configuration in which when a line drawing such as a line segment or a triangle is drawn with a finger on a touch panel display, the line drawing is recognized and a corresponding command is executed.

  In Patent Literature 3, when an image is displayed on a touch panel display and a place where focus and metering are desired is touched, the touch position and the pressing force are detected, the focus is adjusted to a corresponding place in the object field, and metering is performed. A configuration is described in which a shooting operation is performed when pressed strongly.

  Patent Document 4 has a display that displays a customized screen for each individual, and a touch panel that can input control data necessary for remotely operating a plurality of electrical devices on the screen displayed on the display. A configuration is described in which an electric device that is not operated by another person is prevented from being operated.

  Patent Document 5 has a configuration in which the operation button arrangement of the multimedia playback device is customized as desired by the user, and the operation of the touch panel display can be arbitrarily set for each user according to his / her preference. Have been described.

  Patent Document 6 describes a configuration in which display switching is performed by a finger gesture using a touch panel in a configuration in which display is switched by menu selection.

  Patent Document 7 describes a configuration in which operation buttons on a touch panel display are customized by updating firmware.

  Patent Document 8 describes a configuration for calling a command assigned to a finger gesture.

  Patent Document 9 describes a configuration in which, when an image is displayed on a touch panel display, when a place to be focused is touched, a corresponding object in the object scene is focused.

  Patent Document 10 describes a configuration in which a face is detected from an image, and autofocus and automatic exposure are performed based on image data in the face area.

  Patent Document 11 describes a configuration in which a release button is automatically pressed when a face is detected from an image.

  Patent Document 12 describes a configuration in which a touch panel display is provided and the center of an AF (Auto focus) frame and an AE (Auto Exposure) area is moved to a touched location.

  Patent Document 13 describes a configuration in which a face is detected from an image, subject distance is calculated based on the detected face size, and autofocus is performed.

  Patent Document 14 describes a configuration in which a face is detected from an image, a face detection frame indicating the detected face position is displayed on a touch panel display together with the image, and a face to be autofocused is selected by touching the face position. ing.

JP-A-6-70206 Japanese Patent Laid-Open No. 11-85398 JP-A-11-355617 JP 2002-152863 A JP 2004-172695 A JP 2005-339420 A JP 2006-293678 A JP 2006-331210 A JP 2004-48526 A JP 2007-81732 A JP 2003-92700 A Japanese Patent Laid-Open No. 2004-20585 JP 2007-328212 A JP 2008-85737 A

  However, there is a problem that the operability of touch input is not good when an image is displayed on the touch panel display.

  When an operation button is combined with the image in a state where the image is displayed, the operation button interferes with image observation for a user who wants to observe the entire screen of the touch panel display. In addition, it may be possible not to display the operation button by adopting a so-called gesture command, but if the process is executed without the operation button being displayed, a process that does not match the user's intention is executed. There is a problem of malfunction. For example, when a through image is displayed on a camera-equipped mobile device, the operation button is an obstacle for a user who wants to observe the entire screen. In order to take the best picture, we want to determine the angle of view and adjust the focus and exposure while looking through the entire through image. However, if shooting is performed immediately with a gesture, the shooting process may be erroneously started, and in such a case, an extra operation such as a cancellation process is required. In addition, once the angle of view is determined and the desired subject is in focus and exposure, it is desirable to quickly take a picture in an opportunity without missing a photo opportunity. For example, after focusing on the face of a target person and exposure, it is desirable to leave a photograph of the moment when the face and background of the person become favorable.

  Patent Documents 1 to 14 describe a configuration that can solve the problem of reconciling the request for observing the entire image displayed on the touch panel display and the request for surely executing the intended processing. It has not been.

  In the configurations described in Patent Documents 1, 3, and 9, it is possible to perform focus and metering by touching, but in order to be able to instruct modes and processing other than focus and metering, operation buttons are displayed in advance. It is necessary to keep it.

  Further, in the configuration described in Patent Document 3, there is another problem that camera shake is likely to occur due to pressing when a button is strongly pressed during a shooting instruction.

  In the configurations described in Patent Documents 2, 6, and 8, it is possible to execute various processes by drawing a line drawing or a trajectory. However, in general, the recognition result of touch input is known only after the process is executed. It is difficult to reliably execute the process.

  Patent Documents 4, 5, and 7 only describe customization of operation buttons, and do not describe customization of a trajectory input.

  Patent Documents 10 and 13 do not describe how to use the touch panel.

  In the configuration described in Patent Document 11, shooting is automatically started, but shooting may be started against the user's intention.

  Japanese Patent Application Laid-Open No. 2004-228561 does not describe the movement of the operation button.

  In the configuration described in Patent Document 14, when the detection target is limited to the face, a plurality of detection targets can be easily detected from the entire through image, but the detection target is not limited to the face. However, there is a problem that the detection process of the detection target is inevitably complicated and requires processing time.

  The present invention has been made in view of such circumstances, and in particular, an object of the present invention is to provide a portable device and an operation control method with good operability of touch input in a state where an image is displayed on a touch panel display.

  To achieve the above object, the present invention provides a touch panel display having a display for displaying and a touch panel for detecting touch input, and a locus drawn by touching the touch panel in a state where an image is displayed on the display. Recognizing recognition means, display control means for displaying an operation button corresponding to the recognized locus on the display, and execution control means for executing processing corresponding to the operation button when the operation button is touched. A portable device characterized by comprising:

  According to this, when a trajectory is drawn on the touch panel with an image displayed on the display, an operation button corresponding to the trajectory is displayed. Therefore, before the trajectory is drawn, the user's image observation is obstructed by the operation button. In addition, when the locus is drawn, the user can surely grasp whether or not the intended processing is executed by visually recognizing the display of the operation button. In the state where the operation button is displayed, the user can quickly execute the intended process by touching the operation button. Therefore, in a state where an image is displayed on the touch panel display, a request for observing the entire displayed image and a request for surely executing an intended process can be satisfied, and thus operability is good.

  In one aspect of the present invention, the image processing apparatus includes: an imaging unit that captures an image of a subject; and a recording unit that records a captured image obtained by imaging with the imaging unit on a recording medium. When a specific trajectory is drawn on the touch panel in a state where a continuously output through image is displayed on the display, a release button for inputting a shooting instruction is displayed on the display, and the execution control unit includes: When the release button is touched, imaging is performed by the imaging unit, and the captured image obtained by the imaging is recorded on the recording medium by the recording unit.

  In one aspect of the present invention, the display control means displays the release button on an end portion of the display.

  According to this, since the periphery of the touch panel display is generally gripped by the mobile device, the movement of the mobile device is small even when the operation button displayed on the end is touched, and so-called camera shake is prevented. Become.

  In one aspect of the present invention, the recognizing unit identifies a clockwise encircling locus and a counterclockwise encircling locus drawn by touching the touch panel, and the display control unit is configured to detect the clockwise encircling locus. It is characterized in that the release button is displayed on which of the end portions of the display, depending on the case and the case of the locus surrounding the counterclockwise direction.

  According to this, it is possible to further reduce camera shake, further improve operability, and the like by switching the display position of the release button based on the direction of the surrounding locus (clockwise / counterclockwise). .

  In one aspect of the present invention, the recognition unit recognizes a surrounding locus drawn by touching the touch panel, and the display control unit surrounds the surrounding by the recognition unit in a state where the through image is displayed on the display. When a locus is recognized, a reduced image of an area designated by the surrounding locus in the through image is displayed in the release button on the display.

  In one aspect of the present invention, the imaging unit includes a focus lens, and the recognition unit recognizes a surrounding locus drawn by touching the touch panel and displays the through image on the display. When the surrounding trajectory is recognized by the above, the specific target detecting means for detecting the specific target on the object scene designated by the surrounding trajectory in the through image, and the focus lens of the photographing lens on the object scene Focusing control means for focusing on the specific target, wherein the display control means displays a reduced image of the specific target in the through image in the release button on the display. To do.

  According to this, the user can accurately grasp that the intended specific target (main subject) is detected and that the focus and exposure are adjusted.

  In one aspect of the present invention, when an arbitrary position on the touch panel is touched in a state where the operation button is displayed on the display, the recognition unit uses the touched position as a movement destination of the operation button. Recognizing, the display control means changes the display position of the operation button on the display to the movement destination.

  According to this, the user can freely move the operation button to an uncomfortable place.

  In one aspect of the present invention, when the recognizing unit recognizes an operation of moving while touching the operation button on the touch panel while the operation button is displayed on the display, the operation button is released. The position is recognized as a movement destination of the operation button, and the display control means changes the display position of the button on the display to the movement destination.

  According to this, the user can freely move the operation button to an uncomfortable place, and can change the arrangement of the operation button while checking the interference between the image and the operation button.

  One aspect of the present invention is characterized by comprising registration means for registering a locus freely drawn on the touch panel and a correspondence relationship between the locus and processing executed by the execution control means.

  According to this, since the user can register a free trajectory input that does not depend on the operation buttons, a simple operation can be performed.

In one aspect of the present invention, the display control unit inputs a shooting instruction when a first trajectory is drawn on the touch panel in a state where a through image continuously output from the imaging unit is displayed on the display. A release button for displaying the image is displayed on the display. When the release button is touched, an image recording display indicating the start of an image recording process for recording the captured image on the recording medium is displayed on the display, and the execution is performed. When the second track whose shape is different from the first track is recognized by the recognizing unit during display of the image recording display, the control unit unrecords the captured image of the recording medium from the recorded state. Return to the state.

  According to this, even if there is no operation button for canceling image recording, it is possible to easily instruct to stop the image recording process by operation.

In one aspect of the present invention, the display control means performs an image erasing process for changing an image recorded on a recording medium from a recorded state to an unrecorded state when the first locus is recognized by the recognition means. An image erasure display indicating the start is displayed on the display, and the execution control means, when the recognition means recognizes the first locus, the image recorded on the recording medium from the recorded state to the unrecorded state. The image erasing process is changed to, and when the second locus having a shape different from the first locus is recognized by the recognition means during the display of the image erasure display, the image of the recording medium is displayed. Is returned from the unrecorded state to the recorded state.

  According to this, even if there is no operation button for canceling image erasure, it is possible to easily instruct to cancel the image erasure processing.

  Further, the present invention is an operation control method using a touch panel display having a display for displaying and a touch panel for detecting touch input, and is drawn by touching the touch panel in a state where an image is displayed on the display. Recognizing a locus, displaying an operation button corresponding to the recognized locus on the display, and executing a process corresponding to the operation button when the operation button is touched. An operation control method is provided.

  ADVANTAGE OF THE INVENTION According to this invention, the operativity of the touch input in the state which displayed the image on the touchscreen display can be improved.

The front view which shows the external appearance of the digital camera to which this invention is applied The rear view which shows the external appearance of the digital camera to which this invention is applied The block diagram which shows the internal structural example of the digital camera to which this invention is applied The block diagram which shows the principal part function structural example of CPU from 1st Embodiment to 3rd Embodiment. The flowchart which shows the flow of the imaging | photography process example in 1st Embodiment. (A) is explanatory drawing which shows an example of the locus | trajectory which surrounds, (B) is explanatory drawing which shows an example of a release button display. (A) is explanatory drawing which shows an example of the locus | trajectory which surrounds, (B) is explanatory drawing which shows the other example of a release button display. (A) is explanatory drawing which shows an example of the locus | trajectory surrounding one specific object, (B) is explanatory drawing which shows the example of a display of the release button corresponding to the locus | trajectory surrounding one specific object, (C) is a some specific object. Explanatory drawing which shows an example of the locus | trajectory which surrounds, (D) is explanatory drawing which shows the example of a display of the release button corresponding to the locus | trajectory surrounding a some specific object (A), (B) and (C) are explanatory drawings showing various enclosing trajectories. (A) is explanatory drawing used for description when the specific target image is completely within the surrounding trajectory, and (B) is explanatory drawing used for description when the specific target image is protruding from the surrounding trajectory. (A) is explanatory drawing which shows an example of the locus | trajectory which surrounds, (B) is explanatory drawing used for description at the time of displaying the reduction | decrease image of a specific object in a release button. (A) is explanatory drawing which shows an example of the locus | trajectory enclosed clockwise, (B) is explanatory drawing which shows an example of the locus | trajectory enclosed counterclockwise, (C) is the description which shows the example of a display of the release button corresponding to the surrounding locus | trajectory. FIG. 4D is an explanatory diagram showing another display example of the release button corresponding to the surrounding locus. The flowchart which shows the flow of the example of an operation button movement process in 2nd Embodiment. (A) is explanatory drawing used for description of operation button selection, (B) is explanatory drawing which shows the blinking display state of an operation button, (C) is explanatory drawing used for description of the movement destination designation | designated of an operation button, (D) is shown. Explanatory drawing showing the display state after the destination is confirmed The flowchart which shows the flow of the example of an operation button movement process in 3rd Embodiment. (A) is explanatory drawing used for description of operation button drag, (B) is explanatory drawing used for description of operation button drop. The block diagram which shows the principal part function structural example of CPU of 4th Embodiment. The flowchart which shows the flow of the touch input registration process example in 4th Embodiment. Explanatory drawing showing an example of touch input for zoom operation selection (A) is an explanatory view showing a display state before an image erasure instruction, (B) is an explanatory view showing an example of touch input of the image erasure instruction, and (C) is an explanatory view showing an example of an image erasure display. (A) is an explanatory view showing an example of an image erasure display, (B) is an explanatory view showing an example of touch input of an image erasure stop instruction, and (C) is an explanatory view showing a display state returned to before the image erasure instruction.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a front view showing an appearance of a digital camera 100 to which the present invention is applied. FIG. 2 is a rear view showing an appearance of the digital camera 100 of FIG.

  As shown in FIG. 1, a photographing lens 24, a flash 60, a release switch 71 and the like are provided on the front surface of the camera body 70. In addition, as shown in FIG. 2, a touch panel display 47 and the like are provided on the back surface of the camera body 70.

  The photographing lens 24 of this example is a retractable type, and includes a zoom lens (24z in FIG. 3) described later. The taking lens 24 is extended from the camera body 70 when the power of the digital camera 100 is turned on. In addition, since the retracting mechanism in the photographic lens is a known technique, a description of a specific configuration is omitted here.

  The flash 60 irradiates the object scene with light for photographing. The flash 60 of this example is composed of a xenon tube, and emits light as necessary when photographing a dark subject or when backlit.

  The release switch 71 is a two-stage stroke type hardware switch capable of so-called “half-pressing” and “full-pressing”. When the release switch 71 is pressed halfway, shooting preparation processing is performed, that is, AE (Automatic Exposure), AF (Auto Focus), AWB (Automatic White Balance) processing is performed, and then fully pressed. Then, a captured image recording process is performed.

  The touch panel display 47 is a device capable of display and touch input. The touch panel display 47 will be described in detail later.

  Although only the front view and the rear view are shown, the top view, the side view, and the bottom view are omitted, the power switch for inputting the power-on and power-off instructions, the mode selector switch for inputting the instructions for switching between the shooting mode and the playback mode, the menu A hardware switch such as a menu switch for instructing display input is provided on the upper surface of the camera body 70 or the like.

  FIG. 3 is a block diagram illustrating an internal configuration example of the digital camera 100 illustrated in FIGS. 1 and 2.

  In FIG. 3, a digital camera 100 is a digital camera that electronically records an image, and includes a CPU (central processing unit) 10, an operation unit 12, a ROM 14, an SDRAM 16, a VRAM 18, an EEPROM 20, a photographing lens 24, an image sensor 30, a timing. Generator 32, analog signal processing unit 34, A / D converter 36, image input controller 38, image signal processing unit 40, compression / decompression processing unit 42, media controller 44, memory card 46, touch panel display 47 (display 48 and touch panel 49 ), A display driver 50, a touch panel driver 51, an AE detector 52, an AF detector 54, a flash controller 58, a flash 60, a power controller 62, a battery 64, and the like.

  The CPU 10 functions as a control unit that performs overall control of the entire operation of the digital camera 100, and controls each unit of the digital camera 100 according to a program based on inputs from the operation unit 12 and the touch panel 49. Further, the CPU 10 functions as an arithmetic processing unit for calculating various control values necessary for controlling the digital camera 100, and executes various arithmetic processes according to a program. Each unit of the digital camera 100 is connected to the CPU 10 via the bus 22.

  The ROM 14 stores programs executed by the CPU 10 and various data necessary for control. The SDRAM 16 is used as a work area for the CPU 10 and also as a temporary storage area for image data. The VRAM 18 is used as a temporary storage area dedicated to display image data. The EEPROM 20 stores various setting information unique to the user.

  The operation unit 12 includes various hardware switches such as a release switch, a power switch, a mode switch, and a menu switch, and outputs a signal corresponding to the operation of these hardware switches to the CPU 10. The digital camera 100 has a reproduction function for reproducing a photographed image in addition to a photographing function for photographing an image, and switching between the photographing and reproduction modes is performed by a mode changeover switch (not shown).

  The photographing lens 24 includes a zoom lens 24z that performs zooming, a focus lens 24f that performs focusing, and a diaphragm 24i that performs light amount adjustment.

  The zoom lens 24z is driven by a zoom motor 26z and moves back and forth on the optical axis. Thereby, the subject image formed on the light receiving surface of the image sensor 30 is optically scaled. The CPU 10 controls the movement of the zoom lens 24z and the zoom by controlling the driving of the zoom motor 26z via the zoom motor driver 28z.

  The focus lens 24f is driven by the focus motor 26f and moves back and forth on the optical axis. Thereby, focusing is performed. The CPU 10 controls the movement of the focus lens 24f by controlling the drive of the focus motor 26f via the focus motor driver 28f, and performs focusing.

  The diaphragm 24i is constituted by, for example, an iris diaphragm, and is driven by an iris motor 26i to change its opening amount (aperture value). The CPU 10 controls the opening amount of the diaphragm 24i by controlling the driving of the iris motor 26i via the iris motor driver 28i, and controls the amount of subject light incident on the light receiving surface of the image sensor 30.

  The image sensor 30 is composed of a color CCD having an RGB color filter array, and is driven by a timing generator (TG) 32 to operate. That is, the signal charge accumulated in each pixel (photosensor) is read out by the drive pulse supplied from the timing generator 32 and output as an RGB image signal. The CPU 10 controls the driving of the timing generator 32 to control the charge accumulation time (shutter speed) of the image sensor 30 and the reading of the image signal.

  The analog signal processing unit 34 performs correlated double sampling processing on the analog image signal output from the image sensor 30, and amplifies and outputs it.

  The A / D converter 36 converts the analog image signal output from the analog signal processing unit 34 into a digital image signal and outputs the digital image signal.

  The image input controller 38 has a built-in line buffer having a predetermined capacity. Under the control of the CPU 10, the image input controller 38 captures an image signal for one frame output from the A / D converter 36 and stores it in the SDRAM 16.

  The image signal processing unit 40 takes in an image signal stored in the SDRAM 16 under the control of the CPU 10 and performs a required signal processing to obtain an image signal (Y) and a color signal (Cr, Cb). Y / C signal) is generated and written to the VRAM 18.

  The compression / decompression processing unit 42 takes in an image signal (Y / C signal) under the control of the CPU 10 and performs predetermined compression processing to generate compressed image data (for example, JPEG). Further, under the control of the CPU 10, the compressed image data is captured and subjected to a predetermined expansion process to generate an uncompressed image signal (Y / C signal).

  The media controller 44 reads / writes data to / from the memory card 46 under the control of the CPU 10. For example, in response to a recording instruction from the CPU 10, image data obtained by photographing is recorded on the memory card 46. Also, corresponding image data is read from the memory card 46 in response to a read instruction from the CPU 10. The memory card 46 is detachably loaded in a card slot provided in the photographing apparatus main body.

  The touch panel display 47 includes a display 48 that performs display and a touch panel 49 that has translucency and detects touch input. The display 48 may be referred to as a “display device”. The touch panel 49 may also be referred to as a “touch sensor”.

  Various known display devices can be used as the display 48, but generally thin display devices such as LCD (liquid crystal display device) and organic EL (electroluminescence) display devices are used for portable devices. . The display 48 is used as a playback display unit for recorded images in the playback mode, and in the shooting mode, images generated by the image sensor 30 and taken into the SDRAM 16 by the image input controller 38 are time-sequential through images. Display as.

  Various known touch sensors can be used as the touch panel 49, but for a portable device, a capacitive touch sensor that detects a change in capacitance generated between a finger and a conductive film, A thin touch sensor such as a resistive film type touch sensor that detects a voltage using a plurality of resistive films is used. A multipoint detection touch sensor is preferable in order to recognize a locus drawn by touching with a finger or a pen.

  The display driver 50 controls display on the display 48 under the control of the CPU 10. In this example, an image signal (Y / C signal) is taken from the VRAM 18, converted into a display signal format, and output to the display 48.

  The touch panel driver 51 controls touch input detection of the touch panel 49 under the control of the CPU 10. In this example, position information indicating a position touched with a finger or a pen on the touch panel 49 is stored in the SDRAM 16 in time series.

  Various settings of the digital camera 100 are performed using the touch panel display 47. When a menu switch (not shown) is pressed, a setting screen for performing various settings of the digital camera 100 is displayed on the display 48. The setting screen may be displayed when a specific locus is drawn on the touch panel 49. The user performs various settings of the digital camera 100 from the touch panel 49 in accordance with the screen display on the display 48.

  The AE detection unit 52 takes in R, G, and B image signals stored in the SDRAM 16 under the control of the CPU 10, calculates an integrated value necessary for AE control as an AE evaluation value, and outputs the integrated value to the CPU 10. In the digital camera 100 of the present embodiment, one screen is divided into a plurality of areas, and an integrated value of image signals for each of R, G, and B is calculated for each divided area. As the AE control, the CPU 10 obtains the brightness of the shooting scene based on the AE evaluation value calculated by the AE detection unit 52, and determines the aperture value and the shutter speed. For example, it is determined using a program diagram.

  The AF detection unit 54 takes in R, G, and B image signals stored in the SDRAM 16 under the control of the CPU 10 and calculates an AF evaluation value necessary for AF control. The AF detection unit 54 includes a high-pass filter that passes only a high-frequency component of the G signal, an absolute value processing unit, a focus area extraction unit that extracts a signal within a predetermined focus area set by the touch panel display 47, and An integration unit for integrating the absolute value data in the focus area is included, and the absolute value data in the focus area integrated by the integration unit is output to the CPU 10 as an AF evaluation value. As the AF control, the CPU 10 moves the focus lens 24f from the closest distance to the infinity to acquire an AF evaluation value in small increments, and sets the lens position at which the AF evaluation value reaches a peak to a focus lens position (focus on the main subject). A focus detection process for determining the position of the focus lens 24f) is performed. Then, the focus lens 24f is moved to the determined focus lens position.

  The flash control unit 58 controls light emission of the flash 60 under the control of the CPU 10. That is, the flash 60 is caused to emit light at the light emission timing and the light emission amount instructed from the CPU 10.

  The flash 60 is composed of, for example, a xenon tube. In addition, it can also comprise using LED.

  The power control unit 62 controls the supply of power from the battery 64 loaded in the apparatus main body to each unit of the digital camera 100 in accordance with a command from the CPU 10.

(First embodiment)
FIG. 4 is a block diagram illustrating an exemplary functional configuration of the main part of the CPU 10 of the digital camera 100 according to the first embodiment.

  The touch input recognition unit 101 cooperates with the touch panel driver 51 to determine which position on the image is specified by associating the position touched on the touch panel 49 with a finger or pen with the position on the image displayed on the display 48. The designated position is recognized, and the locus recognition is performed to recognize the locus drawn by touching the touch panel 49 with a finger or a pen. In this example, the touch input includes a point input, a locus input, and a combination input thereof. Point input includes tap input (operation to tap with a control). In the case of point input, the touch input recognition unit 101 generates coordinate information indicating the position of the touched point on the image as a recognition result. In the case of trajectory input, as the recognition result, the shape information of the trajectory drawn by touching and the coordinate information indicating the position of the trajectory on the image are generated. For example, when the locus is a line shape, coordinate information such as the start point and end point of the line on the image is generated. Further, in the case of a shape that the locus encloses (hereinafter also referred to as “enclosing locus”), the coordinate information of the enclosing area on the image and whether the locus is a locus enclosing in the clockwise direction or the locus enclosing in the counterclockwise direction. The enclosing direction information shown is generated.

  The display control unit 102 displays images and operation buttons on the display 48. In this example, the image display includes a through image display for displaying a through image continuously output from the image sensor 30 and a reproduction display for displaying a captured image (recorded image) recorded in the memory card 46. In addition, the display control unit 102 of this example causes the display 48 to display operation buttons corresponding to the shape of the locus drawn on the touch panel 49.

  When a hardware switch (for example, release switch 71 in FIG. 1) provided in the camera body 70 is pressed, the execution control unit 103 executes processing corresponding to the pressed switch. Further, when an operation button displayed as a software switch on the display 48 is touched, the execution control unit 103 executes processing corresponding to the touched operation button.

  The specific target detection unit 104 detects a specific target (for example, a human face or an animal) from a captured image (through image or main image) obtained by the image sensor 30.

  The AF control unit 105 determines a lens position (focusing lens position) at which the focus lens 24f focuses on a specific target on the object field based on the AF evaluation value calculated by the AF detection unit 54, and a focus motor. The driver 28f is controlled to move the focus lens 24f to the focus lens position.

  The AE control unit 106 performs exposure setting based on the AE evaluation value calculated by the AE detection unit 52. That is, sensitivity, aperture value, shutter speed, necessity of flash emission, etc. are set.

  FIG. 5 is a flowchart showing the flow of an example of photographing processing to which the present invention is applied. This process is executed according to the program by the CPU 10 of FIG.

  In step S1, the display control unit 102 starts displaying a through image. That is, the captured images continuously output in time series from the image sensor 30 are displayed on the display 48 through the display driver 50 as a through image.

  In step S2, it is determined whether or not the release switch (71 in FIG. 1) is half-pressed. If the release switch 71 is half-pressed, the process proceeds to step S14. If the release switch 71 is not half-pressed, the process proceeds to step S3.

  In step S <b> 3, the touch input recognition unit 101 determines whether or not the touch panel 49 is touched. That is, it is determined whether or not the touch panel 49 is touched while the through image is displayed on the display 48. If the touch panel 49 is touched, the process proceeds to step S4. If the touch panel 49 is not touched, the process returns to step S2.

  In step S4, the touch input recognition unit 101 associates the touched position on the touch panel 49 with the position on the image displayed on the display 48 to recognize which position on the image is specified. Recognizing or recognizing a locus by touching the touch panel 49 and recognizing a locus drawn. The touch input recognition unit 101 of this example recognizes a surrounding locus 90 drawn in an arc shape so as to surround an arbitrary region by touching the touch panel 49 as shown in FIG.

  In step S5, it is determined whether or not the trajectory is a surrounding trajectory. If it is an enclosing locus, the process proceeds to step S6, and if it is not an enclosing locus, the process proceeds to step S13.

  In step S6, shooting preparation processing is performed. In this shooting preparation process, first, the specific target detection unit 104 performs a specific target detection process. In this example, a specific target (also referred to as a “main subject”) such as a human face or an animal in an area designated by a trajectory enclosed in the through image is detected. Second, the AF control unit 105 performs AF (automatic focus) processing. In this example, the focus lens 24f of the photographing lens 24 is focused on a specific target on the object scene. Third, the AE control unit 106 performs AE (automatic exposure) processing. In this example, the sensitivity, aperture value, shutter speed, necessity of flash emission, and the like are set based on the area specified by the trajectory enclosed in the through image and the surrounding photometric values (AE evaluation values).

  As described above, in this example, when the surrounding trajectory is recognized by the touch input recognition unit 101 in a state where the through image is displayed on the display 48, the specified target detection unit 104 specifies the surrounding trajectory designation region in the through image. To detect a specific object on the object scene. Further, the AF control unit 105 focuses the focus lens 24f of the photographing lens 24 on the detected specific object on the object scene. Further, the AE control unit 106 performs photometry in the designated region of the trajectory enclosed in the through image.

  In step S7, the display control unit 102 displays the release button 81 on the display 48 as shown in FIG. The release button 81 is a software switch that corresponds to full-pressing of the release switch (71 in FIG. 1) and is used to input a shooting instruction. In the example shown in FIG. 6B, the release button 81 is displayed on a trajectory enclosed on the display 48. Other display examples will be described later.

  In step S8, the touch input recognition unit 101 determines whether or not the release button 81 has been touched. That is, it is determined whether or not a finger or a pen has touched the touch area on the touch panel 49 corresponding to the display position of the release button 81. If the release button 81 is touched, the process proceeds to step S9.

  In step S9, the image pickup device 30 performs the main image pickup. That is, the object scene including the specific object is imaged in a state where the specific object on the object field is in focus and exposure.

  In step S <b> 10, the media controller 44 records the captured image obtained by capturing with the image sensor 30 in the memory card 46.

  In step S11, it is determined whether or not the shooting mode is ended. For example, when the mode is switched to the playback mode by the mode switch, it is determined that the photographing mode is finished. If the shooting mode is ended, the shooting mode end process is performed in step S12. If the shooting mode is not ended, the process returns to step S2.

  In step S13, an operation button is already displayed on the display 48, and when the operation button is touched, processing corresponding to the operation button is executed. In this example, when no surrounding locus is input, no operation button is displayed on the display 48, and nothing is performed in step S13.

  If it is determined in step S2 that the release switch 71 as a hardware switch is half-pressed (shooting preparation instruction), a shooting preparation process is performed in step S14. In this case, the specific object detection unit 104 detects a specific object on the object scene in the entire region of the through image, and performs AF processing by the AF control unit 105 and AE processing by the AE control unit 106.

  Note that when the shooting preparation instruction is input by drawing a locus enclosed on the touch panel 49 as described above without using the release switch 71 as a hardware switch, the detection area of the specific target is limited by the enclosed locus. There are advantages.

  In order to facilitate understanding of the advantages of the locus input and the release button 81, the case where the release switch 71, which is a hardware switch, is provided as an example has been described. However, in the present invention, the hardware switch is omitted. It is also possible to do.

  In addition, the case where the image is displayed on the locus surrounding the release button 81 has been described as an example with reference to FIG. 6B. However, in order to prevent camera shake, the release button 81 is set as shown in FIG. It is preferable to display at the end of the display 48. When the lower end portion of the body of the portable device is gripped, the release button 81 is displayed on the end portion of the display 48.

  Further, when the touch input recognition unit 101 recognizes the locus enclosed on the touch panel 49 while the through image is displayed on the display 48, a reduced image of the area designated by the enclosed locus in the through image is displayed on the release button of the display 48. 81 may be displayed.

  In addition, instead of simply displaying a reduced image in the surrounding locus 90, a specific object is detected in an area in the surrounding locus 90, and the image of the specific object is extracted from the through image. The image may be reduced and displayed in the release button 81. For example, as shown in FIG. 8A, when the specific target is a human face, a face image 91 is extracted from the locus 90 surrounded by the through image, and as shown in FIG. 8B, the release is performed. A thumbnail image 92 (reduced image) obtained by reducing the face image 91 in the through image is displayed in the button 81.

  Further, as shown in FIG. 8C, when there are a plurality of human face images 91a, 91b, 91c in the trajectory 90 enclosed in the through image, a plurality of face images 90a are enclosed from the trajectory 90 surrounded by the through image. The face images 91a, 91b, 91c are extracted, respectively, and a plurality of release buttons 81a, 81b, 81c are displayed as shown in FIG. 8D, and each face image 91a in the through image is displayed in each release button 81. , 91b and 91c are displayed as thumbnail images 92a, 92b and 92c, respectively. In this case, focusing and exposure are performed on a specific target (a face in this example) corresponding to the release button that is touch-operated among the plurality of release buttons 81a, 81b, and 81c.

  The specific target is not particularly limited to a human face. For example, animals other than humans such as dogs, cats and birds, plants such as flowers, cars, buildings, etc. may be used. In this example, since the region for detecting the specific target in the through image is limited by the surrounding trajectory, it is easier to extract the specific target compared to the case where various specific targets are extracted from the entire region of the through image. . It is not necessary to identify whether the specific object is a human face or another animal. The detection and extraction of the specific object may be a method that can be performed by a known recognition technique. For example, the specific target image is extracted from the through image by detecting the edge of the specific target image based on the color, brightness, or the like in the trajectory enclosed in the through image. For example, when there are many skin color components in the surrounding trajectory, a human face image is extracted by detecting the edge of the skin color region. Further, the specific target image may be extracted by detecting the background region.

  The recognition of the surrounding trajectory is performed when the start point and the end point of the surrounding trajectory coincide with each other as shown in FIG. 9A, or when the start point neighborhood and the end point neighborhood appear as shown in FIG. 9B. Is not particularly limited. As shown in FIG. 9C, even in the case of an open trajectory, the touch input recognition unit 101 recognizes it as an open surrounding trajectory by estimating the dotted line portion in FIG. 9C.

  Further, as illustrated in FIG. 10A, the specific target detection unit 104 extracts the specific target image 91 even when the specific target image 91 is not completely within the surrounding trajectory 90. That is, as illustrated in FIG. 10B, the specific target image 91 is extracted even when the specific target image 91 protrudes from the surrounding trajectory 90. For example, if there are many white components in the surrounding trajectory, and the edge of the white region is continuous from the surrounding trajectory to the outside of the surrounding trajectory, the white bird image outside the surrounding trajectory is detected, so that the white bird image is extracted from the through image. Extract.

  For example, as shown in FIG. 11A, when a bird image appears in a through image displayed on the display 48, a trajectory 90 surrounding at least a part of the bird image is drawn with a finger. Then, the bird image extending inside and outside the surrounding trajectory 90 is extracted by the specific target detection unit 104. Further, as shown in FIG. 11B, the display control unit 102 displays a release button 81 on the display 48, and a thumbnail image obtained by reducing the bird image is displayed in the release button 81. . The AF control unit 105 focuses the focus lens 24f on the bird on the object scene, and the AE control unit 106 performs photometry in the bird image in the through image and the surrounding photometry area, and the exposure is adjusted. . The user visually recognizes that the release button 81 is displayed on the display 48 and that the thumbnail image of the bird is displayed in the release button 81, so that the bird is detected, and that the bird is in focus and exposure. Then, the user can input a shooting instruction by touching the release button 81 while looking at the opportunity while viewing the through image.

  Further, the display position of the release button 81 may be switched based on the direction of the surrounding locus. When a trajectory 90R that surrounds clockwise as shown in FIG. 12A is drawn, the touch input recognition unit 101 recognizes the trajectory 90R that surrounds clockwise and surrounds it counterclockwise as shown in FIG. 12B. When the locus 90L is drawn, the touch input recognition unit 101 recognizes the locus 90L surrounded counterclockwise. The display control unit 102 switches between which end of the display 48 the release button 81 is displayed depending on whether the locus 90R is clockwise or the locus 90L is counterclockwise.

  Here, it is assumed that the right-handed person draws a trajectory 90R that is clockwise with the right hand, and the left-handed person draws a trajectory that is counterclockwise with the left hand. Left and right are left and right as viewed from the user facing the display 48.

  First, an example in which the camera body 70 is structured to be held with one hand will be described.

  From the viewpoint of preventing camera shake, the release button 81 is displayed on the lower end of the camera body 70 that is gripped with one hand and on the gripped hand of the right end and the left end. That is, in the case of the trajectory 90R that is clockwise as shown in FIG. 12A, it is determined that a right-handed person has drawn the camera body 70 with the left hand and drawn with the right hand, and FIG. As shown in FIG. 12B, a release button 81 is displayed on the lower left end of the display 48, and in the case of a locus 90L surrounding counterclockwise as shown in FIG. 12B, a left-handed person holds the camera body 70 with the right hand and moves the left hand. As shown in FIG. 12, a release button 81 is displayed at the lower right end of the display 48 as shown in FIG.

  On the other hand, from the viewpoint of improving operability, the release button 81 is displayed on the lower end of the camera body 70 that is gripped with one hand and the free hand of the right end and the left end. That is, in the case of the trajectory 90R clockwise surrounded as shown in FIG. 12A, the release button 81 is displayed at the lower right end of the display 48 as shown in FIG. 12D, and shown in FIG. In the case of the locus 90L that is counterclockwise, a release button 81 is displayed at the lower left end of the display 48 as shown in FIG.

  Next, an example in the case where the camera body 80 is structured to be held with both hands will be described. From the viewpoint of preventing camera shake, the release button 81 is displayed on the lower end of the camera body 70 held by one hand, and from the viewpoint of improving operability, the release button 81 is displayed on the free hand. To do. That is, in the case of the trajectory 90R clockwise surrounded as shown in FIG. 12A, the release button 81 is displayed at the lower right end of the display 48 as shown in FIG. 12D, and shown in FIG. In the case of the trajectory 90R encircling counterclockwise, a release button 81 is displayed at the lower left end of the display 48 as shown in FIG.

  It is assumed that the right-handed person draws a trajectory 90R that is clockwise with the right hand, and the left-handed person is to draw a trajectory that is counterclockwise with the left hand. The correspondence relationship between the direction of the surrounding locus and the display position of the release button 81 can be changed.

  In the present embodiment, the area can be designated by a trajectory freely enclosed on the through image by the user. Thereby, it is possible to freely specify the detection area, the focusing area, and the photometry area of the specific target as the main subject. In addition, since the operation button corresponding to the locus input is displayed on the touch panel display, it is possible to execute a desired process by touching the operation button after confirming the recognition result of the touch input even with rough input. Moreover, camera shake can be prevented by displaying a release button at the end of the touch panel display. Further, since the reduced image of the area specified by the trajectory enclosed in the through image or the reduced image of the specific target is displayed in the release button, the user can adjust the detected specific target, focus and exposure. This can be easily grasped while observing the through image and the release button.

(Second Embodiment)
The internal configuration of the digital camera 100 according to the second embodiment is as shown in FIG. 3 and has already been described. Moreover, the principal part functional structure of CPU10 is as having shown in FIG. 4, and only a different point from 1st Embodiment is demonstrated here.

  In the present embodiment, when an arbitrary position on the touch panel 49 is touched while the operation button is displayed on the display 48, the touch input recognition unit 101 recognizes the touched position as the movement destination of the operation button. To do. In addition, the display control unit 102 changes the display position of the operation button on the display 48 to the movement destination recognized by the touch input recognition unit 101.

  FIG. 13 is a flowchart showing a flow of an example of operation button movement processing in the present embodiment. This process is executed according to the program by the CPU 10 of FIG.

  In step S21, the touch input recognition unit 101 detects whether an operation of double-clicking an operation button on the touch panel display 47 or an operation of drawing a locus surrounding the operation button has been performed. As shown in FIG. 14A, the operation button may be double-clicked with the pen tip. In step S22, it is determined whether or not it is detected. If it is detected, the process proceeds to step S23, and if not detected, the process returns to step S21.

  In step S23, the operation button to be moved is determined.

  In step S24, an operation button movement mode is set.

  In step S25, the display control unit 102 causes the operation button to blink as shown in FIG.

  In step S26, the movement destination position of the operation button to be moved is detected. In this example, the touch input recognition unit 101 detects an operation of clicking on the touch panel display 47 as shown in FIG.

  In step S27, the display control unit 102 displays the operation button to be moved at the movement destination.

  In step S28, an input of a position confirmation instruction is accepted. For example, the touch input recognition unit 101 detects whether or not an operation for drawing a locus surrounding the operation button has been performed.

  In step S29, it is determined whether a position determination instruction has been accepted. If a position confirmation instruction is accepted, the process proceeds to step S30. If it is not a position confirmation instruction (for example, when a cancel instruction is input by drawing a trajectory marked “x”), the process returns to step S25.

In step S30, the movement destination position of the operation button on the display 48 is determined. In step S31, the blinking of the movement target button on the display 48 is terminated. Then, the display state shown in FIG.

  In step S32, it is determined whether or not the operation button movement setting is to be ended. If the operation button is to be ended, the operation button movement mode is ended in step S33, and otherwise the process returns to step S21.

  In the second embodiment, the arrangement of operation buttons on the touch panel display 47 can be changed in order for the user to improve usability. For example, when an operation button is considered to be an obstacle during image shooting or reproduction, the operation button can be moved to a desired position.

(Third embodiment)
The internal configuration of the digital camera 100 according to the third embodiment is as shown in FIG. 3 and has already been described. Moreover, the principal part functional structure of CPU10 is as having shown in FIG. 4, and only a different point from 1st Embodiment is demonstrated here.

  In the present embodiment, when the touch input recognition unit 101 recognizes an operation to move while touching the operation button on the touch panel 49 in a state where the operation button is displayed on the display 48, the position where the operation button is released is determined. Recognized as the destination of the operation button. In addition, the display control unit 102 changes the display position of the operation button on the display 48 to the movement destination recognized by the touch input recognition unit 101.

  FIG. 15 is a flowchart showing a flow of an example of operation button movement processing in the present embodiment. This process is executed according to the program by the CPU 10 of FIG.

  Steps S41 to S45 are the same as steps S21 to 25 of FIG. 13 in the second embodiment, and a description thereof is omitted here.

  In step S46, an operation of dragging the operation button on the touch panel display 47 is detected. That is, the touch input recognition unit 101 detects a state where the operation button is not touched and released with a finger or the like, as shown in FIG.

  In step S47, an operation for moving the operation button while dragging it on the touch panel display 47 (draw operation) is detected. That is, the touch input recognition unit 101 detects that a linear trajectory has been drawn while the operation button is touched with a finger.

  In step S48, an operation of dropping the operation button on the touch panel display 47 is detected. That is, the touch input recognition unit 101 detects that a finger or the like has been released from the operation button as shown in FIG.

  In step S49, it is determined whether a position confirmation instruction has been accepted. If a position confirmation instruction has been accepted, the process proceeds to step S50, and if it is not a position confirmation instruction (for example, if a cancel instruction is input by drawing a trajectory marked with “×”), the process returns to step S45.

  Steps S50 to S53 are the same as steps S30 to 33 in FIG. 13 in the second embodiment, and a description thereof is omitted here.

  In the third embodiment, the same effect as in the second embodiment can be obtained. In addition, the display position of the operation button on the touch panel display 47 can be moved by simple touch input such as drag, draw, and drop.

  In the second embodiment and the third embodiment, the movable operation button is arbitrary. For example, the release button 81 described above may be moved.

(Fourth embodiment)
FIG. 17 is a block diagram illustrating an example of a main functional configuration of the CPU 10 of the digital camera 100 according to the fourth embodiment. In FIG. 17, the same reference numerals are given to the components shown in FIG. 4, and the description of the matters already described is omitted here.

  In FIG. 17, a touch input registration unit 107 registers a touch input. In this example, the touch input recognition unit 101 recognizes a locus freely drawn by the user touching the touch panel 49 with a finger or a pen, and the touch input registration unit 107 detects the locus recognized by the touch input recognition unit 101, and The correspondence relationship between the locus and the process executed by the execution control unit 103 is registered.

  FIG. 18 is a flowchart showing the flow of the touch input registration processing example in the present embodiment. This process is executed according to the program by the CPU of FIG.

  In step S61, the touch input registration mode is started. For example, the touch input registration mode is selected from the menu.

  In step S62, input form selection display is performed. That is, the display control unit 102 displays guidance on the display 48 so as to select a touch input form.

  In step S63, input mode selection is accepted. That is, the touch input recognition unit 101 detects selection of a touch input form.

  In this example, there are a point input, a locus input, and a combination input thereof as touch input forms. In this example, the form is selected by an operation button of the touch panel display 47.

  In step S64, a touch input instruction display is performed. That is, the display control unit 102 displays guidance on the display 48 so as to perform touch input.

  In step S65, the user performs touch input. A second touch input may be performed as necessary.

  In step S67, touch input recognition is performed. That is, the touch input recognition unit 101 recognizes a locus freely drawn by the user touching the touch panel 49 with a finger or a pen.

  In step S68, a recognition result is displayed. That is, the display control unit 102 displays the recognition result by the touch input recognition unit 101 on the display 48. In addition, the touch panel 49 accepts input of a user content confirmation result. In this example, whether or not the recognition result is OK is selected by an operation button on the touch panel display 47.

  In step S69, it is determined whether or not the content confirmation result is OK. If it is OK, the process proceeds to step S71. If it is NG, the touch input is reset in S70 and the process returns to step S64. .

  In step S71, response processing selection display is performed. That is, the display control unit 102 displays guidance so as to select a process to be executed by the execution control unit 103 in response to the touch input. In this example, a desired process is selected from a plurality of predetermined processes by operating buttons on the touch panel display 47.

  In step S72, response processing selection is accepted. That is, the touch input recognition unit 101 accepts selection of a touch input form. In addition, the touch panel 49 receives an input of a user's confirmation instruction.

  In step S73, it is determined whether or not it is confirmed. If it is confirmed, the process proceeds to step S74. If not confirmed, the process returns to step S72.

  In step S74, registration is performed. That is, the touch input registration unit 107 registers the correspondence relationship between the touch input recognized by the touch input recognition unit 101 and the process executed by the touch input and the execution control unit 103 in the EEPROM 20. For example, when the touch input form is a locus input, a locus freely drawn on the touch panel 49 and a correspondence relationship between the locus and the process are registered. For example, when the touch input form is a combination input, a combination of a point and a locus freely drawn on the touch panel 49 and a correspondence relationship between the combination and the process are registered.

  In step S75, it is determined whether or not the setting is completed. If the setting is to be ended, the touch input registration mode is ended in step S76, and if not, the process returns to step S62.

  Further, when the digital camera 100 is activated, the contents registered from the EEPROM 20 are read out by the touch input registration unit 107.

  FIG. 19 is an explanatory diagram illustrating an example of touch input for selecting a zoom operation. The zoom operation is designated by the touched position (point input position) on the touch panel 49. For example, when a short touch (tap input) is performed twice in succession so that the first circle is hit with a konkon, a fast WIDE operation is performed. Further, when the second circle is touched twice continuously, a fast TELE operation is performed. Further, when the third circle is touched twice continuously, a slow WIDE operation is performed. Further, when the fourth circle is touched twice continuously, a slow TELE operation is performed. In addition, when the fifth circle is continuously touched twice, the standard operation is reset. Thus, the zoom speed and selection of WIDE (wide angle side) and TELE (telephoto side) of the zoom lens 24z can be switched depending on the point input position. Such a point input position and a zoom operation (process) corresponding to the point input position can be registered by the touch input registration process shown in FIG. That is, the touch input and the pairing process are learned in advance.

  In addition, the optical zoom can be switched to the digital zoom by changing the number of touches. Such learning is also performed by the touch input registration process described above.

  20A to 20C are explanatory diagrams illustrating examples of touch input of an image erasing instruction. In this example, with the image recorded on the memory card 46 displayed on the display 48 as shown in FIG. 20A, a finger is touched on the touch panel 49 as shown in FIG. When the image erasing instruction is touch-input by turning around, the image erasing display is performed on the display 48 as shown in FIG. 20C, and the image erasing process is executed. Also, the image erasing process is switched when the speed of turning is changed. For example, when it is turned slowly, one frame is deleted, and when it is turned quickly, the contents in the folder are deleted.

FIGS. 21A to 21C are explanatory diagrams illustrating touch input examples of an image erasure stop instruction (referred to as an instruction to return to a state before the image erasure instruction) . In this example, when an image erasure instruction is touch-inputted, an image erasure display is performed on the display 48 as shown in FIG. This image erasure display indicates that image erasure processing for erasing an image recorded on the memory card 46 has started. Further, during the image erasure display shown in FIG. 21A, that is, during the image erasure processing, when “x” is touched on the touch panel 49 as shown in FIG. ) To return to the state before the image erasure instruction. That is, the image is returned to the state recorded on the memory card 46.

In the image erasing process, normally, the image is not completely erased from the memory card 46, but the image recording area of the memory card 46 is released. Therefore, when returning to the state before the image erasing instruction , processing for returning the image recording area from the open state to the unopened state is performed. In the mode of completely erasing the image from the memory card 46, the image in the memory card 46 is temporarily saved in the SDRAM 16 and then the image on the memory card 46 is erased to return to the state before the image erasure instruction. For this purpose, the image saved in the SDRAM 16 may be returned to the memory card 46.

  Also, after the clockwise spiral shown in FIG. 20B is drawn, when the counterclockwise spiral is drawn, that is, when it is recognized that the rotating direction is reversed, the image before the image erasing instruction is displayed. You may make it return to a state.

In this example, when a shooting instruction is touch-input by the release button 81, the image recording display is performed on the display 48. This image recording display indicates that an image recording process for recording an image captured by the image sensor 30 on the memory card 46 has started. Also, during the image recording, that is, during the image recording process, "×" in the trajectory on the touch panel 49 is touched input, return to the shooting instruction input previous state. That is, the captured image is returned to an unrecorded state, and the through image and the release button 81 are displayed on the display 48.

  In addition, although the case where the instruction to stop the processing such as the image recording processing and the image erasing processing is performed by inputting the “×” locus has been described as an example, the present invention is not particularly limited to such a case. For example, a stop instruction may be input by a “=” (double cancellation line) locus.

  Moreover, although the case where the stop instruction is performed by trajectory input has been described as an example, the present invention is not particularly limited to such a case. For example, a confirmation instruction input (or an OK instruction input) may be performed using a “re” (check) locus.

  According to the digital camera of the fourth embodiment, the user can register a free trajectory input that does not depend on the operation buttons, and thus can be operated easily. In addition, the user can experience the enjoyment of the operation by the locus input. In addition, since an instruction to stop processing such as image recording processing and image erasing processing can be performed by instantaneous trajectory input, even when a touch input unintended by the user is recognized and processing is started, “× It is possible to prevent malfunctions by inputting a locus such as “”.

  In addition, in order to make an understanding of this invention easy, although it demonstrated separately from 1st Embodiment to 4th Embodiment, it cannot be overemphasized that this invention may be implemented combining several embodiment.

  Moreover, although the case where this invention was applied to the digital camera was demonstrated to the example, this invention is not specifically limited in such a case, It is applicable to the various apparatuses provided with the touchscreen display. In addition to a digital camera, the present invention can be applied to various portable devices such as a mobile phone, a PDA, and a game device.

  The present invention is not limited to the examples described in the present specification and the examples illustrated in the drawings, and various design changes and improvements may be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... CPU, 24 ... Shooting lens, 24f ... Focus lens, 30 ... Image sensor, 38 ... Image input controller, 44 ... Media controller (recording means), 46 ... Memory card (recording medium), 47 ... Touch panel display, 48 ... Display 49, touch panel, 50 ... display driver, 51 ... touch panel driver, 81 ... release button (operation button), 90 ... surrounding locus, 91 ... specific target, 92 ... thumbnail image (reduced image), 100 ... digital camera, 101 ... Touch input recognition unit (recognition unit), 102 ... Display control unit, 103 ... Execution control unit, 104 ... Specific target detection unit, 105 ... AF control unit, 106 ... AE control unit, 107 ... Touch input registration unit (registration unit) )

Claims (19)

A touch panel display having a display for displaying and a touch panel for detecting touch input;
An imaging means having a focus lens and imaging a subject;
Recognizing means for recognizing a surrounding locus drawn by touching the touch panel in a state where a through image continuously output from the imaging means is displayed on the display ;
Focusing control means for focusing the subject specified by the trajectory surrounding the focus lens of the imaging means;
When the surrounding trajectory is recognized by the recognition means in a state where the through image is displayed on the display, a release button for inputting a shooting instruction is displayed on the display, and the surrounding in the through image is displayed. Display control means for extracting an image of an area designated by a locus from the through image and displaying it in the release button on the display;
Recording means for recording a captured image obtained by imaging by the imaging means on a recording medium;
Execution control means for capturing an image by the imaging means when the release button is touched, and recording the captured image obtained by the imaging on the recording medium by the recording means;
A portable device comprising: When the surrounding trajectory is recognized by the recognition means in a state where the through image is displayed on the display, one or more specific objects on the object scene specified by the surrounding trajectory in the through image are detected. Specific object detection means for
The focusing control unit focuses the focus lens of the imaging unit on the specific object on the object field,
The display control unit extracts the image of the specific target in the through image from the through image when the recognizing unit recognizes the surrounding locus while the through image is displayed on the display. The portable device according to claim 1, wherein the portable device is displayed in the release button. A touch panel display having a display for displaying and a touch panel for detecting touch input;
Recognizing means for recognizing a locus drawn by touching the touch panel in a state where an image is displayed on the display;
Imaging means for imaging a subject;
Display control means for displaying on the display a release button for inputting a photographing instruction when a trajectory surrounding the touch panel is drawn in a state where through images continuously output from the imaging means are displayed on the display. When,
Recording means for recording a captured image obtained by imaging by the imaging means on a recording medium;
Execution control means for capturing an image by the imaging means when the release button is touched, and recording the captured image obtained by the imaging on the recording medium by the recording means;
With
The recognizing means identifies a trajectory that is clockwise and drawn counterclockwise drawn by touching the touch panel,
The display control means switches between which of the plurality of end portions of the display the release button is displayed depending on the clockwise encircling locus and the counterclockwise encircling locus. A portable device characterized by that . A touch panel display having a display for displaying and a touch panel for detecting touch input;
Recognizing means for recognizing a locus drawn by touching the touch panel in a state where an image is displayed on the display;
Display control means capable of displaying an operation button corresponding to the recognized locus on the display;
Execution control means for executing processing corresponding to the operation button when the operation button is touched;
Imaging means for imaging a subject;
Recording means for recording a captured image obtained by imaging by the imaging means on a recording medium;
With
The display control means includes a release button for inputting a shooting instruction when a first locus is drawn on the touch panel in a state where a through image continuously output from the imaging means is displayed on the display. When displayed on the display and the release button is touched, an image recording display indicating the start of an image recording process for recording the captured image on the recording medium is displayed on the display,
The execution control means, when the second locus having a shape different from the first locus is recognized by the recognition means during the display of the image recording display, the captured image of the recording medium from the recording state. A portable device characterized by returning to an unrecorded state . The display control means, when the third locus is recognized by the recognition means, image erasure indicating the start of image erasure processing for changing the captured image recorded on the recording medium from the recorded state to the unrecorded state Display on the display,
The execution control means executes the image erasing process for changing the captured image recorded on the recording medium from a recorded state to an unrecorded state when the recognizing means recognizes the third locus, When the fourth track whose shape is different from the third track is recognized by the recognizing unit during the image erasure display, the captured image of the recording medium is returned from the unrecorded state to the recorded state. The portable device according to claim 4. The imaging means has a focus lens
Focusing control means for focusing the focus lens of the imaging means on the subject specified by an enclosing locus drawn by touching the touch panel;
The display control means is configured to display a through image continuously output from the imaging means on the display when the surrounding trajectory is recognized as the first trajectory by the recognition means. The mobile device according to claim 4 or 5, wherein an image of an area designated by the surrounding locus is extracted from the through image and displayed in the release button on the display . A touch panel display having a display for displaying and a touch panel for detecting touch input;
Recognizing means for recognizing a locus drawn by touching the touch panel in a state where an image is displayed on the display;
Display control means capable of displaying an operation button corresponding to the recognized locus on the display;
Execution control means for executing processing corresponding to the operation button when the operation button is touched;
With
The display control means displays an image erasure display indicating the start of an image erasure process for changing an image recorded on a recording medium from a recorded state to an unrecorded state when the first locus is recognized by the recognition means. Display on the display,
The execution control unit executes the image erasing process for changing the image recorded on the recording medium from a recorded state to an unrecorded state when the first locus is recognized by the recognizing unit, and the image When the second track whose shape is different from the first track is recognized by the recognition means during the display of the erase display, the image on the recording medium is returned from the unrecorded state to the recorded state. Features portable devices . An imaging means having a focus lens and imaging a subject;
Recording means for recording a captured image obtained by imaging by the imaging means on a recording medium;
Focusing control means for focusing the focus lens of the imaging means on the subject specified by an enclosing locus drawn by touching the touch panel;
With
The display control means includes a release button for inputting a shooting instruction when the recognizing means recognizes the surrounding trajectory while the through image continuously output from the imaging means is displayed on the display. Displaying on the display, and extracting an image of the area specified by the surrounding locus in the through image from the through image and displaying it in the release button on the display;
8. The execution control means, when the release button is touched, takes an image by the imaging means and records the captured image obtained by the imaging on the recording medium by the recording means. The portable device as described in . A specific target detection for detecting a specific target on the object scene designated by the surrounding trajectory in the through image when the surrounding trajectory is recognized by the recognition means in a state where the through image is displayed on the display. With means,
The focusing control unit focuses the focus lens of the imaging unit on the specific target,
The display control means displays a release button for inputting a photographing instruction on the display when the surrounding locus is recognized by the recognition means in a state where the through image is displayed on the display, and the through 9. The portable device according to claim 6, wherein the image of the specific target in the image is extracted from the through image and displayed in the release button on the display. The portable device according to any one of claims 1, 2, 4, 5, 6, 8, and 9, wherein the display control means displays the release button on an end portion of the display. The recognizing means identifies a trajectory that is clockwise and drawn counterclockwise drawn by touching the touch panel,
The display control means switches between which of the plurality of end portions of the display the release button is displayed depending on the clockwise encircling locus and the counterclockwise encircling locus. The portable device according to claim 10 . The recognizing means recognizes the touched position as the movement destination of the release button when an arbitrary position on the touch panel is touched in a state where the release button is displayed on the display,
The portable device according to any one of claims 1 to 6 and 8 to 11 , wherein the display control means changes a display position of the release button on the display to the movement destination. The recognizing unit recognizes an operation of moving the release button while touching the release button on the touch panel while the release button is displayed on the display, and moves the release button to a position where the release button is released. Recognize the destination,
The portable device according to any one of claims 1 to 6 and 8 to 11 , wherein the display control means changes a display position of the release button on the display to the movement destination. Freely trail drawn on the touch panel, and any one of claims 1, characterized in that it comprises a registration means for registering a correspondence relationship between the processing executed by the execution control means and the trajectory 13 Item 1. A portable device according to item 1. A touch panel display having a display for displaying and a touch panel for detecting touch input, an imaging unit having a focus lens and imaging a subject, and a captured image obtained by imaging by the imaging unit is recorded on a recording medium. An operation control method using recording means ,
Recognizing a surrounding locus drawn by touching the touch panel in a state where a through image continuously output from the imaging means is displayed on the display ;
Focusing the subject specified by the trajectory surrounding the focus lens of the imaging means;
When the surrounding locus is recognized in a state where the through image is displayed on the display, a release button for inputting a shooting instruction is displayed on the display , and designated by the surrounding locus in the through image Extracting an image of a region from the through image and displaying it in the release button on the display;
When the release button is touched, imaging by the imaging unit and recording the captured image obtained by the imaging on the recording medium by the recording unit;
The operation control method characterized by including. Detecting the one or more specific objects on the object field specified by the surrounding locus in the through image when the surrounding locus is recognized in a state where the through image is displayed on the display. ,
When the surrounding trajectory is recognized with the through image displayed on the display, the focus lens of the imaging unit is focused on the specific target, and a release button for inputting a shooting instruction is displayed on the display. 16. The operation control method according to claim 15, wherein the operation control method is displayed and the image of the specific target in the through image is extracted from the through image and displayed in the release button on the display. A touch panel display having a display for displaying and a touch panel for detecting touch input, an imaging unit having a focus lens and imaging a subject, and a captured image obtained by imaging by the imaging unit is recorded on a recording medium. An operation control method using recording means,
Recognizing a locus drawn by touching the touch panel with an image displayed on the display;
Displaying a release button for inputting a photographing instruction on the display when a locus surrounding the touch panel is drawn in a state where a through image continuously output from the imaging unit is displayed on the display;
When the release button is touched, performing a process of capturing an image by the imaging unit and recording the captured image obtained by the imaging on the recording medium by the recording unit;
Including
Identifying a clockwise and counterclockwise trajectory drawn by touching the touch panel, and a plurality of the displays in the clockwise encircling trajectory and the counterclockwise enclosing trajectory An operation control method for switching between which one of the ends of the shutter button the display of the release button is performed. A touch panel display having a display for displaying and a touch panel for detecting touch input, an imaging unit having a focus lens and imaging a subject, and a captured image obtained by imaging by the imaging unit is recorded on a recording medium. An operation control method using recording means,
Recognizing a locus drawn by touching the touch panel in a state where an image is displayed on the display;
Displaying a release button for inputting a shooting instruction on the display when a first locus is drawn on the touch panel in a state where a through image continuously output from the imaging unit is displayed on the display; ,
When the release button is touched, causing the display to display an image recording display indicating the start of an image recording process that is a process of recording the captured image on the recording medium;
The step of taking an image by the imaging unit and recording the captured image obtained by the imaging on the recording medium by the recording unit, wherein the first locus has a shape during display of the image recording display. Returning a captured image of the recording medium from a recorded state to an unrecorded state when a different second locus is recognized;
The operation control method characterized by including . An operation control method using a touch panel display having a display for displaying and a touch panel for detecting touch input,
Recognizing a locus drawn by touching the touch panel in a state where an image is displayed on the display;
Displaying an operation button corresponding to the recognized locus on the display;
Executing a process corresponding to the operation button when the operation button is touched;
Image erasure indicating the start of an image erasure process, which is a process of erasing an image recorded on a recording medium when a first locus for instructing the start of an image erasure process for erasing an image recorded on the recording medium is recognized Displaying a display on the display;
Executing the image erasing process by changing an image recorded on the recording medium from a recorded state to an unrecorded state, wherein the first locus has a shape during display of the image erasure display. Returning the image of the recording medium from an unrecorded state to a recorded state when a different second trajectory is recognized;
The operation control method characterized by including .

Images