JP4586470B2 - Digital camera - Google Patents

Description

The present invention relates to a digital camera including an image recognition device.

With the recent spread of digital cameras, many users carry digital cameras when they go out, such as daily life, travel, and business trips. In addition, in order to know information on unknown objects (animals, plants, buildings, etc.) on the go, you must check with a guidebook or picture book, and carry the guidebook or picture book separately from the digital camera. However, in order to obtain information on many objects, different types of guidebooks and pictorial books are carried, which is not realistic. Due to the above-described circumstances, there are those that can store picture book data in an image processing apparatus and search and display information data of a subject from a captured image. (For example, Patent Document 1)
JP 2000-113097

  However, even in the above-mentioned Patent Document 1, it takes a long time to retrieve subject information from a photographed image from pictorial book data, which is inconvenient. In addition, the time required for searching can be shortened by transmitting a captured image to a high-speed terminal through communication, but the time required for searching can be shortened if the data capacity during communication is large, and the time required for searching generally increases.

  The present invention provides a highly convenient digital camera and digital camera system with improved operability and subject information search speed.

The digital camera according to claim 1, wherein a shooting mode setting means for setting one shooting mode from a plurality of shooting modes suitable for each of a plurality of shooting situations, and a shooting mode set by the shooting mode setting means. Imaging means for imaging a subject and outputting image data, feature information extracting means for extracting feature information of the subject from the image data output by the imaging means, and a plurality of objects The shooting mode setting is performed by recording information relating to the description and characteristic information of each object in association with each other and referring to a database in which information relating to the size of the object is recorded by being classified into a plurality of associated categories. The size of the object to be searched is determined based on the shooting mode set by the means, and the determined object is Selection means for selecting, as a search target, a category associated with information related to severity, and comparison means for comparing feature information of the object of the category selected as the search target by the selection means with feature information of the subject. And determining means for determining information relating to the description of the object corresponding to the subject in accordance with a comparison result by the comparing means.

The digital camera according to claim 10, an imaging unit that images a subject and outputs image data, a main imaging instruction member that is operated to instruct imaging of a recording image by the imaging unit, and the main imaging When the pointing member is operated, recording image generation means for generating recording image data from the image data output by the imaging means, and display image data are generated from the image data output by the imaging means. A display image generating unit; a display control unit for displaying an image as a moving image on a display medium based on the display image data generated by the display image generating unit; and a subject image based on the display image data. Feature information extracting means for extracting feature information, and information related to the explanation of each object and feature information of each object are recorded in association with a plurality of objects. Referring to the database, a comparison unit that compares the feature information of the object and the feature information of the subject, and information related to the description of the object corresponding to the subject is determined according to a comparison result by the comparison unit. A display unit that outputs the recording image data generated by the recording image generation unit when the main imaging instruction member is operated and the time point when the main imaging instruction member is operated; And recording means for associating and recording information relating to the description of the object corresponding to the subject determined by the determining means based on image data.

According to the digital camera of the first to fourth aspects, since the search condition is set based on the photographing condition of the digital camera, the search speed of the subject information is improved.
According to the digital camera of the fifth to ninth aspects, it is possible to quickly provide the search target information to the user by reproducing the search target information by voice.

  According to the digital camera of the tenth to fourteenth aspects, since the recognition process is started by the operation member to which a plurality of processes are assigned, it is not necessary to add a new member for starting the subject recognition process. good.

A digital camera to which the present invention is applied will be described with reference to FIGS.
<First embodiment>
<Configuration>
FIG. 1 is a perspective view of a digital camera 1 to which the present invention is applied. This is a lens-integrated digital camera in which an imaging lens (not shown) is provided integrally with the camera body on the front surface of the camera body.

  The digital camera 1 is provided with a power button 2, a release button 3 on the top surface, a rear liquid crystal 4 on the back surface, an operation mode dial 5, a cross key 6, a decision button 7, a menu button 8, an image playback button 9, and a speaker 10. ing.

  The release button 3 is composed of two switches, and the first release switch (hereinafter referred to as SW1) is turned on in the half-pressed state, and the second release switch (hereinafter referred to as SW2) is turned on in the fully-pressed state. The rear liquid crystal 4 is a liquid crystal panel. The operation mode dial 5 is a rotary dial switch. The cross key 6 is a switch having electrical contacts in four directions, up, down, left, and right, and is mainly used for changing menu items displayed on the rear liquid crystal 4 and setting operations such as an imaging condition. The power button 2, the decision button 7, the menu button 8, and the image reproduction button 9 are momentary switches. The speaker 10 is a speaker that reproduces sound such as start-up sound, operation sound, and subject sound information.

  FIG. 2 shows a block diagram of a digital camera 1 to which the present invention is applied. The control unit 20 includes an image processing unit 23, a liquid crystal control unit 24, a RAM 25, a ROM 26, an EEPROM 27, an external memory 28, a mass storage medium 29, a subject recognition unit 30, a position detection unit 31, a date detection unit 32, an operation unit 33, An imaging element driving unit 34, an imaging optical driving unit 35, and an audio reproduction unit 36 are connected. The imaging optical unit 21 is connected to the imaging optical drive unit 35, the imaging device 22 is connected to the image processing unit 23 and the imaging device driving unit 34, and the rear liquid crystal 4 is connected to the liquid crystal control unit 24.

Hereinafter, basic processing in the constituent members of the digital camera 1 in the present embodiment will be described.
<Control unit>
The control unit 20 includes a CPU and the like and controls the connected members.
<Focus and aperture processing>
The imaging optical unit 21 includes an imaging lens, a diaphragm mechanism, and the like. Further, the focus, aperture value, and the like are adjusted by driving the imaging lens, the diaphragm mechanism, and the like by the imaging optical drive unit 35. The digital camera 1 according to the present embodiment has a macro drive mode as a lens drive mode in which the normal drive mode and the focus adjustable distance are shorter than those in the normal motion mode.
<Imaging and image processing>
The image sensor 22 is a solid-state image sensor such as a CCD or a CMOS that converts an object image formed by an imaging lens included in the imaging optical unit 21 into an electrical signal. The image sensor 22 is controlled by the image sensor drive unit 34 such as reading of an image signal, control driving of an electronic shutter, and the like. The image signal read from the image sensor 22 is sent to the image processing unit 23. The image signal sent to the image processing unit 23 is subjected to processing such as noise removal, A / D conversion, color interpolation processing, size change, and encoding as necessary, and display image data displayed on the rear liquid crystal 4. Or converted into image data for recording stored in the external memory 28 or the like.

  The digital camera 1 in the present embodiment mainly uses an electronic shutter that determines the exposure time by controlling the accumulation time in the image sensor 22. In addition, as a series of driving processes by the image sensor 22, the image processing unit 23, the image sensor driving unit 34, and the like, a through image reproduction process for displaying a subject image formed on the image sensor 22 on the rear liquid crystal 4 as a moving image, There is a photographing recording process for recording as an image.

  In the through image reproduction process, an image signal of 10 to 30 frames per second is read from the image sensor 22 at a high speed by driving the image sensor drive unit 34. The read image signal is subjected to various processes by the image processing unit 23 and converted into display image data, and is displayed as a moving image on the rear liquid crystal 4 by the liquid crystal control unit 24.

In the imaging / recording process, an image signal is read from the image sensor 22 by driving the image sensor drive unit 34. The read image signal is subjected to various processes by the image processing unit 23, and is converted into image data for recording and display image data as required. The recording image data is stored in the external memory 28 or the like, and the display image data is displayed on the rear liquid crystal 4 by the liquid crystal control unit 24. The recording image data may be stored in the EEPROM 27, the large capacity storage medium 29, or the like.
<Recording process>
The RAM 25 is used as a temporary storage location for data when the control unit 20 and the image processing unit 23 perform processing. The ROM 26 stores programs necessary for the operation of the digital camera 1, initial values used for the programs, and the like. The EEPROM 27 is a built-in flash memory that retains recorded information even when the power of the digital camera 1 is turned off. Information such as user settings and custom settings of the digital camera 1 is recorded in the EEPROM 27. The external memory 28 is a removable memory card for storing recording image data and the like. The large-capacity storage medium 29 is a storage medium such as a large-capacity magnetic disk such as a hard disk or a large-capacity optical disk such as a DVD in which image data, picture book data, and the like are stored.
<Picture book data>
The large-capacity storage medium 29 stores picture book data divided into categories of animals, plants, insects, and building landscapes. Each picture book item of each picture book data includes characteristic information and display information. The feature information is, for example, information for specifying the subject such as contour information, color, position information in the case of a fixed object, and date information of information that can estimate the inhabiting time. The display information is descriptive information such as the names and descriptive texts of items that match the feature information. In addition, the picture book item having voice information includes the voice information in the display information of the picture book item. For example, the voice information is a cry of animals or insects. The audio information is processed by the audio reproduction unit 36 and reproduced from the speaker 10. The picture book data is further classified according to the size of the object of the picture book item included in the picture book. Encyclopedia data for objects of 1 m or less is classified as “small”, encyclopedia data for objects of 1 to 4 m is “medium”, and encyclopedia data for objects of 2 m or more is “large”. Set to classification. The size classification of each picture book data may not be included in the picture book data, and in this case, it may be set by the user when the picture book is stored in the digital camera 1. The pictorial book data may be stored in the external memory 28, the EEPROM 27, the ROM 26, or the like. In addition, although the case where the animal picture book, the plant picture book, the insect picture book, and the building landscape picture book were memorize | stored in the digital camera 1 was demonstrated, it is not restricted to this as picture book data. For example, a vehicle picture book containing data of vehicles such as automobiles, or a person picture book containing celebrity data may be used.
<Subject recognition processing>
The subject recognition unit 30 extracts subject feature information from the subject image data processed by the image processing unit 23 and stores it in the RAM 25. Furthermore, the picture book data to be searched or the picture book item of the picture book data is selected from the search conditions, and the picture book item having the feature information that matches the feature information of the subject is selected as the picture book data or the picture book of the picture book data. Search from the item and provide it as subject information.

The search conditions are set based on shooting conditions such as position information, date information, and exposure mode of the digital camera 1. From the exposure mode, a search category is set as a search condition. The position information, date information, exposure mode, and search category will be described later. In the above description, the search condition is set based on shooting conditions such as position information, date information, and exposure mode. However, the present invention is not limited to this. For example, distance information to the subject, color information of the subject, or the like may be used as the imaging condition for setting the search condition.
<Location date detection processing>
The position detection unit 31 has a position information acquisition unit such as GPS, and acquires the current position of the digital camera 1. The acquired position information of the digital camera 1 is stored in the RAM 25 as one of the search conditions. As a method for acquiring the current position by the position information acquisition unit, any method may be used as long as the position is calculated by receiving radio waves from a plurality of radio base stations. Further, as the position information acquisition method, the position information may be input by the user.

The date detection unit 32 includes a date / time acquisition unit such as a GPS or an internal clock of the digital camera 1, and acquires a date or time. The acquired date information is stored in the RAM 25 as one of the search conditions.
<Image display processing>
The liquid crystal control unit 24 causes the liquid crystal display unit 4 to display the display image data sent in response to a command from the control unit 20.
<Superimpose display>
The digital camera 1 according to the present embodiment can perform superimpose display in which superimposition information such as character information is superimposed on image data displayed on the rear liquid crystal 4. The superimpose information is stored in a superimpose information storage area of the RAM 25. When superimpose display is performed, the superimpose information stored in the superimpose information storage area of the RAM 25 is read and combined with display image data, and then displayed on the rear liquid crystal 4 by the liquid crystal controller 24. That is, when the data in the superimpose area of the RAM 25 is updated, an image reflecting the update is displayed on the rear liquid crystal 4 in the next display process.
<Operation unit>
The operation unit 33 includes a power button 2, a release button 3, an operation mode dial 5, a cross key 6, a determination button 7, a menu button 8, an image reproduction button 9, and the like.

Hereinafter, the operation of the digital camera 1 will be described.
<Main flow>
Hereinafter, the main flow of the digital camera 1 in the present embodiment will be described with reference to FIG.

  First, when the power button 2 is pressed, activation processing of the image sensor 22, the image processing unit 23, and the like is performed in step S101. Next, in step S102, it is determined whether or not the power button 2 has been pressed. If the power button 2 is pressed, the process proceeds to step S108, and the image sensor 22, the image processing unit 23, and the like are terminated and the power is turned off. If the power button 2 is not pressed, the process proceeds to step S103. In step S103, it is determined whether or not the operation mode is a shooting mode.

  In the digital camera 1 in the present embodiment, an operation mode such as a shooting mode for performing an imaging operation and processing of a captured image, a menu mode for setting various functions, and an image playback mode for displaying a captured image on the liquid crystal panel 4 or the like. have. The change to each operation mode is performed by operating the mode dial 5, the menu button 8, the image reproduction button 9, and the like.

When the operation mode is the shooting mode, the process proceeds to a shooting mode subroutine of step S105, and when the operation mode is not the shooting mode, the process proceeds to step S104. In step S104, it is determined whether or not the operation mode is the menu mode. If the operation mode is the menu mode, the process proceeds to menu mode processing in step S106, and if the operation mode is not the menu mode, the process proceeds to image display mode in step S107. When the shooting mode subroutine in step S105, the menu mode process in step S106, and the image display mode process in step S107 are completed, the process returns to step S102.
<Description of operation in each operation mode>
Hereinafter, processing in each of the above operation modes will be described.
<Shooting mode>
The shooting mode will be described. When the imaging mode is entered, the above-described through image reproduction process is started and a moving image is displayed on the rear liquid crystal 4. The user can determine the imaging composition while confirming the moving image of the subject image displayed on the rear liquid crystal 4.

  Further, by pressing the release button 3 from the half-pressed state to the fully-pressed state, the through image reproduction process is switched to the shooting / recording process, and a still image can be captured and recorded. When the photographing / recording process is completed, the process switches to the through image reproduction process again.

  In the shooting mode, an auto mode that sets an imaging condition by an imaging condition function that assumes a general shooting scene, a macro mode that sets an optimal imaging condition by an imaging condition function that assumes that an object in close proximity is in focus, and The portrait mode for setting an optimal imaging condition by an imaging condition function assuming shooting of a person as a main subject and the landscape mode for setting an optimal imaging condition by an imaging condition function with a landscape as a main subject Has an exposure mode. In each exposure mode, imaging conditions are determined by different imaging condition functions. The imaging condition function is a function for obtaining a combination of the shutter speed and the aperture value according to the exposure value. A front view of the mode dial 5 is shown in FIG. 4a, and a front view of the cross key 6 is shown in FIG. 4b. The user can change the exposure mode to auto mode, portrait mode, and landscape mode by rotating the mode dial 5 to any position. When the exposure mode is set to auto mode, The macro mode can be changed by pressing the key 6b.

  The digital camera 1 in the present embodiment further has a subject recognition mode for displaying subject information such as the name of the subject displayed on the rear liquid crystal 4 and an explanatory note. In each exposure mode described above, the subject recognition mode is turned ON / OFF by pressing the right direction key 6d of the cross key 6.

Subject recognition starts when the release button 3 is pressed halfway (SW1 is turned on). When the subject recognition is completed, the recognized subject information is superimposed on the moving image displayed on the rear liquid crystal 4 and displayed on the rear liquid crystal 4. If the recognized subject information includes audio information, the audio information can be reproduced when the subject recognition is completed or when the release button 3 is fully pressed. When the release button 3 is fully pressed (SW2 is turned on) with the subject information displayed on the rear liquid crystal 4, the subject information is used as a recording image file together with the recording image data picked up by the photographing and recording processing described above. It can also be recorded in the external memory 28 or the like.
<Subject recognition processing>
The subject recognition process described above is started by half-pressing the release button 3. When the subject recognition process is started, one of the display image data used in the through image reproduction process is stored in the RAM 25 as recognition image data. Next, the subject recognition unit 30 processes the recognition image data and extracts feature information of the subject. It should be noted that a plurality of display image data used for through image reproduction processing is captured and stored in the RAM 25 as recognition image data, and subject feature information is extracted by processing the plurality of recognition data by the subject recognition unit 30. You may do that.

Next, a picture book item having feature information that matches the feature information of the subject is searched from the picture book data set as a search target by the search category. The search is started from the pictorial book with the highest search priority. If a pictorial book item having characteristic information that matches the subject characteristic information cannot be detected, the process moves to searching for a pictorial book with a low priority. When a pictorial book item having characteristic information that matches the subject characteristic information is selected, display information for the pictorial book item is stored as superimpose information in the superimpose information storage area of the RAM 25 as subject information.
<Search category>
The pictorial book to be searched and the search priority of the pictorial book are set by the search category. The search category is set in conjunction with each exposure mode when the subject recognition process is turned on when the currently set exposure mode is set to other than auto mode, and the exposure mode is set to auto mode. If the subject recognition process is turned on, it is set by the user. FIG. 5a shows the priority search order based on the size classification of the search category set when the subject recognition is turned on in each exposure mode, and FIG. 5b shows the search category set in the present embodiment. When the exposure mode is set to the macro mode, the subject size is considered to be 1 m or less. First, a picture book corresponding to the “small” category is searched, and then a picture book corresponding to the “medium” category is searched. A search category is set with priorities. In the present embodiment, a flower picture book with classification “small” is searched first, and if there is no picture book item that matches the feature information of the subject, then an insect picture book with classification “small”, and finally a classification “medium”. The search category is set to search for the animal picture book. When the exposure mode is set to portrait mode, the subject size is assumed to be about 1 to 4 m, and a pictorial book corresponding to the “medium” category is searched first, followed by a pictorial book corresponding to the “large” category. A search category is set and a priority is set so as to search. In this embodiment, first, the animal picture book corresponding to the classification “medium” is searched, and if there is no picture book item that matches the feature information of the subject, the search category is searched so that the building landscape picture book corresponding to the classification “large” is searched next. Is set. If the exposure mode is set to landscape mode, think that the subject size is about 2m or more, first search the picture book corresponding to the "large" classification, and then search the picture book corresponding to the "medium" classification A search category is set with priorities. In the present embodiment, first, the building landscape picture book corresponding to the classification “large” is searched, and if there is no picture book item that matches the feature information of the subject, the search is performed so that the animal picture book corresponding to the classification “medium” is searched next. A category is set. When the exposure mode is set to the auto mode, the user selects a picture book to be searched. If the subject recognition process is turned on when the exposure mode is set to the auto mode, the process proceeds to a process of selecting picture book data to be searched. The user selects a picture book to be used from “flower picture book”, “insect picture book”, “animal picture book”, “building landscape picture book”, and “all picture books” and sets it in the search category. When “all pictorial books” is selected, as shown in FIG. 5b, search categories are set so that an animal pictorial book, a building landscape picture book, a flower picture book, and an insect picture book are searched in this order. In other words, in exposure modes other than auto mode, the picture book to be searched is selected in conjunction with the exposure mode, and the search order is set in the search category, so it is possible to search only for the best picture book data for each exposure mode. It can reduce the false detection rate, improve the search system, and shorten the search time. In addition, when the user has previously determined the category of the subject to be recognized, it can be set to auto mode and specific picture book data can be set as the search category, further reducing the false detection rate, improving the search system, and searching time Can be shortened. Furthermore, even when the subject recognized by the user is unknown and the category cannot be specified, all the pictorial books can be set as the search category in the auto mode, so that appropriate subject information can be obtained.

In addition, when searching for a building landscape picture book, the position information of the digital camera 1 is acquired from the position detection unit 31, and the picture book item to be searched is further reduced to a picture book item having position information close to the position information. And search. Further, when searching for a flower picture book or an insect picture book, date / time information is acquired from the date detection unit 32, and the picture book item to be searched is further reduced to a picture book item having date / time information close to the date / time information. . In other words, when searching for a building landscape picture book, a flower picture book, and an insect picture book, the picture book items used for the search can be reduced among the picture book items of each picture book data by the position information and date / time information described above, so the search time can be shortened. It becomes possible.
<Audio playback settings>
In the present embodiment, it can be set so that the audio information is reproduced from the speaker 10 when audio information is included in the pictorial book item selected as subject information by the search. The audio reproduction setting that can be set includes audio reproduction pattern 1 for reproducing audio information when the selected subject information includes audio information after the subject information is selected, and release button 3 is fully pressed after the selection of the subject information ( When SW2 is turned ON, there are an audio reproduction pattern 2 for reproducing audio information when audio information is included in the selected subject information, and an audio reproduction pattern 3 for not reproducing audio information in the shooting mode. The sound reproduction pattern can be arbitrarily set by the user in the menu mode. The menu mode will be described later.

The audio information of the subject information can also be reproduced when the recording image file stored with the subject information by the above-described shooting and recording process is displayed on the rear liquid crystal 4 in the image display mode. Details will be described in the description of the image display mode described later.
<Flow of shooting mode>
Hereinafter, processing in the shooting mode subroutine of the digital camera 1 in the present embodiment will be described with reference to the drawings.

FIG. 6 shows a flow of the shooting mode in the present embodiment. When the operation mode is changed to the shooting mode, the shooting mode subroutine is entered. First, in step S201, a start instruction for through image reproduction processing is issued, and the process proceeds to step S202. Here, a through image reproduction process that is performed in parallel with the main shooting mode subroutine will be described.
<Through-image playback processing>
FIG. 7 shows a flow of the through image reproduction process. When the through image reproduction process is started, 4 is assigned to FlagN in step S301. In step S302, an image signal is read from the image sensor 22 under the control of the image sensor driving unit. In step S303, the image signal is processed by the image processing unit 23 and converted to display image data. Next, in step S304, it is determined whether SW1 is ON. If SW1 is ON, the process proceeds to step S310. If SW1 is not ON, the process proceeds to step S305. In step S305, it is determined whether FlagN is 4. If FlagN is not 4, 1 is added to FlagN in step S309, and the process proceeds to step S310. If FlagN is 4, the process proceeds to step S306. In step S306, the subject luminance value is calculated from the display image obtained in step S303. In step S307, the shutter speed is adjusted based on the calculated subject luminance value. In step S308, 0 is substituted for FlagN, and the process proceeds to step S310. In step S310, superimpose information is read from the RAM 25, and in step S311, the superimpose information is combined with display image data, and the combined display image data is displayed on the rear liquid crystal 4 by the liquid crystal control unit 24. . Next, in step S312, it is determined whether or not there is an instruction to stop the through image reproduction process. If there is no instruction to stop the through image reproduction process, the process returns to step S302. The image reproduction process ends.

  Steps S302 to S311 described above are looped until an instruction to stop the through image reproduction process is issued, and the display of the subject moving image is continued on the rear liquid crystal 4. During the through image reproduction process, the loop of Steps S302 to S311 is counted by FlagN, and the shutter speed with respect to the subject luminance value is evaluated once every four loops by Steps S306 to S308, and adjustment is made so as to obtain an appropriate exposure. The loop rate is about 10-30 per second and is changed by the shutter speed. When the release button 3 is pressed halfway (SW1 is turned on), the shutter speed is fixed for the image recording process, so that the processes in steps S305 to S309 are passed.

Returning to the description of the shooting mode subroutine processing. When a through image reproduction process start command is issued in step S201, the process proceeds to an exposure mode setting process subroutine in step S202.
<Exposure mode setting process>
The exposure mode setting process will be described. In the exposure mode setting process, the lens drive mode, function setting, and search category setting for priority search when the object recognition mode is set are changed according to each exposure mode. When the subject recognition mode is ON, a search category used during subject recognition processing is set in accordance with each exposure mode. The exposure mode setting process is performed when the shooting mode is started (step S202) and when the exposure mode is changed (including when the subject recognition process is turned on and off) (step S205).

FIG. 8 shows a flow of the exposure mode setting subroutine. First, in step S401, it is determined whether or not the set exposure mode is the auto mode. If the exposure mode is set to the auto mode, the process proceeds to step S402, and the exposure mode is not set to the auto mode. In this case, the process proceeds to step S406. In step S402, the lens driving mode is set to the normal mode. In step S403, the imaging function for calculating the imaging settings used at the time of imaging is changed for the auto mode. In step S404, it is determined whether or not the subject recognition mode is set. If the subject recognition mode is set, the process proceeds to step S405. If the subject recognition mode is not set, the exposure mode setting subroutine is terminated. To do. In step S405, in the search category selection processing subroutine, a search category used for subject recognition processing is set. When the search category selection process subroutine in step S405 is completed, the exposure mode setting process subroutine is terminated.
<Search category setting process>
Here, the search category setting processing subroutine will be described.

  When the exposure mode is set to the auto mode, it is necessary to set the picture book to be searched, that is, the search category by the user. Therefore, when the subject recognition process is turned on during the auto mode, the search category setting process is also performed during the exposure mode setting process. If it is desired to change only the search category again after the exposure mode setting process, the search category process can be set by pressing the left key 6c of the cross key 6 (steps S206 to S207).

  FIG. 9 shows a flow of the search category selection processing subroutine. When the search category selection processing subroutine is entered, first, the through image reproduction processing is stopped in step S501. In step S501, a picture book selection menu is displayed on the rear liquid crystal 4. FIG. 10B shows a picture book selection menu displayed on the rear liquid crystal 4. In the pictorial book menu, the pictorial book names that can be set in the search category are displayed, and one of them is highlighted. The user can move the highlight display by arbitrarily pressing the cross key 6 in the vertical direction, and by pressing the enter button 7 with the picture book name to be selected highlighted, The highlighted picture book can be set as the search category. In step S503, it is determined whether or not the cross key 6 has been pressed. When the cross key 6 is pressed, the process proceeds to step S504, and when the cross key 6 is not pressed, the process proceeds to step S505. In step S504, the picture book name highlighted is changed to the picture book name in the direction in which the cross key 6 is pressed. In step S505, it is determined whether or not the enter button 7 has been pressed. When the determination button 7 is pressed, the process proceeds to step S506, and when the determination button 7 is not pressed, the process returns to step S503. In step S506, the highlighted pictorial book is set as a search category. In step S507, a start instruction for through image reproduction processing is issued, and the search category selection processing subroutine ends.

  Returning to the description of the exposure mode setting processing subroutine. In step S406, it is determined whether or not the set exposure mode is a landscape mode. If the exposure mode is set to landscape mode, the process proceeds to step S407, and if the exposure mode is not set to landscape mode, the process proceeds to step S412. In step S407, the lens driving mode is set to the normal mode. In step S408, the imaging function for calculating the imaging settings used at the time of imaging is changed for landscape mode. In step S409, it is determined whether or not the subject recognition mode is set. If the subject recognition mode is set, the process proceeds to step S410. If the subject recognition mode is not set, the exposure mode setting subroutine is terminated. To do. In step S410, the search category is set for landscape mode (see FIG. 5b), and the exposure mode setting processing subroutine is terminated.

In step S411, it is determined whether or not the set exposure mode is the portrait mode. If the exposure mode is set to the portrait mode, the process proceeds to step S412. If the exposure mode is not set to the portrait mode, the process proceeds to step S416. In step S412, the lens driving mode is set to the normal mode. In step S413, the imaging function for calculating the imaging setting used at the time of imaging is changed for the portrait mode. In step S414, it is determined whether or not the subject recognition mode is set. If the subject recognition mode is set, the process proceeds to step S415. If the subject recognition mode is not set, the exposure mode setting processing subroutine is executed. finish. In step S415, the search category is set for portrait (see FIG. 5b), and the exposure mode setting subroutine is terminated.
If the result in step S411 is negative, the exposure mode is the macro mode, so the processing in steps S416 to S419 sets the macro mode. In step S416, the lens driving mode is set to the macro mode. In step S417, the imaging function for calculating the imaging setting used at the time of imaging is changed for the macro mode. In step S418, it is determined whether or not the subject recognition mode is set. If the subject recognition mode is set, the process proceeds to step S419. If the subject recognition mode is not set, the exposure mode setting subroutine is terminated. To do. In step S419, the search category is set for the macro mode (see FIG. 5b), and the exposure mode setting processing subroutine ends. The search category set in each exposure mode is set with a search priority assigned to the picture book to be searched as shown in FIG. 5b.

  Returning to the description of the shooting mode subroutine. When the exposure mode selection processing subroutine ends, the process proceeds to step S203. In step S203, it is determined whether or not SW1 is turned on. If SW1 is not turned on, the process proceeds to step S204. If SW1 is turned on, the process proceeds to step S210. In step S204, it is determined whether or not the exposure mode or subject recognition mode setting (ON, OFF) has been changed. If the setting of the exposure mode or the subject recognition mode has been changed, the process proceeds to step S205, and if the setting of the exposure mode or the subject recognition mode has not been changed, the process proceeds to step S206. In step S205, the process proceeds to the above-described exposure mode setting processing subroutine, where the lens mode and imaging condition function are set, and the search category is set as necessary. In step S206, it is determined whether or not the exposure mode is set to the auto mode and the subject recognition mode, and the left key 6c of the cross key 6 is pressed. If the exposure mode is the auto mode and the subject recognition mode is set, and the left key 6c of the cross key 6 is pressed, the process proceeds to step S207, and the exposure mode is not the auto mode or the subject recognition mode is not set. Alternatively, if the left key 6c of the cross key 6 is not pressed, the process proceeds to step S208. In step S207, the process moves to the above-described search category selection processing subroutine, and a search category is set. In step S208, it is determined whether or not the operation mode has been changed from the shooting mode to another mode. If the operation mode remains the shooting mode, the process returns to step S203. If the operation mode is changed to a mode other than the shooting mode, the process proceeds to step S209. In step S209, after issuing an instruction to stop the through image reproduction process, the shooting mode subroutine is terminated, and the process returns to step S102 of the main flow of the digital camera 1 described above.

  When SW1 is turned on, the result in step S203 is affirmative and the process proceeds to step S210. In step S210, the display image data is stored in the RAM 25 as an evaluation image. In step S211, the subject luminance value is calculated from the evaluation image and stored in the RAM 25. In step S212, the shutter speed used when reading the image in step S302 during the above-described through image reproduction process is fixed to a value calculated from the subject luminance. In step S213, the focal length to the subject is measured, and the imaging optical drive unit 35 adjusts the imaging optical unit to bring it into focus. In step S214, an exposure value is determined from the subject luminance value, and various imaging conditions are calculated from the exposure value by an imaging processing condition function and stored in the RAM 25. In step S215, it is determined whether or not the subject recognition mode is set. If the subject recognition mode is set, the subject recognition processing is started in step S216 and then the process proceeds to step S217. If not the subject recognition mode, the process proceeds to step S217. .

<Subject recognition processing>
Here, the subject recognition process will be described. FIG. 11 shows a flow of subject recognition processing. When the subject recognition process is started, subject feature information is extracted from the evaluation image stored in the RAM 25 in step S601 and stored in the RAM 25 as subject feature information. In step S602, 1 is assigned to Flag n. In step S603, the picture book item of the picture book in which the search priority is set to the nth in the picture book set in the search category is set as the search target. In step S604, it is determined whether or not the search category is set to the building landscape. When the search category is set to the building landscape, the process proceeds to step S605, and when the search category is not set to the building landscape, the process proceeds to step S607. In step S605, position information is acquired from the position detector 31 and stored in the RAM 25 as subject position information. In step S606, a pictorial book item having position information that is close to the subject position information is selected as a search target from the pictorial book items set as the search target, and the process proceeds to step S610. In step S607, it is determined whether the search category is set to flower or insect. If the search category is set to flower or insect, the process proceeds to step S208. If the search category is not set to flower or insect, the process proceeds to step S610. In step S608, date information is acquired from the date detector 32 and stored in the RAM 25 as subject date information. In step S609, a pictorial book item having date information that is close to the subject date information is selected as a search target from the pictorial book items set as the search target, and the process proceeds to step S610. In step S610, the feature information of the picture book item selected as a search target is compared with the subject feature information, and a picture book item whose difference between the feature information and the subject feature information is a predetermined value or less is selected as a subject information candidate item. If there are a plurality of selected subject information candidate items, the picture book item with the smallest difference is set as the subject information candidate item. In step S611, it is determined whether the subject information candidate item has been selected. If the subject information candidate item has been selected, the process proceeds to step S615. If the subject information candidate item has not been selected, the process proceeds to 612. In step S612, it is determined whether or not there is a picture book set in the search priority n + 1 in the search category. If there is a picture book set to search priority n + 1 in the search category, the process moves to step S613, and 1 is added to n, and the process returns to step S603. If there is no picture book set to search priority n + 1 in the search category, step The process moves to S614. In step S614, the character information “No corresponding data” is stored in the RAM 25 as subject information, and the process proceeds to step S619. It should be noted that an icon such as a mark such as a cross may be stored in the RAM 25 as subject information instead of the character information “no corresponding data”.

  In step S615, the display information of the subject information candidate item is stored as subject information in the superimpose information storage area of the RAM 25. When the subject information is stored in the superimpose information storage area of the RAM 25, the subject information is displayed on the rear liquid crystal 4 so as to be superimposed on the moving image by the process of step 311 of the through image reproduction process described above. 12A and 12B show the state of the rear liquid crystal 4 when the subject information is displayed over the moving image. As a display pattern of subject information to be displayed superimposed on a moving image, only the subject name of the subject information is displayed so as to be superimposed on the moving image as shown in FIG. 12A, and other than the subject name of the subject information as shown in FIG. 12B. There are also two patterns for displaying subject information superimposed on a moving image, which can be set by a user in a menu mode to be described later.

  In step S616, it is determined whether or not the sound reproduction mode is pattern 1. If the sound reproduction mode is pattern 1, the process proceeds to step S617. If the sound reproduction mode is not pattern 1, the process proceeds to step S619. In step S617, it is determined whether the subject information includes audio data. If the subject information includes audio data, the process proceeds to step S618. If the subject information does not include audio data, the process proceeds to step S619. In step S618, the audio data included in the subject information is processed by the audio reproduction unit 36 and reproduced from the speaker 10. In step S619, the subject information is additionally stored in the superimpose information stored in the superimpose area of the RAM 25, and the subject recognition process is terminated.

  As described above, in the subject recognition process, first, the pictorial book item of the pictorial book data in which the first priority search order is set in the search category is set as the search target (step S603). If there is no picture book data that matches the feature information of the subject of the picture book with the first search priority set, the picture book with the higher priority search order is searched, and the picture book data set in the search category is searched. (Step S612).

  When the picture book to be searched is “building landscape picture book”, the picture book items to be searched are further narrowed down by subject position information (steps S604 to S606), and the picture book to be searched is “flower picture book” or “insect picture book”. ", The picture book items to be searched are further narrowed down by subject date information (steps S607 to S609).

Returning to the description of the shooting mode subroutine.
In step S217, it is determined whether SW1 is ON. If SW1 is not turned on, the process proceeds to step S225. If SW1 is turned on, the process proceeds to step S218. In step S218, it is determined whether SW2 is turned on. If SW2 is turned on, the process proceeds to step S219. If SW2 is not turned on, the process returns to step S217. In step S219, it is determined whether or not the subject recognition mode is set. If the subject recognition mode is ON, the process proceeds to step S220. If the subject recognition mode is OFF, the process proceeds to step S223. In step S220, it is determined whether or not the voice playback mode is set to pattern 2. If the voice recognition mode is set to pattern 2, the process proceeds to step S221, and the voice playback mode is not set to pattern 2. Moves to step S223. In step S221, it is determined whether or not the subject information includes audio information. If the subject information includes audio information, the audio data included in the subject information is processed by the audio reproduction unit 36 in step S222. When it is reproduced from the speaker 10 and the subject information does not include audio data, the process proceeds to step S223. In step S223, a through image reproduction process stop command is issued, and the through image reproduction process is terminated. In step S224, the process proceeds to a photographing / recording processing subroutine.
<Shooting and recording process>
Here, the photographing / recording processing subroutine will be described. 13 and 14 show the flow of the photographing processing subroutine. In step S701, a subject image is captured according to the imaging setting set in step S214, and a subject image signal is acquired from the image sensor 22 in step S702. In step S703, the image processing unit 23 processes the subject image signal to create subject image data. In addition to the recording image data for recording, the display image displayed on the rear liquid crystal 4 is also created for the subject image data created in step S703. In step S704, it is determined whether or not the subject recognition mode is ON. If the subject recognition mode is ON, the process proceeds to step S708. If the subject recognition mode is not ON, the process proceeds to step S705.

  In step S705, it is determined whether the image confirmation setting is ON. If the image confirmation setting is ON, the process proceeds to step S706. If the image confirmation setting is not ON, the process proceeds to step S707. In step S706, the display image data is displayed on the rear liquid crystal 4. In step S707, the recording image data is stored in the external memory 28 as an image file, and the process proceeds to step S726.

  In step S708, it is determined whether there is subject information. If the subject information is stored in the RAM 25, the process proceeds to step S709. If the subject information is not stored in the RAM 25, the process proceeds to step S705. In step S709, it is determined whether or not the subject information is “no corresponding data”. If the subject information is “no relevant data”, the process proceeds to step S710. If the subject information is not “no relevant data”, the process proceeds to step S711.

  In step S710, it is determined whether the image confirmation setting is ON. If the image confirmation setting is ON, the process proceeds to step S724. If the image confirmation setting is not ON, the process proceeds to step S725.

  In step S711, it is determined whether or not simple confirmation is ON. If the simple confirmation is turned on, the process proceeds to step S712. If the simple confirmation is not turned on, the process proceeds to step S710.

  In step S712, feature information is extracted from the display image data, and in step S713, it is determined whether the difference between the feature information and the feature information extracted from the evaluation image data is within a predetermined threshold. If the difference in feature information is within the threshold, the process proceeds to step S710. If the difference in feature information is not within the threshold, the process proceeds to step S714. In step S714, a re-search menu is displayed on the rear liquid crystal 4 so as to overlap the display image created in step S703. FIG. 10 c shows the re-search menu displayed on the rear liquid crystal 4. The re-search menu consists of three menu items: “OK (Save image with subject information)”, “Re-search”, and “Cancel save”. In the initial state, the “Re-search” menu item is high as shown. Light is displayed. When the cross key 6 is pressed in any direction up or down, the highlighted menu item is changed to the menu item in the direction in which the cross key 6 is pressed. When the determination button 7 is pressed, the currently highlighted menu item is selected and the process is determined. In step S715, it is determined whether or not “OK (Save Image with Subject Information)” is selected from the re-search menu item. If “OK (store image with subject information)” is selected, the process proceeds to step S710. If “OK (store image with subject information)” is not selected, the process proceeds to step S716. In step S716, it is determined whether or not “re-search” is selected from the re-search menu items. If “re-search” is selected, the process proceeds to step S720. If “re-search” is not selected, the process proceeds to step S717. In step S717, it is determined whether or not “cancel” is selected from the re-search menu items. If “cancel” is selected, the process proceeds to step S718. If “cancel” is not selected, the process returns to step S715. In step S718, the display of “cannot save the captured image” is started on the rear liquid crystal. In step S719, it is determined whether or not a predetermined time has elapsed in step S, and the process waits until the predetermined time elapses.

  In step S720, the display image data is stored in the RAM 25 as evaluation image data, and the process proceeds to a subject recognition processing subroutine in step S721. Since the subject recognition processing subroutine is the same as described above, a description thereof will be omitted. When the subject recognition processing subroutine ends, the process proceeds to step S722. In step S722, it is determined whether or not the subject information newly obtained by subject recognition processing in step S721 is “no relevant data”. If the subject information is “no relevant data”, the process proceeds to step S723, and if the subject information is not “no relevant data”, the process proceeds to step S724. In step 723, the menu item “save” and “cancel” is displayed together with the message “There is no corresponding data. Do you want to save?” On the back LCD 4, and if “save” is selected, the process proceeds to step S724. If “Cancel” is selected, the process proceeds to step S729.

  In step S724, display of an image in which the superimpose information stored in the RAM 25 is superimposed on the display image data on the back liquid crystal 4 is started. In step S725, the recording image data in which the subject information is recorded in the header information is stored in the external memory 28 as an image file.

  In step S726, it is determined whether the image confirmation setting is ON or “re-search” is set. If the image confirmation setting is ON or “re-search” is set, the process proceeds to step S727. If the image confirmation setting is not ON or “re-search” is not set, step S729 is performed. Move on. In step S727, it is determined whether or not a predetermined time has elapsed since the display of the display image data on the back liquid crystal 4 in step S706 or step S724. If the predetermined time has not elapsed, the process proceeds to step S728. If the predetermined time has elapsed, the process proceeds to step S729. In step S728, it is determined whether the release button 3 has been pressed halfway (SW1 = ON) or whether the operation mode has been changed from the shooting mode. If the release button 3 is not pressed halfway or the operation mode is not changed from the shooting mode, the process returns to step S727, and the release button 3 is pressed halfway (SW1 = ON) or the operation mode is the shooting mode. If changed from step S729, the process proceeds to step S729.

In step S729, after the rear liquid crystal 4 is turned off, the photographing recording processing subroutine is terminated, and the photographing mode subroutine is shifted to step S225.
As described above, when the release button 3 is fully pressed (SW2 is turned on) while the subject information is displayed on the rear liquid crystal 4, the above-described shooting and recording process is performed, and the recording image data is stored in the header area. The information is stored in the external memory 28 as a recording image file in which information is embedded. Note that the shooting and recording process is also performed when the release button 3 is fully pressed in a state where the subject recognition process is not completed, that is, the subject information is not displayed on the rear liquid crystal 4, and in this case, the recording image file is recorded. The subject information is stored without being embedded in the header information. Further, the storage of the recording image file is not limited to the external memory 28, and the recording image file may be stored in a recording medium such as an EEPROM 27 or a large capacity storage medium 29, for example.
<Simple confirmation of subject>
As described above, the moving image is displayed on the rear liquid crystal 4 after the release button 3 is pressed halfway and the subject recognition process is started until the release button 3 is fully pressed (steps S216 to S217). Has been. For this reason, the recognition image data used for the recognition process acquired by half-pressing the release button 3 and the recording image data acquired by fully pressing the release button 3 are different images. There is a possibility that the subject recognition information and the subject of the recording image data included in the recording image file are different. Therefore, in the digital camera 1 according to the present embodiment, when the recording image data is stored together with the subject information obtained by the recognition processing, the subject recorded in the subject recognition image data and the recording image data are recorded. Thus, a simple confirmation process for determining whether or not the subject is the same is provided. The simple confirmation process can be set to ON or OFF by a menu process described later by the user. When the simple confirmation processing is ON, the feature information extracted from the display image data created together with the recording image data by the processing of the subject detection unit 30 and the features of the recognition image data stored in the RAM 25 Information is collated (steps S712 to S713).

  If the difference in the feature information is equal to or greater than a predetermined value as a result of the collation, a re-search process for searching subject information again using image data recorded by the full-pressing operation of the release button 3 or an image is saved together with the subject information. The user selects either the storage process to be performed or the storage cancellation process to cancel the image data recording process (steps S714 to S717). When the re-search process for selecting subject information search again using the image data recorded by pressing the release button 3 is selected, the display image data created together with the recording image data is again used as the recognition image data. Subject recognition processing is performed (steps S716, S720 to S721). If there is no picture book item that matches the subject information (no corresponding data), whether or not to save the image data for recording is selected (step S723). When the storage of the recording image data is selected, the recording image data is recorded together with the subject information “no corresponding data” (steps S724 to S729). When canceling the saving of the recording image data is selected, the recording image data is discarded and the photographing recording process is terminated (step S729). If there is a picture book item that matches the subject information (successful selection of subject information), the image data for recording is recorded together with the selected subject information (steps S724 to S729).

  When the saving process for saving the image together with the subject information is selected, the recording image data is saved as a recording image file including the subject information in the header information without performing a re-search (steps S715, S710, S724). S729). When the image data recording process is canceled or the storage canceling process is selected, the image data for recording is discarded and the photographing recording process is terminated (steps S717 to S719 and S729).

Returning to the description of the shooting mode subroutine.
In step S225, the AF lock locked in step S213 is released. In step S226, if subject recognition processing is being performed, subject recognition processing is terminated. In step S227, the subject information stored in the RAM 25 and the subject information of the superimpose information are cleared. In step S228, it is determined whether or not the through image playback process is stopped. If the through image playback process is stopped, a start instruction for the through image playback process is issued in step S229, and the through image playback is resumed. Returning to step S203, if the through image reproduction process is being executed, the process returns to step S203.

  As described above, in the recognition process, the subject recognition process is continued when the release button 3 is half pressed, but the subject recognition process is interrupted when the half press state is released (step S217). , S225 to S226). If the half-pressed state is released when the subject recognition process is completed and the subject information is displayed on the rear liquid crystal 4, the subject information displayed on the rear liquid crystal 4 is not displayed (step S227). .

That is, the image for recording is newly captured for subject recognition, and the display image when the release button 3 is half-pressed without performing the saving process in the external memory 28 or the like is used for subject recognition. Therefore, subject information can be provided quickly. Further, the user can save the subject information data acquired by fully pressing the release button 3 in the external memory 28 together with the recording image data as necessary.
<Image display mode>
When the image reproduction button 9 is pressed when the operation mode is the shooting mode or the menu mode, the operation mode is switched to the image display mode. In the image display mode, a recording image file (hereinafter referred to as a recorded image file) stored in the external memory 28 or the large-capacity storage medium 29 by the above-described shooting and recording process is displayed on the rear liquid crystal 4. . FIG. 15 a shows a recorded image file displayed on the back liquid crystal 4. When the image playback mode is entered, the recorded image file last displayed in the previous image playback mode or the recorded image file stored last is displayed. By pressing the upper key 6a or the lower key 6b of the cross key 6, the user can switch the display to the image file stored immediately after or one before the currently displayed image file. As shown in FIG. 15a, the image file is displayed as a single frame display for displaying one image on the back liquid crystal 4, and a four frame display for displaying four image files on the back liquid crystal 4 as shown in FIG. 15b. As shown in FIG. 15c, the nine-frame display for displaying nine image files on the rear liquid crystal 4 can be switched by pressing a zoom button (not shown). When the displayed captured image has subject information, a subject information icon 50 is displayed on the upper right of the displayed captured image. Furthermore, when the subject information of the displayed captured image includes audio information, the audio information icon 51 is displayed on the upper right of the displayed captured image, and the image on which the audio reproduction icon is displayed is displayed. When the determination button 7 is pressed during selection, the audio information is reproduced from the audio reproducing unit 36. That is, when the voice information icon 51 is displayed on the displayed image when the single frame is displayed, or on the selected image when the four or nine frames are displayed, the OK button 7 is displayed. When is pressed, the audio information included in the subject information of the image displayed in one frame or the selected image is reproduced.

  Further, in the one-frame display, it is possible to display the shooting information of the image file and the like on the recorded image file. As the display pattern of the imaged image file, display pattern 1 for displaying only the imaged image is displayed, and imaging settings such as a file name, a shooting date, a shutter speed, and an aperture value are displayed over the displayed recorded image file. There are a display pattern 3 for displaying a histogram display overlaid on a displayed recorded image file, and a display pattern 4 for displaying both the displayed recorded image file and stored subject information. As shown in FIG. 15a, the display pattern 1 is shown in FIG. 15a, the display pattern 2 is shown in FIG. 15d, the display pattern 3 is shown in FIG. Is shown in FIG. The display of the display patterns 1 to 4 is cyclically switched by pressing the left key 6c or the right key 6d of the cross key 6. The display pattern 4 can be displayed only when subject information obtained by subject recognition processing is stored in a recorded image file. That is, when the subject information is stored in the recorded image file displayed on the rear liquid crystal 4, the display patterns 1 to 4 are cyclically operated by pressing the left key 6 c or the right key 6 d of the cross key 6. When the subject information is not stored in the recorded image file displayed on the rear liquid crystal 4, the display pattern 1 is displayed by pressing the left key 6 c or the right key 6 d of the cross key 6. -3 are displayed cyclically.

  Note that, in the case of the pattern 4, the subject information displayed on the recorded image displayed on the rear liquid crystal 4 is displayed in the recorded image displayed on the rear liquid crystal 4 as shown in FIG. 15f. A subject information display pattern 1 that is displayed so as to be superimposed on top of the other, and a subject information display pattern 2 that displays a recorded image on the upper left of the rear liquid crystal 4 and displays subject information in the remaining area 52, as shown in FIG. As shown in FIG. 15h, there is a subject information display pattern 3 in which a recorded image is displayed on the center of the rear liquid crystal 4 and subject information is displayed in a line in a region 53 below the displayed recorded image. In the subject information display, when the menu button 8 is pressed while the subject information is displayed in the display pattern 4, a subject information display setting menu is displayed on the rear liquid crystal 4. In the subject information display setting menu, it is possible to set which display method of the patterns 1 to 3 is used to display the subject information in the case of the display pattern 4 described above. The subject information display setting menu can also be set in a menu mode to be described later. When the subject information is displayed in the subject information display patterns 1 and 2, if the subject information cannot be displayed on the screen, the scroll display can be performed by pressing the upper key 6a and the lower key 6b of the cross key 6. It becomes. Further, when the subject information display pattern 3 cannot display all the subject information, the horizontal scroll display is automatically started.

If the image reproduction button 9 is pressed again during the image display mode process or the release button 3 is pressed halfway (SW1 is turned on), the operation mode is changed to the shooting mode. When the operation mode is changed to an operation mode other than the image display mode during the image display mode process, the display on the rear liquid crystal 4 is turned off and the image display mode is ended.
<Menu mode>
Next, the menu mode will be described. In the menu mode, the user performs a menu item selection operation to select an arbitrary function. FIG. 10 shows an example of a menu displayed on the rear liquid crystal 4. As shown in the figure, by specifying a tag 60, a reproduction menu, a shooting menu, a custom menu, and a setup menu can be switched. In the playback menu, items of functions used during image playback such as a slide show setting are displayed. In the shooting menu, items of functions used at the time of shooting such as setting of image quality, and items of functions related to subject recognition processing such as the above-described sound reproduction setting and subject information display setting are displayed. In the custom menu, items related to the overall operation of the digital camera 1 such as arrangement items of the operation mode of the digital camera 1 and date setting are displayed in the setup menu. In any menu, the currently selected menu item is displayed so that the user can recognize it by highlighting. When the cross key 6 is pressed in any direction, the highlighted menu item is switched to the menu item in the direction in which the cross key 6 is pressed. When the menu item is switched, highlighting of the menu item that has been selected is canceled, and the newly selected menu item is highlighted. When the determination button 7 is pressed, if the highlighted menu item is a setting or setting value, the setting or setting value is set, and the highlighted menu item functions. If there is a menu item at a lower level, such as the name of, move to the setting menu of the selected function.
<Second Embodiment>
Hereinafter, the second embodiment will be described with reference to FIGS.

Since the digital camera according to the second embodiment is substantially the same as the digital camera 1 according to the first embodiment, the description thereof will be omitted, and only differences from the first embodiment will be described.
The second embodiment is different from the first embodiment in that a communication processing unit 37 is added as a constituent member, and a process using the communication processing 37 unit is added to the subject recognition process described above. It is.

  FIG. 16 shows a block diagram of a digital camera according to the second embodiment. The same members as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted. As shown in the figure, the difference from the digital camera 1 in the first embodiment is that a communication processing unit 37 is added. The communication processing unit 37 is connected to the control unit 20 and is controlled by the control unit 20. The communication processing unit 37 has a transmission unit and a reception unit, and can transmit and receive data to and from a server computer by radio waves (including light) via a radio base station and a communication network, or directly.

  In the digital camera according to the present embodiment, when the subject feature information and the search condition extracted from the evaluation image are transmitted to the computer on the server side, the server computer selects the server selected as the search target based on the received search condition and feature information. A picture book item having characteristic information that matches the characteristic information of the subject is searched from the picture book data in the picture book. Search results from the server computer are sent to the digital camera. The search result received from the server computer is stored in the RAM 25 as subject information. The search condition is a search category or the like determined by position information of the digital camera 1, date information, an exposure mode such as a macro mode.

Hereinafter, the subject recognition process in which the communication processing unit 37 is used will be described.
17, 18 and 19 show the flow of subject recognition processing. The same processes as those of the digital camera 1 of the first embodiment are denoted by the same reference numerals, and description thereof is omitted.

When the feature information of the subject is extracted from the evaluation image in step S601, the process proceeds to step S801.
In the digital camera according to the second embodiment, the feature information of the subject extracted from the evaluation image is searched using the pictorial book data stored in the mass storage medium 29 based on the search category set by the exposure mode. In-camera pictorial book search mode, and if the communication state is good, the communication processing unit 37 communicates to transmit the subject feature information and the search category to the server computer, and priority is given to the search in the server computer. The mode can be selected. Switching between the camera search mode and the communication search priority mode can be set by the user in the menu mode.

  In step S801, it is determined whether or not the communication priority search mode is set. If it is in the communication priority search mode, the process proceeds to step S802. If it is not in the communication priority search mode, the process proceeds to step S602. In step S802, the communication processing unit 37 confirms the communication state with the server computer. If the communication quality is greater than or equal to a predetermined value, the process proceeds to step S805, and if the communication quality is less than the predetermined value, the process proceeds to step S602. That is, even in the communication search priority mode that prioritizes search on the server computer, if the communication state is poor, the pictorial book data stored in the large-capacity storage medium 29 of the digital camera 1 is switched to the in-camera picture book search mode. Perform a search using.

  In step S805, the feature information and the search category are transmitted to the server computer by the processing of the communication processing unit 37. The transmitted communication category information is information on the size classification of the picture book to be searched and the search priority of the classification. The communication category information to be transmitted may be the pictorial book to be searched shown in FIG. 5b shown in FIG. 5a and the information of the search priority. In step S806, it is determined whether or not reception of search result data sent from the server computer has started. If the reception of the search result data has been started, the process proceeds to step S808, and if the reception of the search result data has not been started, the process proceeds to step S807. In step S807, it is determined whether or not a predetermined time has elapsed since the transmission of the feature information and the search category in step S805. If the predetermined time has elapsed, the process proceeds to step S811, and if the predetermined time has not elapsed, Return to step S806. In step S811, the character information “timed out” is stored in the RAM 25 as subject information, and the flow advances to step S616.

  In step S808, it is determined whether data has been received. If data has been received, the process proceeds to step S809. If data has not been received, the process proceeds to step S810. In step S809, the received data is saved. In step S810, it is determined whether reception of all data has been completed. If the data reception is completed, the process proceeds to step S813. If the data reception is not completed, the process proceeds to step S811. In step S811, it is determined whether or not a predetermined time has elapsed since data was received in step S809. If the predetermined time has elapsed, the process proceeds to step S812. If the predetermined time has not elapsed, the process returns to step S808. In step S813, the reception is completed and the search result data is stored in the RAM 25 as subject information, and then the process proceeds to step S616. Note that the search result data received in step S813 has the same format as the display information included in the picture book data described above.

  If the result in step S801 is negative, or if the result in step S802 is negative, the process proceeds to step S602. The processes in steps S602 to S619 are also substantially the same as those in the digital camera 1 in the first embodiment. . The difference is that the process proceeds to step S616 after the process of step S811 or S812, and the process of steps S803 to S804 is performed while the process proceeds from step S612 to step S614 due to the negative result of step S612.

  Hereinafter, the processing of steps S803 to S804 will be described. If a negative determination is made in step S612, the process proceeds to step S803. In step S803, it is determined whether the communication re-search setting for re-searching by the server computer through communication is ON. If the communication re-search setting is ON, the process proceeds to step S804. If the communication re-search setting is not ON, the process proceeds to S614. In step S804, the communication processing unit 37 confirms the communication state with the server computer. If the communication quality is greater than or equal to a predetermined value, the process proceeds to step S805, and if the communication quality is less than the predetermined value, the process proceeds to step S614. As described above, when the pictorial book items that match the characteristic information cannot be selected even after searching all the pictorial books to be searched by the search category (No in step S612), the communication re-search setting is turned on (step S803). It is possible to send subject characteristic information and a search category to the server computer, and search the subject information again on the server computer. That is, even if the picture book data stored in the large-capacity storage medium 29 of the digital camera 1 has no subject information, the subject information can be searched for using the picture book data stored in the server computer. Will improve. The communication re-search setting ON / OFF can be set by the user in the menu mode.

Since the processing after step S614 is the same as that in the first embodiment, a description thereof will be omitted.
As described above, when the search process is performed by the server computer, only the feature information and the search category of the subject whose data capacity is relatively light are transmitted to the server computer (step S805), and the display data received from the server computer is also transmitted. Since the character data has a relatively light data capacity, transmission / reception processing with the server computer can be performed quickly. In addition, since the subject search is performed in a server computer that can perform higher-speed processing than a digital camera, subject information can be searched faster than a larger amount of picture book data, and the subject information search rate can be improved.

In the above description, when the object recognition is turned on when the exposure mode is the auto mode, the pictorial book data to be searched is set from the pictorial book data stored in the large-capacity storage medium 29 by the user. Possible picture book data may be settable. In this case, in step S801 of the subject recognition process described above, whether the pictorial book data stored in the large-capacity storage medium 29 is included in the pictorial book data set in the search category in addition to whether or not the communication priority mode is set. It may be determined whether or not. That is, when the picture book data to be searched set in the search category is not recorded in the digital camera, the search is performed on the server computer. As a result, more objects can be recognized, and the user only needs to store the necessary picture book in the digital camera, thereby reducing the storage area for the picture book data.
<Change example>
The example of a change of the digital camera in embodiment mentioned above is shown.

  In the first and second embodiments described above, the shutter speed and AF adjustment, imaging processing condition setting, and subject recognition processing start command are performed by pressing the first switch (SW1) provided on the release button 3. The processing (steps S210 to S216) is performed, and the processing such as the imaging processing (steps S219 to S229) is performed by pressing the second switch (SW2). However, the present invention is not limited to this. For example, the first switch and the second switch may be different operating members. In this case, the determination process performed in step S217 in the above-described shooting mode flow is changed to a determination process for determining whether or not there is an operation of pressing the cancel button. Further, the first switch may be assigned as a cancel button. In this case, the photographing process is canceled when the first switch is operated again.

  In the above description, when the recording image is saved together with the subject information, the subject information is recorded in the header of the image file and stored in the external memory 28. However, the present invention is not limited to this. May be stored in the external memory 28 in association with each other.

Note that the present invention may be used in an interchangeable lens digital camera.

Perspective view of digital camera Digital camera block diagram Main flow Front view of operation mode dial and cross key Correspondence diagram of exposure mode and set search category Flow chart of shooting mode Through image playback processing flow Flow of exposure mode setting process Search category selection process flow Menu display example Subject recognition processing flow Display example of subject information displayed superimposed on a moving image Flow of shooting and recording process 1 Flow of shooting and recording process 2 Image display example in image display mode Digital camera block diagram Subject recognition processing flow part 1 Subject recognition processing flow 2 Subject recognition processing flow 3

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital camera 2 Power button 3 Release button 4 Back surface liquid crystal 5 Operation mode dial 6 Cross key 7 Decision button 8 Menu button 9 Image reproduction button 10 Speaker 20 Control part 21 Imaging optical part 22 Imaging element 23 Image processing part 24 Liquid crystal control part 25 RAM
26 ROM
27 EEPROM
28 External memory 29 Mass storage medium 30 Subject recognition unit 31 Position detection unit 32 Date detection unit 33 Operation unit 34 Image sensor drive unit 35 Imaging optical drive unit 36 Audio reproduction unit 37 Communication processing unit 50 Subject information icon 51 Subject audio information icon

Claims (14)

Shooting mode setting means for setting one shooting mode from a plurality of shooting modes suitable for each of a plurality of shooting situations;
Imaging means for imaging a subject in a shooting mode set by the shooting mode setting means and outputting image data;
Feature information extraction means for extracting feature information of the subject from the image data output by the imaging means;
Information related to the description of each object and characteristic information of each object are recorded in association with a plurality of objects, and information related to the size of the object is classified and recorded in a plurality of related categories. By referring to the database, the size of the target object to be searched is determined based on the shooting mode set by the shooting mode setting means, and information on the determined size of the target object is associated. Selection means for selecting a category to be searched,
Comparison means for comparing feature information of the object of the category selected as the search target by the selection means and feature information of the subject;
A digital camera comprising: a determination unit that determines information related to the description of the object corresponding to the subject according to a comparison result by the comparison unit. The digital camera according to claim 1, wherein
The digital camera is characterized in that the photographing mode setting means sets the photographing mode based on an operation by a user. The digital camera according to claim 1 or 2,
The shooting mode setting means sets a shooting mode suitable for a shooting situation where the subject is close to the camera,
The digital camera according to claim 1, wherein the selection unit selects a category having a size equal to or less than a predetermined size as the search target when a shooting mode suitable for a shooting situation in which the subject is close is set. The digital camera according to claim 1 or 2,
The shooting mode setting means sets a shooting mode suitable for a shooting situation where the subject is a landscape,
The digital camera according to claim 1, wherein the selection means selects a category having a predetermined size or more as the search target when a shooting mode suitable for a shooting situation in which the subject is a landscape is set. The digital camera according to any one of claims 1 to 4,
The digital camera according to claim 1, wherein the selection means selects a plurality of categories associated with the priority of the order of comparison by the comparison means corresponding to the photographing mode as a search target. The digital camera according to any one of claims 1 to 5,
The plurality of shooting modes are a plurality of exposure modes having different combination patterns of shutter speed and aperture value,
The digital camera characterized in that the photographing mode setting means sets one exposure mode from the plurality of exposure modes. The digital camera according to any one of claims 1 to 6,
And an imaging instruction member that is operated to instruct imaging of a recording image by the imaging means;
A recording image generating means for generating recording image data from the image data output by the imaging means when the main imaging instruction member is operated;
And recording means for associating and recording the recording image data generated by the recording image generation means and information relating to the description of the object corresponding to the subject determined by the determination means. A digital camera. The digital camera according to any one of claims 1 to 7,
A digital camera comprising: the display control unit configured to display, on a display member, information relating to an explanation of an object corresponding to the subject determined by the determining unit. The digital camera according to any one of claims 1 to 8,
The digital camera further comprises recording means for recording the database. Imaging means for imaging a subject and outputting image data;
A main imaging instruction member operated to instruct imaging of the recording image by the imaging means;
A recording image generating means for generating recording image data from the image data output by the imaging means when the main imaging instruction member is operated;
Display image generation means for generating display image data from the image data output by the imaging means;
Display control means for displaying an image as a moving image on a display medium based on the display image data generated by the display image generation means;
Feature information extracting means for extracting feature information of a subject based on the display image data;
The feature information of the object is compared with the feature information of the subject with reference to a database in which information related to the explanation of each object and the feature information of each object are recorded in association with a plurality of objects. A comparison means;
Determining means for determining information relating to the description of the object corresponding to the subject in accordance with a comparison result by the comparing means;
Based on the recording image data generated by the recording image generating means when the main imaging instruction member is operated, and the display image data output before the operation time of the main imaging instruction member. And a recording means for recording information relating to the description of the object corresponding to the subject determined by the determination means in association with each other. The digital camera according to claim 10, wherein
And an imaging optical system comprising at least one optical member;
A focusing instruction member operated to instruct focusing by the imaging optical system;
A digital camera comprising start control means for starting extraction of feature information of the subject by feature information extraction means when the focusing instruction member is operated. The digital camera according to claim 10 or claim 11,
The display control unit displays information on an explanation of an object corresponding to the subject on the display member when the focusing instruction member is operated. The digital camera according to any one of claims 10 to 12,
And a re-comparison means for comparing the difference between the feature information of the display image data and the feature information corresponding to the recording image after the operation time of the main imaging instruction member,
The recording means records the recording image and information related to the description of the object corresponding to the subject in association with each other according to the comparison result by the re-comparison means. The digital camera according to any one of claims 10 to 13,
The digital camera further comprises recording means for recording the database.