JP2008165009A - Image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To determine priority levels corresponding to user's interests for a plurality of stored images. <P>SOLUTION: When an image display unit displays an image based on image data stored in a memory, a photographic unit takes a picture in the front direction of the image display unit. When the user is photographed by the photographic unit, an image recognition predicting unit finds the range of a field of view of the user from photographed image data, and predicts that the user recognizes an image displayed on the image display unit when the range of the field of view is included in the image display unit. Based on the predicted result, a recognition information acquiring unit acquires how many times the user has recognized the image displayed on the display means and the time thereof, as recognition information for each piece of image data of the image displayed on the image display unit; and based on the recognition information, a priority level determining unit determines priority levels by the plurality of pieces of image data stored in the memory. Consequently, a display control unit makes the image display unit display the plurality of pieces of image data stored in the memory, based on the priority levels. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image display device, and more particularly to an image display device that recognizes a user.

  A digital photo frame that reads image data of an image taken by a digital camera or the like and displays an image based on the read image data on a display unit configured by, for example, a liquid crystal display or the like is widely used as an image display device. Some digital cameras can use a liquid crystal display arranged on the back for displaying a captured image as a digital photo frame.

  The digital photo frame has not only an image display function but also a memory function for storing image data, and can store a plurality of image data. For this reason, when there are a large number of image data stored in the memory, the user of the digital photo frame needs time and effort to select image data for displaying an image on the display unit.

  Here, an image reproduction system in which a count value is provided for each of a plurality of stored image data is disclosed (Patent Document 1).

According to Patent Document 1, each time processing such as display and printing is performed for a plurality of images, the counter adds a count value corresponding to the processing content, determines the count value as a priority for each image data, and displays The order of images to be displayed on the screen is determined.
JP 2006-173983 A

  However, in the invention of Patent Document 1, for example, when a plurality of images are displayed in a slide show, the number of times the images are displayed is added as a count value regardless of the user's interest, and the images to be printed are also prioritized. However, there is a possibility that the determined priority order does not necessarily correspond to the interest of the user.

  An object of the present invention is to obtain an image display device that can determine a priority order according to a user's interest for a plurality of stored images in consideration of the above facts.

  The present invention includes a storage unit that stores a plurality of image data, an image display unit that displays an image based on the image data stored in the storage unit, and an imaging unit that captures the front direction of the image display unit. And when the photographing means photographs the user, the range of the field of view of the user photographed from the image data obtained by the photographing is obtained, and the user displays the image based on the range of the field of view. Image recognition prediction means for predicting that the image displayed on the means has been recognized, and the user for each image data of the image displayed on the image display means based on a prediction result by the image recognition prediction means. Based on the recognition information acquired by the recognition information acquisition means and the recognition information acquisition means for acquiring the recognition information that is the frequency at which the image displayed on the image display means is recognized. Priority order determining means for determining a priority order for each of the plurality of image data stored in the means, and a plurality of the above-mentioned stored in the storage means based on the priority order determined by the priority order determining means Display control means for controlling image data to be displayed on the image display means.

  According to the present invention, when the image display means displays an image based on the image data stored in the storage means, for example, the photographing means which is a CCD (Charge Coupled Device) camera is connected to the front of the image display means. Shoot the direction. The image recognition predicting unit obtains the range of the field of view of the user captured from the image data obtained by the imaging when the imaging unit captures the user, and based on the range of the field of view, the user Predicts that the image displayed on the image display means has been recognized. Next, the recognition information acquisition means is a frequency at which the user recognizes the image displayed on the image display means for each image data of the image displayed on the image display means based on the prediction result by the image recognition prediction means. Certain recognition information is acquired, the priority order determination means determines the priority order for each of the plurality of image data stored in the storage means based on the recognition information, and the display control means stores the priority order based on the priority order. A plurality of image data stored in the means is displayed on the image display means. The display of the image based on the priority order is, for example, displayed on the image display means first from the image data having a higher priority order, or displayed on the image display means first from the image data having a lower priority order. Etc.

  Therefore, when the image display means in which the image is displayed in the range of the user's field of view is included, the user determines that the image is recognized, and the more frequently recognized the image is, The user is assumed to indicate that he is interested in the image. Therefore, since the priority order according to the user's interest can be determined, the user can easily display his / her preferred image on the image display means, or the image that the user usually hardly sees. It can be easily displayed on the image display means.

  In the present invention, the recognition information acquired by the recognition information acquisition unit recognizes the time when the user recognizes the image displayed on the image display unit and the image displayed on the image display unit. It is at least one of the number of times.

  It is considered that the user recognizes the image more frequently and for a longer time as the image he is interested in. Therefore, the recognition information acquisition unit acquires, as the recognition information, the time when the user recognizes the image displayed on the image display unit and the number of times the image displayed on the image display unit is recognized as the recognition information. For this reason, the priority order can be made higher by the priority order determination means for the image that the user is more interested in.

  Further, in the present invention, the plurality of image data stored in the storage unit has a low priority for each of the plurality of image data determined by the priority acquisition unit when a predetermined condition is satisfied. It is erased from the image data.

  Therefore, the user can easily erase image data of low interest.

  Further, in the present invention, whether or not the user's face pattern extracted from the image data relating to the user photographed by the photographing means coincides with a pre-registered face pattern for each user. Face recognition means for determining whether or not the extracted face pattern matches the face pattern for each user registered in advance, the recognition information acquisition means for each registered user The recognition information for each image data of the image displayed on the image display means is acquired, and the priority order determination means determines the priority order for each of the plurality of image data for each registered user. To do.

  The face determination means determines whether or not the registered user's face matches the user's face photographed by the photographing means. Then, if they match, the recognition information acquisition unit acquires the recognition information for each image data in accordance with the registered user, and the priority order determination unit determines the registered user based on the recognition information. Accordingly, the priority order for each image data is determined. As a result, the display control means can cause the image display means to display an image based on the image data in a priority order corresponding to each registered user.

  Furthermore, in the present invention, when the face judging means judges that the photographing means has photographed a face that does not match a pre-registered face pattern for each user, the display control means includes the image display means. The displayed image is switched to an image that may be recognized by a person other than the registered user.

  When a person other than the registered user sees the image displayed on the image display means, the display control means switches to an image that may be recognized by a user other than the registered user. It is possible to protect a registered user's personal image from being recognized in addition to the registered user.

  Further, in the present invention, when the face judging means judges that the photographing means has photographed a face that does not match the pre-registered face pattern for each user, the power of the apparatus is turned off. It is characterized by.

  When a person other than the registered user sees the image displayed on the image display means, the power of the image display device is turned off, so that the registered user Personal images can be protected from being recognized.

  As described above, the present invention has an excellent effect that it is possible to determine the priority order according to the user's interest for a plurality of stored images.

(First embodiment)
FIG. 1 shows an external view of a digital photo frame 10 that is an image display device according to the present embodiment.

  The digital photo frame 10 includes an image display unit 12.

  The image display unit 12 is provided in front of the digital photo frame 10 and is configured by, for example, a liquid crystal display. The image display unit 12 displays an image based on the image data, or displays an operation screen for operating the digital photo frame 10.

  An operation unit 14 is provided on the upper surface of the digital photo frame 10. The user uses the operation unit 14 to display the image display unit 12 as an operation screen, and performs operations such as switching the operation mode of the digital photo frame 10 and selecting an image to be displayed on the image display unit 12.

  The side surface of the digital photo frame 10 includes a USB (Universal Serial Bus) connector 16 and a memory card slot 18.

  The digital photo frame 10 receives image data stored in a digital camera, a personal computer or the like from a digital camera or a personal computer (not shown) via a USB cable connected to the USB connector 16. In addition, when a memory card, which is a portable nonvolatile storage medium storing image data, is inserted into the memory card slot 18, the digital photo frame 10 reads image data stored in the memory card. There are several types of memory cards, and some have different connector shapes. Therefore, the digital photo frame 10 may include a plurality of memory card slots 18 having different slot shapes so as to be compatible with various memory cards.

  Further, the digital photo frame 10 includes a photographing unit 20 for photographing a user who views the image display unit 12. The imaging unit 20 is configured by, for example, a CCD or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  FIG. 2 shows the configuration of the electrical system of the digital photo frame 10.

  The digital photo frame 10 includes a main control unit 50.

  The main control unit 50 is connected to the image display unit 12, the operation unit 14, the imaging unit 20, the internal memory interface 54, the USB interface 56, and the external memory interface 58 via a bus 52 such as a control bus or a data bus.

  The main control unit 50 controls the digital photo frame 10 such as causing the image display unit 12 to display an image based on the image data. The internal memory interface 54 controls access to the memory 60 that is a storage unit. The memory 60 stores image data captured by the digital photo frame 10 and data necessary for controlling the digital photo frame 10.

  The USB interface 56 can directly connect the digital photo frame 10 and an external device such as a digital camera or a personal computer (not shown) via the USB connector 16 to perform communication conforming to the USB standard.

  The external memory interface 58 enables the memory card inserted into the memory card slot 18 to be accessed by the digital photo frame 10.

  Further, the main control unit 50 obtains the range of the visual field of the user photographed by the photographing unit 20 from the image data acquired by the photographing unit 20, and when the image display unit 12 is included in the visual field range, The user determines that the image displayed on the image display unit 12 is recognized, and determines the priority order for each image data based on the determination result. Note that the fact that the user recognizes the image displayed on the image display unit 12 is considered that the user is interested in the image.

  FIG. 3 is a functional block diagram relating to the determination of the priority order for each image data based on the range of the visual field of the user in the main control unit 50.

  The main control unit 50 includes a display control unit 100.

  The display control unit 100 reads image data stored in the image data storage unit 112 provided in the memory 60 and causes the image display unit 12 to display an image based on the image data.

  In addition, the memory 60 includes a priority order storage unit 114. The priority storage unit 114 stores a priority for each of a plurality of image data stored in the image data storage unit 112. The priority order is assigned a smaller number as the priority order as the user is more interested in the plurality of pieces of image data. For example, the plurality of pieces of image data stored in the image data storage unit 112 are assigned to the image display unit 12. It is used for the order in which to display. For example, when the user selects a mode for performing image display based on the priority order as the operation state of the digital photo frame 10 via the operation unit 14, the display control unit 100 stores image data from the priority order storage unit 114. Data related to each priority is read, and an image is displayed on the image display unit 12 based on the priority for each image data.

  The main control unit 50 includes a face area extraction unit 102, an image recognition prediction unit 104, a recognition information acquisition unit 106, and a priority order determination unit 108.

  The face area extraction unit 102 extracts the area of the user's face that is the subject from the image data (captured image data) of the image captured by the imaging unit 20. There are many known methods for extracting a face area. For example, an oval area containing a skin color of a predetermined percentage or more is extracted as a face.

  The image recognition prediction unit 104 obtains the range of the user's visual field from the user's face extracted by the face region extraction unit 102. When the image display unit 12 is included in the range of the visual field, it is predicted that the user recognizes the image displayed on the image display unit 12.

  In order to obtain the range of the visual field of the user, first, the position of the black eye is detected from the user's face extracted by the face area extraction unit 102. As a feature of the eye, the left-right direction and the up-down direction are surrounded by skin, and the left-right direction of the black eye is surrounded by white eyes. From this, the density of the white-eye area is low with respect to the skin area, and the black-eye area sandwiched between the white-eye areas has a higher density than the skin area. Based on this feature, the position of the black eye in the extracted face region is obtained.

  When the face of the person faces the front with respect to the digital photo frame 10 and the white-eye areas on both sides of the black eye are approximately the same area, the black eye is positioned in front of the image display unit 12. It is determined that the image display unit 12 is included in the range of the visual field of the user, that is, the user has recognized the image displayed on the image display unit 12. On the other hand, when the areas of the white eyes on both sides of the black eye are different, the black eyes are not located in front of the image display unit 12, and the image display unit 12 is not included in the range of the visual field of the user. That is, it is determined that the user has recognized the image displayed on the image display unit 12.

  If a pair of eyes is not detected in the face area extracted by the face area extraction unit 102, the user is not facing the image display unit 12, and the image recognition prediction unit 104 Determines that the image displayed on the image display unit 12 is not recognized.

  The recognition information acquisition unit 106 acquires recognition information in association with each image data of the image displayed on the image display unit 12. The recognition information is the frequency with which the user has recognized the image displayed on the image display unit 12, and is associated with each image data of the image displayed on the image display unit 12. Specifically, it is the number of times that the user has recognized the image (number of times of image recognition) and the time that the user has recognized the image (image recognition time). The number of times of image recognition is obtained from the number of times that the image recognition prediction unit 104 determines that the user has recognized the image displayed on the image display unit 12. The image recognition time is obtained by converting the number of consecutive times that the user has recognized that the image displayed on the image display unit 12 is recognized by the image recognition prediction unit 104 into time. It is considered that the image data with a larger number of times of image recognition and the image data with a longer image recognition time are images that the user is more interested in.

  The recognition information for each image data acquired by the recognition information acquisition unit 106 is transmitted to the priority order determination unit 108.

  For example, the priority order determination unit 108 determines the priority order for each image data by creating a priority table in which the priority order is increased in descending order of the number of times of image recognition for each image data as shown in FIG. The number of times of image recognition stored in the priority table is cumulatively added for each image data every time the image recognition prediction unit 104 determines that the user has recognized the image display unit 12. The priority order table is stored in the priority order storage unit 114. Note that the recognition information for determining the priority order may be the image recognition time instead of the number of times of image recognition as shown in FIG. Even when the recognition information for determining the priority order is the image recognition time, the image recognition time stored in the priority order table is the number of times the user has recognized the image display unit 12 by the image recognition prediction unit 104. The value converted into time is cumulatively added for each image data.

  Further, the priority order determination unit 108 may add the number of times of image recognition or the image recognition time to the image data itself without storing the priority order of each image data as a table as shown in FIG. In this case, the image data can be obtained by adding shooting information such as a thumbnail, a shooting date / time, a photographer, an aperture, and a shutter speed to the image data, for example, as in the Exif (Exchangeable Image File Format) standard. There must be.

  In this case, before the display control unit 100 displays an image based on the image data on the image display unit 12, the number of image recognition times or image recognition times added to the plurality of image data is read, and the number of image recognition times or image Determine priority based on recognition time. Then, an image is displayed based on the determined priority order.

  Further, the main control unit 50 includes an image data erasing unit 110.

  The image data erasure unit 110 stores the image data when the user sets the operation state of the digital photo frame 10 to the mode for erasing the image data stored in the image data storage unit 112 via the operation unit 14. The image data stored in the unit 112 is deleted. The image data erasure unit 110 is connected to the erasure condition storage unit 116 and the apparatus state storage unit 118. The erasure condition storage unit 116 stores conditions for erasing image data as set values. In addition, the apparatus state storage unit 118 stores information related to the state of the digital photo frame 10 such as the remaining capacity of the storage capacity of the memory 60 and the date and time when the previous erasing process was performed.

  The image data erasure unit 110 reads out information related to the state of the digital photo frame 10 from the apparatus state storage unit 118, and reads out and compares setting values, which are conditions for erasing image data, from the erasure condition storage unit 116. As a result of the comparison, when it is determined that the condition for erasing the image data is satisfied, the image data erasure unit 110 erases the image data based on the priority order for each image data. When the condition for erasing image data is satisfied, for example, the remaining capacity (actual remaining capacity) of the memory 60 is stored in the erasing condition storage unit 116 as a set value (set remaining capacity). Capacity) or less, or when the elapsed time from the previous erasing process has passed the period (set period) stored in the erasing condition storage unit 116. Although the set remaining capacity of the memory 60 and the setting period after the previous erasing process, which are the conditions for erasing the image data, are set in advance as predetermined values, Can also be set via the operation unit 14.

  Instead of comparing the conditions for erasing the image data, the user may select the image data based on the priority order for each image data by manual operation via the operation unit 14 and delete the image data. .

  Next, the operation of the present embodiment will be described.

  When determining the priority order of the image data of the image displayed on the image display unit 12, the user sets the operation state of the digital photo frame 10 to the priority order determination mode for performing the determination.

  With reference to the flowchart of FIG. 5, processing for determining the priority order for each image data will be described.

  First, in step 500, the priority determination mode is set.

  Next, in step 502, an image based on the image data is displayed on the image display unit 12, and photographing by the photographing unit 20 is executed.

  Next, in step 504, it is determined whether or not the user has recognized the image displayed on the image display unit 12 based on the captured image data acquired by the imaging unit 20. When the user's face can be extracted from the captured image data and the image recognition prediction unit 104 determines that the image display unit 12 is included in the range of the user's visual field, the user is displayed on the image display unit 12. The image is predicted to have been recognized, and the determination is affirmative, and the process proceeds to step 506. On the other hand, if the user's face is not extracted from the captured image data, or the image recognition prediction unit 104 determines that the image display unit 12 is not included in the range of the user's field of view even if it is extracted, the user It is predicted that the image displayed on the display unit 12 has not been recognized, and the determination is negative, and the process proceeds to step 508.

  In step 506, the recognition information acquisition unit 106 displays the user on the image display unit 12 based on the captured image data predicted to have recognized the image displayed on the image display unit 12 by the user. The number of times the image is recognized and the recognized time are obtained as recognition information in association with each image data.

  Next, in step 508, it is determined whether or not the image displayed on the image display unit 12 has been switched. If the image is switched, it is determined as affirmative and the process proceeds to step 510. On the other hand, if the image is not switched, it is determined to be negative, the process proceeds to step 504, and the acquisition of the recognition information is repeated until the image is switched. Note that the time for switching images is set in advance.

  Next, in step 510, the priority determining unit 108 adds the recognition information acquired in step 506 to the priority table shown in FIG. 4 in association with the image data.

  Next, in step 512, it is determined whether the power source of the digital photo frame 10 is turned off or the setting is changed. When the power is turned off or the setting is changed, it is determined as affirmative, and the priority order determination process for each image data ends. On the other hand, when the power is turned off or the setting is not changed, it is determined to be negative, the process proceeds to step 504, and acquisition of recognition information for each image data displayed on the image display unit 12 and determination of the priority order are repeated.

  By determining the priority order for each image data in this way, the user can display an image on the image display unit 12 based on the priority order of the image data. Specifically, for example, when the user sets the operation state of the digital photo frame 10 as a slide show, images are displayed in descending order of priority of image data, or images are displayed in order of low priority of image data. Can be displayed. By displaying images in descending order of priority, the user can preferentially display images of interest to the image display unit 12. On the other hand, by displaying the images in the order of lower priority, the user can preferentially display images that are not often viewed on the image display unit 12.

  Next, processing for erasing image data stored in the image data storage unit 112 will be described with reference to the flowchart of FIG.

  First, in step 600, settings related to the image data erasing process by the user are performed via the operation unit 14.

  Next, in step 602, the image data erasure unit 110 reads the priority order for each image data from the image data storage unit 112.

  Next, in step 604, the image data erasure unit 110 determines whether the setting for erasing image data is conditional on the storage capacity of the memory 60. If the storage capacity is set as a condition, the process proceeds to step 606. On the other hand, if the storage capacity is not set as a condition, the process proceeds to step 608.

  In step 606, the image data erasure unit 110 reads and compares the actual remaining capacity of the memory 60 and the set remaining capacity when erasing the image data, from the apparatus state storage unit 118 and the erasure condition storage unit 116, respectively. If the actual remaining capacity is equal to or greater than the set remaining capacity as a result of the comparison, it is determined affirmative and it is not necessary to erase the image data, and the image data erasing process is terminated as it is. On the other hand, if the actual remaining capacity is smaller than the set remaining capacity as a result of the comparison, the determination is negative and the process proceeds to step 612.

  In step 608, the image data erasure unit 110 determines whether or not the setting of the erasure process is a manual operation. If the setting of the erasure process is a manual operation, the process proceeds to step 612. On the other hand, if the setting of the erasure process is not a manual operation, the process proceeds to step 610.

  In step 610, since the setting of the erasing process is set on the condition that the elapsed time from the previous erasing process is a condition, the date and time when the image data erasing unit 110 performed the previous erasing process from the apparatus state storage unit 118 Is read, the elapsed time from the previous erasure process is calculated, the set period for erasing the image data is read from the erasure condition storage unit 116, and the elapsed time is compared with the set time. . As a result of the comparison, if the elapsed time has not passed the set period, it is determined as affirmative, and it is not necessary to erase the image data, so the image data erasing process is terminated as it is. On the other hand, as a result of the comparison, if the elapsed period has passed the set period, it is determined as negative and the process proceeds to step 612.

  In step 612, the image data erasure unit 110 extracts image data having a low priority order to be erased. When the setting of the erasure process is based on the storage capacity of the memory 60 (step 604), for example, the image data is sorted in ascending order of priority so that the actual remaining capacity of the memory 60 becomes a preset remaining capacity. Extract. When the setting of the erasure process is a manual operation (step 608), for example, the image data is displayed as a list on the image display unit 12 in ascending order of priority, and the user extracts arbitrary image data. Further, when the setting of the erasing process is based on the elapsed time from the previous erasing process (step 610), for example, a preset number of image data is extracted in order of decreasing priority.

  Next, in step 614, the image data erasure unit 110 erases the image data extracted in step 612, and the image data erasure process ends.

  As described above, when the image display unit 12 displays an image based on the image data stored in the memory 60, for example, the imaging unit 20 that is a CCD camera captures the front direction of the image display unit 12. To do. When the user is photographed by the photographing unit 20, the image recognition prediction unit 104 obtains the range of the user's visual field from the captured image data, and when the image display unit 12 is included in the visual field range. It is predicted that the user has recognized the image displayed on the image display unit 12. The recognition information acquisition unit 106 recognizes the number of times the user has recognized the image displayed on the display unit for each image data of the image displayed on the image display unit 12 based on the prediction result by the image recognition prediction unit 104, and The time when the image is recognized is acquired as recognition information. Next, the priority order determination unit 108 determines the priority order for each of the plurality of image data stored in the memory 60 based on the recognition information, and the display control unit 100 stores the priority order in the memory 60 based on the priority order. A plurality of stored image data is displayed on the image display unit 12.

Therefore, when an image is displayed on the image display unit 12 based on the image data, for example, the image display unit 12 displays the image data with higher priority first or the image data with lower priority first. be able to. That is, since the priority according to the user's interest can be determined for the plurality of images stored in the memory 60, the user can easily display an image of high interest on the image display unit 12, An image that the user usually hardly sees can be easily displayed on the image display unit 12.
(Second Embodiment)
In the first embodiment, since the digital photo frame 10 includes the photographing unit 20, the recognition of the image displayed on the image display unit 12 is determined without distinguishing the user. Therefore, in the second embodiment, a priority order for each image data corresponding to each registered user is determined. In addition, about the same component as 1st Embodiment, the same code | symbol is attached | subjected and description of the structure is abbreviate | omitted.

  FIG. 7 is a functional block diagram relating to determination of the priority order for each image data corresponding to each registered user in the main control unit 50 according to the second embodiment.

  The main control unit 50 includes a face registration unit 200 and a face determination unit 202. The memory 60 also includes a registered face pattern storage unit 204.

  For example, the face registration unit 200 binarizes the image data related to the face area extracted by the face area extraction unit 102 from the photographed image data acquired by the photographing unit 20 to detect a face pattern, and for each user. Are registered in the registered face pattern storage unit 204 by storing them. Note that a plurality of user face patterns can be registered. The user's face registration by the face registration unit 200 is performed when the user selects a mode for performing face registration via the operation unit 14.

  The face determination unit 202 extracts the image data of the portion related to the user's face from the image data acquired by the photographing unit 20 and binarizes it. Then, the face characteristics are stored in the registered face pattern storage unit 204. It is determined whether or not the registered user's face pattern matches with a predetermined percentage or more.

  Note that the method relating to the determination of the registered user's face is an example, and other conventionally known methods may be used.

  Then, the image recognition prediction unit 104 includes the registered user's face stored in the registered face pattern storage unit 204 in which the user's face included in the captured image data acquired by the imaging unit 20 by the face determination unit 202 is stored. When it is determined that the image matches the face, the field of view is obtained from the extracted face image data, and it is determined whether the image display unit 12 is included in the determined field of view. On the other hand, if the user's face included in the captured image data does not match the registered user's face stored in the registered face pattern storage unit 204, is the image display unit 12 included in the field of view? No judgment is made.

  The recognition information acquisition unit 106 acquires recognition information such as the number of image recognitions and image recognition time for each image data for each registered user. Then, the priority order determination unit 108 determines the priority order of each image data for each registered user based on the recognition information acquired by the recognition information acquisition unit 106.

  Here, as an example, FIG. 8 is a schematic diagram of a data file that constitutes a priority order table indicating the priority order for each image data determined for each of the users A and B, where A and B are registered users. Show.

  The priority order determination unit 108 creates a priority order table in which the priorities are increased in descending order of the number of times of image recognition for each image data for each of the users A and B as shown in FIG. The priority order table indicating the priority order for each image data is stored in the priority order storage unit 114. In FIG. 8, although the number of times of image recognition is given as the recognition information, it may be the image recognition time.

  Next, the operation of the second embodiment will be described.

  With reference to FIG. 9, the process for determining the priority order for each image data for each registered user will be described. The steps that are the same as those in the flowchart of FIG. 4 will be described only before and after the added steps, and the other steps that are the same will be given the same reference numerals and description thereof will be omitted.

  In step 502, an image based on the image data is displayed on the image display unit 12, and photographing by the photographing unit 20 is executed.

  Next, in step 700, the face determination unit 202 detects a face that matches the registered user's face pattern stored in the registered face pattern storage unit 204 from the captured image data acquired by the imaging unit 20. Determine whether or not. If it is determined that a face matching the face pattern has been detected, the determination is affirmative, and the process proceeds to step 504 where the image display unit 12 is included in the range of the user's field of view based on the extracted face image data. Judge whether or not On the other hand, if it is determined that a face that matches the face pattern has not been detected, the determination is negative, and the process proceeds to step 508 to determine whether or not the display image has been switched.

  In step 508, when the display image is switched, in step 510, recognition information is added to the priority table for each recognized user.

  As shown in the flowchart of FIG. 9, the case where an image is displayed on the image display unit 12 based on the priority order of each image data determined for each registered user is used with the flowchart shown in FIG. 10. I will explain.

  First, in step 800, the registered user sets the operation state of the digital photo frame 10 to a mode in which the display image is changed for each registered user via the operation unit 14. At this time, for example, when the user A sets the mode, the user A is registered as the current user at the time of the setting.

  Next, in step 802, the image is displayed on the image display unit 12 and the photographing unit 20 starts photographing. The image displayed at this time is displayed based on the priority order for each image data determined for each registered user who has set the operation state in step 800.

  Next, in step 804, it is determined whether or not the face area extraction unit 102 has extracted a face area from the captured image data acquired by the imaging unit 20. If a face has been extracted, it is determined affirmative and the process proceeds to step 806. On the other hand, when the face is not extracted, it is determined to be negative, the process proceeds to step 802, and image display and photographing are continuously repeated.

  In step 806, the face determination unit 202 compares the face extracted from the captured image data in step 804 with the registered user face pattern stored in the registered face pattern storage unit 204, and whether or not they match. Judge whether or not. If the face extracted from the photographed image data matches the registered user's face pattern, it indicates that the registered user's face is recognized, and the determination is affirmative, and the process proceeds to step 808. On the other hand, if the face extracted from the captured image data does not match the stored registered user's face pattern, it indicates that the registered user's face has not been recognized and is determined to be negative. The process proceeds to step 810. If it is determined negative in this step, the face photographed by the photographing unit 20 is not a user registered in the digital photo frame 10 but a person other than the registered user is displayed on the image display unit 12. This indicates the possibility of recognizing the image.

  In step 808, the display control unit 100 reads the priority order for each image data corresponding to the user recognized in step 804 from the priority order storage unit 114, and stores the priority order in the image display unit 12 in the order based on the priority order. Display an image. If the face recognized in step 806 is different from the registered user A set in step 800, for example, and is a registered user B, the current user is changed from the user A. Change to user B.

  In step 810, the display control unit 100 confirms the setting of this operation mode.

  Next, in step 812, the display control unit 100 determines whether or not the current user has registered a publicly available image that may be recognized by a person other than himself / herself in the setting of this operation mode. An openable image is registered in advance for each registered user, and image data of the openable image is stored in the memory 60. If the current user has registered a publicly available image, it is determined affirmative and the process proceeds to step 814. On the other hand, if the current user has not registered a publicly available image, it is determined as negative and the process proceeds to step 816.

  In step 814, the registered publicly available image is displayed on the image display unit 12, and the process proceeds to step 818.

  In step 816, the current user has not registered a publicly available image. In this case, a default image registered in advance is displayed on the image display unit 12, and the process proceeds to step 818.

  In step 818, the display control unit 100 determines whether the power source of the digital photo frame 10 has been turned off or the setting of the operation state of the digital photo frame 10 has been changed. When the power is turned off or the setting is changed, it is determined as affirmative and the image display process is terminated. On the other hand, if the power is not turned off or the setting is not changed, the process proceeds to step 820.

  In step 820, the display control unit 100 determines whether or not a predetermined time set in advance has elapsed. If the predetermined time has elapsed, the process proceeds to step 802, and again according to each current user. The image is displayed based on the priority order for each image data. If the predetermined time has not elapsed, it is determined to be negative and the time is continuously counted until the predetermined time elapses.

  In the process shown in the flowchart of FIG. 10, a person other than the registered user is displayed on the image display unit 12 together with a process of changing the image displayed on the image display unit 12 according to the registered person. The process of changing the image on the image display unit 12 to a publicly available image or the like when the recognized image is recognized is included. By doing so, it is possible to prevent a personal image of the registered user from being recognized by a person other than the registered user.

  In addition, when a person other than the registered user recognizes the image display unit 12 in order to prevent a person other than the registered user from recognizing a personal image of the registered user, The digital photo frame 10 may be turned off. The processing in this case will be described with reference to the flowchart shown in FIG.

  First, in step 900, when the user detects the face of a person other than the user via the operation unit 14, the digital photo frame is set to an automatic power off mode in which the power of the digital photo frame 10 is automatically turned off. 10 operation states are set.

  Next, in step 902, the image is displayed on the image display unit 12 and the photographing unit 20 starts photographing. The image displayed at this time is displayed based on the priority order for each image data determined for each user who has set the operation state in step 900.

  Next, in step 904, it is determined whether the face area extraction unit 102 has extracted a face area from the captured image data acquired by the imaging unit 20. If a face is extracted, it is determined affirmative and the process proceeds to step 906. On the other hand, when the face is not extracted, it is determined to be negative, the process proceeds to step 902, and image display and photographing are continuously repeated.

  In step 906, the face determination unit 202 compares the face extracted from the captured image data in step 904 with the registered user's face pattern stored in the registered face pattern storage unit 204, and whether or not they match. Judge whether or not. If the face extracted from the captured image data matches the registered face pattern, it indicates that the registered user's face has been recognized, and the determination is affirmative, and the process proceeds to step 920. On the other hand, if the face extracted from the captured image data and the registered face pattern do not match, it indicates that the registered user's face has not been recognized, and it is determined to be negative, and the process proceeds to step 908. If it is determined negative in this step, the person photographed by the photographing unit 20 is not a registered user, but recognizes an image displayed on the image display unit 12 by a person other than the registered user. This indicates the possibility of

  In step 908, when the face of a person other than the registered user is recognized in the setting of the automatic power-off mode, it is determined whether or not to wait for a predetermined time set in advance. If it is set to wait for a predetermined time, it is determined as affirmative and the process proceeds to step 910. On the other hand, if it is not set to wait for a predetermined time, it is determined to be negative, the process proceeds to step 918, the power of the digital photo frame 10 is turned off, and this process ends.

  In step 910, the image display unit 12 starts counting time.

  Next, in step 912, an image is displayed on the image display unit 12 and the photographing unit 20 performs photographing.

  Next, in step 914, the face determination unit 202 determines whether or not the registered user's face has been recognized from the captured image data acquired by the imaging unit 20. If it is determined that the registered user's face has been recognized, the determination is affirmative, and the process proceeds to step 920. On the other hand, if it is not determined that the registered user's face has been recognized, the determination is negative and the process proceeds to step 916.

  In step 916, the image display unit 12 determines whether or not a predetermined time has passed in advance. If the predetermined time has elapsed, the process proceeds to step 918, the power of the digital photo frame 10 is turned off, and this process is terminated. On the other hand, if the predetermined time has not elapsed, the process proceeds to step 912, where the image display unit 12 displays an image and the image capturing unit 20 captures the image until the predetermined time elapses.

  In step 920, the display control unit 100 determines whether or not a predetermined time set in advance has elapsed. When the predetermined time has elapsed, the process proceeds to step 902, and the image is displayed again based on the priority order for each image data corresponding to each current user. If the predetermined time has not elapsed, it is determined to be negative and the time is continuously counted until the predetermined time elapses.

  Here, the process shown in the flowchart of FIG. 10 and the process shown in the flowchart of FIG. 11 include a process for determining the priority order for each image data for each registered user shown in the flowchart of FIG. Not included. However, even when an image is displayed on the image display unit 12 in the processes shown in FIGS. 10 and 11, the priority order determination process for the image data shown in FIG. 9 may be performed.

  As described above, the face determination unit 202 determines whether or not the registered user's face and the user's face taken by the photographing unit 20 match. The unit 106 acquires recognition information for each image data according to the registered user, and the priority order determination unit 108 sets the priority for each image data according to the registered user based on the recognition information. decide. Thereby, the display control part 100 can display the image based on image data on an image display means with the priority according to each registered user.

  In addition, when a person other than the registered user recognizes the image displayed on the image display unit 12, switching to an image that may be recognized by a user other than the registered user set in advance, or digital photo By turning off the power of the frame 10, it is possible to protect the personal image of the registered user from being recognized other than the registered user.

It is a figure which shows the external appearance of a digital photo frame. It is a figure which shows the structure of the electric system of a digital photo frame. It is a functional block diagram regarding the determination of the priority for every image data based on 1st Embodiment. It is a schematic diagram of the data file which comprises the table which shows the priority for every image data based on 1st Embodiment. It is a flowchart regarding the process which determines the priority for every image data based on 1st Embodiment. It is a flowchart regarding the process which erase | eliminates image data based on 1st Embodiment. It is a functional block diagram regarding determination of the priority for every image data based on 2nd Embodiment. It is a schematic diagram of the data file which comprises the table which shows the priority for every image data determined for every user with which the face pattern was registered based on 2nd Embodiment. It is a flowchart regarding the process which determines the priority for every image data for every user based on 2nd Embodiment. It is a flowchart regarding the process which displays an image on an image display part based on the priority for every image data determined for every registered user based on 2nd Embodiment. It is a flowchart regarding the process which turns off the power supply of a digital photo frame, when a person other than the registered user recognizes an image display part based on 2nd Embodiment.

Explanation of symbols

10 Digital photo frame (image display device)
20 Shooting unit (shooting means)
60 memory (memory means)
100 Display control unit (display control means)
104 Image recognition prediction unit (image recognition prediction means)
106 recognition information acquisition unit (recognition information acquisition means)
108 priority order determination unit (priority determination means)
202 Face determination unit (face determination means)

Claims (6)

Storage means for storing a plurality of image data;
Image display means for displaying an image based on the image data stored in the storage means;
Photographing means for photographing the front direction of the image display means;
When the photographing unit photographs the user, the range of the field of view of the user captured from the image data obtained by the photographing is obtained, and the user displays the range of the field of view on the image display unit based on the range of the field of view. Image recognition prediction means for predicting that the displayed image has been recognized;
Based on the prediction result by the image recognition predicting means, the recognition information which is the frequency with which the user has recognized the image displayed on the image display means is obtained for each image data of the image displayed on the image display means. Recognition information acquisition means for
Priority order determining means for determining a priority order for each of the plurality of image data stored in the storage means based on the recognition information acquired by the recognition information acquiring means;
Display control means for controlling the image display means to display a plurality of the image data stored in the storage means based on the priority order determined by the priority order determination means;
An image display device comprising:   The recognition information acquired by the recognition information acquisition means is at least one of the time when the user recognizes the image displayed on the image display means and the number of times the image displayed on the image display means is recognized. The image display device according to claim 1, wherein:   The plurality of image data stored in the storage unit are deleted from the low-priority image data for each of the plurality of image data determined by the priority order acquisition unit when a predetermined condition is satisfied. The image display device according to claim 1, wherein the image display device is an image display device.   Face determination for determining whether or not the user's face pattern extracted from the image data relating to the user photographed by the photographing means matches a face pattern for each user registered in advance. And means for displaying the recognition information for each registered user on the image display means when the extracted face pattern matches a pre-registered face pattern for each user. The recognition information for each image data of the obtained image is acquired, and the priority order determination means determines the priority order for each of the plurality of image data for each registered user. Item 4. The image display device according to any one of Items 3 to 4.   When the face judging means judges that the photographing means has photographed a face that does not match the pre-registered face pattern for each user, the display control means displays the image displayed on the image display means. The image display device according to claim 4, wherein the image display device is switched to an image that may be recognized by a person other than the registered user.   The apparatus is turned off when the face judging means judges that the photographing means has taken a face that does not match a pre-registered face pattern for each user. 4. The image display device according to 4.

Images