JP2009200827A - Electronic device and image display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic device and an image display control method which enable easy recognition of a position of a frame having the image specified by a user in video content data upon video content data reproduction. <P>SOLUTION: A plurality of representative images are extracted out of the video content data. While one of the representative images is selected by the user, if a reproduction request event for indicating the reproduction of the video content data is inputted, the reproduction of the video content data is started earlier by a prescribed time than a time point when the selected representative image is displayed and a frame, in which the selected representative image is included in a group of frames constituting the video image content data, is highlighted for reproduction. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic apparatus and an image display method for displaying a list of images extracted from video content data.

  Generally, electronic devices such as a video recorder and a personal computer can record and reproduce various video content data such as television broadcast program data.

  In this case, although the title name is added to the content data stored in the electronic device, it is difficult for the user to understand what the content of each video content data is based on the title name alone. In order to grasp the contents of the video content data, it is necessary to reproduce the video content data.

  However, the reproduction of video content data having a long total time length requires a lot of time even when a fast-forward function or the like is used.

In Patent Document 1, in order to efficiently search and view recorded video content data, a face area is cut out as a partial image from a frame image of the video content data, and the cut-out face area partial images are displayed as a list. A technique for reproducing and displaying the corresponding video content data at the designated icon display position by designating a specific icon from the face area partial images displayed in the list has been disclosed.
JP 2001-309269 A (page 6, FIG. 1 and page 10, FIG. 8)

  Using the technique disclosed in Patent Document 1, the user not only refers to the title name added to the video content data but also refers to the face area partial image included in the video content data, and the video content It becomes possible to know the contents of data efficiently.

  However, when reproducing the video content data, it is difficult to recognize where the frame including the cut face area partial image is located in the video content data.

  Accordingly, the present invention provides an electronic device and an image display control method capable of easily recognizing where a frame including an image designated by a user is located in the video content data when reproducing the video content data. For the purpose.

  In order to achieve the above object, an electronic apparatus according to claim 1 includes an image extraction unit that extracts a plurality of representative images from video content data, and a state in which one of the plurality of representative images is selected by a user. When a playback request event for instructing playback of the video content data is input, playback that emphasizes and plays back a frame including the selected representative image in the frame group constituting the video content data. And means.

  In the electronic device according to claim 7, an image extracting unit that extracts a plurality of face images from video content data, and each of the plurality of face images extracted by the image extracting unit appears in the video content data. A time stamp information output means for outputting time stamp information indicating a time point to be played, and a playback request event instructing playback of the video content data in a state where one of the plurality of face images is selected by the user The video content data starts to be reproduced from a time before a time when the selected face image appears based on time stamp information assigned to the selected face image. , A frame including the selected face image in a group of frames constituting the video content data. Characterized by comprising a reproducing means for reproducing and tone.

  An image display method according to claim 13 is an image display method for displaying a list of images appearing in video content data, wherein a plurality of representative images are extracted from the video content data, When a playback request event instructing playback of the video content data is input while one is selected by the user, the selected representative image is included in a frame group constituting the video content data. This is characterized in that the frame to be reproduced is emphasized.

  According to the present invention, there are provided an electronic device and an image display control method capable of easily recognizing where a frame including an image designated by a user is located in video content data when the video content data is reproduced. It becomes possible.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, with reference to FIG. 1 and FIG. 2, the structure of the electronic device which concerns on one Embodiment of this invention is demonstrated. The electronic apparatus according to the present embodiment is realized by, for example, a notebook portable personal computer 10 that functions as an information processing apparatus.

  The personal computer 10 can record and reproduce video content data (audio visual content data) such as broadcast program data and video data input from an external device. That is, the personal computer 10 has a television (TV) function for viewing and recording broadcast program data broadcast by a television broadcast signal.

  This TV function is realized by, for example, a TV application program installed in the personal computer 10 in advance. The TV function also has a function of recording video data input from an external AV device, and a function of reproducing recorded video data and recorded broadcast program data.

  Furthermore, the personal computer 10 appears in a list of representative images such as images of objects appearing in video content data such as video data and broadcast program data stored in the personal computer 10, for example, video content data. It has an image list display function for displaying a list of human face images. This face image list display function is implemented as one function in the TV function, for example.

  The face image list display function is one of video indexing functions for presenting the user with an overview of video content data selected by the user as a navigation target. This face image list display function can present to the user which person appears in which time zone in the entire video content data to be navigated. The face image list display function can also display a list of persons by paying attention to a predetermined attribute section included in the video content data.

  FIG. 1 is a perspective view of the computer 10 with the display unit opened. The computer 10 includes a computer main body 11 and a display unit 12. The display unit 12 incorporates a display device including a TFT-LCD (Thin Film Transistor Liquid Crystal Display) 17.

  The display unit 12 is attached to the computer main body 11 so as to be rotatable between an open position where the upper surface of the computer main body 11 is exposed and a closed position covering the upper surface of the computer main body 11. The computer main body 11 has a thin box-shaped housing, and has a keyboard 13 on its upper surface, a power button 14 for powering on / off the computer 10, an input operation panel 15, a touch pad 16, and a speaker. 18A, 18B, etc. are arranged.

  The input operation panel 15 is an input device that inputs an event corresponding to a pressed button, and includes a plurality of buttons for starting a plurality of functions. These button groups also include operation button groups for controlling TV functions (viewing broadcast program data / video data, recording broadcast program data / video data, reproducing recorded broadcast program data / video data). ing.

  In addition, a remote control unit interface unit 20 for executing communication with a remote control unit for remotely controlling the TV function of the computer 10 is provided on the front surface of the computer main body 11. The remote control unit interface unit 20 includes an infrared signal receiving unit and the like.

  On the right side of the computer main body 11, for example, an antenna terminal 19 for TV broadcasting is provided. Further, on the back surface of the computer main body 11, for example, an external display connection terminal corresponding to the HDMI (high-definition multimedia interface) standard is provided. The external display connection terminal is used to output video data (moving image data) included in video content data such as broadcast program data to an external display.

  Next, the system configuration of the computer 10 will be described with reference to FIG.

  As shown in FIG. 2, the computer 10 includes a CPU 101, a north bridge 102, a main memory 103, a south bridge 104, a graphics processing unit (GPU) 105, a video memory (VRAM) 105A, a sound controller 106, a BIOS- ROM 109, LAN controller 110, hard disk drive (HDD) 111, DVD drive 112, video processor 113, memory 113A, card controller 113, wireless LAN controller 114, IEEE 1394 controller 115, embedded controller / keyboard controller IC (EC / KBC) 116 TV tuner 117, EEPROM 118, and the like.

  The CPU 101 is a processor that controls the operation of the computer 10 and executes various application programs such as an operating system (OS) 201 and a TV application program 202 that are loaded from the hard disk drive (HDD) 111 to the main memory 103. .

  The TV application program 202 is software for executing a TV function. The TV application program 202 includes a live reproduction process for viewing broadcast program data received by the TV tuner 117, a recording process for recording the received broadcast program data in the HDD 111, and broadcast program data / data recorded in the HDD 111. A reproduction process for reproducing video data is executed.

  The CPU 101 also executes a BIOS (Basic Input Output System) stored in the BIOS-ROM 109. The BIOS is a program for hardware control.

  The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The north bridge 102 also has a function of executing communication with the GPU 105 via a PCI EXPRESS standard serial bus or the like.

  The GPU 105 is a display controller that controls the LCD 17 used as a display monitor of the computer 10. A display signal generated by the GPU 105 is sent to the LCD 17. The GPU 105 can also send a digital video signal to the external display device 1 via the HDMI control circuit 3 and the HDMI terminal 2.

  The HDMI terminal 2 is the above-described external display connection terminal. The HDMI terminal 2 can send an uncompressed digital video signal and a digital audio signal to the external display device 1 such as a television with a single cable. The HDMI control circuit 3 is an interface for sending a digital video signal to the external display device 1 called an HDMI monitor via the HDMI terminal 2.

  The south bridge 104 controls each device on an LPC (Low Pin Count) bus and each device on a PCI (Peripheral Component Interconnect) bus. The south bridge 104 includes an IDE (Integrated Drive Electronics) controller for controlling the hard disk drive (HDD) 111 and the DVD drive 112. Further, the south bridge 104 has a function of executing communication with the sound controller 106.

  Furthermore, a video processor 113 is connected to the south bridge 104 via a PCI EXPRESS standard serial bus or the like.

  The video processor 113 is a processor that executes various processes related to the above-described video indexing. The video processor 113 functions as an indexing processing unit for executing a video indexing process.

  In the video indexing process, the video processor 113 extracts a plurality of representative images from the moving image data included in the video content data, and time stamp information indicating when each extracted representative image appears in the video content data. , Position information indicating where each extracted representative image is located in the video content data is output.

  As the representative image, for example, a human face image can be used. The extraction of the face image is executed by, for example, a face detection process for detecting a face area from each frame constituting moving image data included in the video content data, a cut-out process for cutting out the detected face area from the frame, and the like. The face area can be detected by, for example, analyzing an image feature of each frame and searching for an area having a feature similar to a face image feature sample prepared in advance. The face image feature sample is feature data obtained by statistically processing the face image features of a large number of persons.

  Also, when using a human face image as a representative image, face area position information indicating the position of the detected face area in the frame is extracted during the process of cutting out the detected face area from each frame constituting the moving image data. Output.

  The memory 113A is used as a working memory for the video processor 113. A large amount of calculation is required to execute the indexing process such as the video indexing process.

  In the present embodiment, a video processor 113 that is a dedicated processor different from the CPU 101 is used as a back-end processor, and indexing processing is executed by the video processor 113. Therefore, the indexing process can be executed without increasing the load on the CPU 101.

  The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speakers 18A and 18B or the HDMI control circuit 3.

  The wireless LAN controller 114 is a wireless communication device that performs wireless communication of, for example, IEEE 802.11 standard. The IEEE 1394 controller 115 executes communication with an external device via an IEEE 1394 standard serial bus.

  The embedded controller / keyboard controller IC (EC / KBC) 116 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard (KB) 13 and the touch pad 16 are integrated. . The embedded controller / keyboard controller IC (EC / KBC) 116 has a function of powering on / off the computer 10 in accordance with the operation of the power button 14 by the user. Further, the embedded controller / keyboard controller IC (EC / KBC) 116 has a function of executing communication with the remote control unit interface 20.

  The TV tuner 117 is a receiving device that receives broadcast program data broadcast by a television (TV) broadcast signal, and is connected to the antenna terminal 19. The TV tuner 117 is realized as a digital TV tuner capable of receiving digital broadcast program data such as terrestrial digital TV broadcast. The TV tuner 117 also has a function of capturing video data input from an external device.

  Next, the face image list display function executed by the TV application program 202 will be described with reference to FIG.

  As described above, the indexing process for video content data such as broadcast program data is executed by the video processor 113 functioning as an indexing processing unit.

  Under the control of the TV application program 202, the video processor 113 executes an indexing process on video content data such as recorded broadcast program data designated by the user, for example. The video processor 113 can also execute an indexing process on the received broadcast program data in parallel with the recording process of storing the broadcast program data received by the TV tuner 117 in the HDD 111.

  In the video indexing process (also referred to as face image indexing process), the video processor 113 analyzes moving image data included in the video content data in units of frames. Then, the video processor 113 extracts a human face image from each of a plurality of frames constituting the moving image data, and outputs time stamp information indicating a time point at which each extracted face image appears in the video content data. . As the time stamp information corresponding to each face image, the elapsed time from the start of the video content data to the appearance of the face image, the frame number from which the face image is extracted, or the like can be used.

  Furthermore, the video processor 113 also outputs the size (resolution) of each extracted face image. The face detection result data (face image, time stamp information TS, and size) output from the video processor 113 is stored as face image indexing information in the database 111A. The database 111A is a storage area for storing indexing data prepared in the HDD 111.

  Further, in the video indexing process, the video processor 113 also executes a thumbnail image acquisition process in parallel with the process of extracting the face image. A thumbnail image is an image (reduced image) corresponding to each of a plurality of frames extracted from video content data at regular time intervals, for example. That is, the video processor 113 sequentially extracts frames, for example, at predetermined equal time intervals from the video content data regardless of whether or not the frame includes a face image, and images (thumbnail images) corresponding to the extracted frames. And time stamp information TS indicating the time when the thumbnail image appears. Thumbnail image acquisition result data (thumbnail and time stamp information TS) output from the video processor 113 is also stored as thumbnail indexing information in the database 111A.

  As shown in FIG. 3, the TV application program 202 includes a face image list display processing unit 301 for executing a face image list display function. The face image list display processing unit 301 is realized as an indexing viewer program, for example, and uses video index data (face image indexing information, thumbnail indexing information, etc.) stored in the database 111A to outline video content data. Display the indexing view screen for a bird's-eye view.

  Specifically, the face image list display processing unit 301 reads face image indexing information (face image, time stamp information TS, and size) from the database 111A, and uses the face image indexing information to generate video content data. A list of face images of people appearing is displayed on a two-dimensional display area (hereinafter referred to as a face thumbnail display area) on the indexing view screen. In this case, the face image list display processing unit 301 divides the total time length of the video content data into a plurality of time zones, for example, at regular intervals, and for each time zone, extracts the face image from the extracted face images. A predetermined number of face images appearing on the screen are selected. Then, the face image list display processing unit 301 displays the selected predetermined number of face images side by side for each time period.

  That is, the two-dimensional face thumbnail display area includes a plurality of face image display areas arranged in a matrix including a plurality of rows and a plurality of columns. A plurality of time zones constituting the total time length of the video content data are assigned to each of the plurality of columns. Specifically, for example, in each of the plurality of columns, a plurality of time zones having the same time length obtained by dividing the total time length of the video content data at equal intervals by the number of the plurality of columns. Are assigned to each. Of course, the time zone allocated to each column does not necessarily have the same time length.

  The face image list display processing unit 301, based on the time stamp information TS corresponding to each face image, on the face image display area for the number of rows belonging to each column, faces belonging to the time zone assigned to each column. For example, the images are arranged and displayed in the order of appearance frequency order (face image detection time length order). In this case, for example, face images corresponding to the number of lines are selected in descending order of appearance frequency (appearance frequency) from the face images belonging to the time zone assigned to each column, and the selected face images are arranged in the appearance frequency order. They are arranged side by side from top to bottom. Of course, instead of the appearance frequency order, the face images that appear in the time zone assigned to each column may be displayed in the order of appearance.

  With this face image list display function, it is possible to easily show to the user which person appears in which time zone in the entire video content data. A specific configuration example of the face thumbnail display area will be described later with reference to FIG.

  In addition, the face image list display processing unit 301 reads thumbnail indexing information (thumbnail and time stamp information TS) from the database 111A, and uses the thumbnail indexing information to display each thumbnail image below or above the face thumbnail display area. On the thumbnail display area arranged on one side (hereinafter referred to as the “jabal thumbnail display area”), the thumbnail images are displayed in a line in order of appearance time.

  Depending on the video content data, there may be a time period when the face image does not appear. Therefore, by displaying not only the face thumbnail display area but also the loose thumbnail display area on the indexing view screen, the contents of the video content data in that time period can be presented to the user even during the time period when the face image does not appear. Can do.

  Next, the functional configuration of the TV application program 202 will be described with reference to FIG.

  The TV application program 202 includes a recording processing unit 401, an indexing control unit 402, a reproduction processing unit 403, and the like in addition to the face image list display processing unit 301 described above.

  The recording processing unit 401 executes a recording process of recording broadcast program data received by the TV tuner 117 or video data input from an external device in the HDD 111. Further, the recording processing unit 401 receives broadcast program data designated by recording reservation information (channel number, date and time) preset by the user using the TV tuner 117, and reserves to record the broadcast program data in the HDD 111. Recording processing is also executed.

  The indexing control unit 402 controls the video processor (indexing processing unit) 113 to cause the video processor 113 to execute the indexing process. The user can specify whether or not to perform the indexing process for each broadcast program data to be recorded. For example, for broadcast program data to be recorded for which execution of the indexing process is instructed, the indexing process is automatically started in parallel with the process of recording the broadcast program data in the HDD 111. The user can also specify video content data to be indexed from video content data already stored in the HDD 111.

  The playback processing unit 403 executes processing for playing back each video content data stored in the HDD 111. Also, the playback processing unit 403 displays the selected face image when a playback request event is input by a user operation while one face image in the face image list of a certain video content data is selected. It has a function of starting playback of video content data from a time point before a predetermined time.

  The user can determine the position where the reproduction of the video content data is to be started while viewing the face image list.

  Note that the indexing process is not necessarily executed by the video processor 113. For example, the TV application program 202 may be provided with a function for executing the indexing process. In this case, the indexing process is executed by the CPU 101 under the control of the TV application program 202.

  Next, a specific configuration of the indexing view screen will be described with reference to FIGS.

  FIG. 5 shows an example of an indexing view screen displayed on the LCD 17 by the face image list display processing unit 301. This indexing view screen is a screen obtained by indexing certain video content data (for example, broadcast program data). This indexing view screen includes the above-described face thumbnail display area for displaying a list of face images and the above-described jagged thumbnail display area for displaying a list of thumbnail images in a loose format.

  Here, the loose format is a display format in which a selected thumbnail image is displayed in a normal size, and the other thumbnail images are displayed in a reduced size in the horizontal direction. FIG. 5 shows the case where the leftmost thumbnail image is selected.

  The face image list display processing unit 301 displays the thumbnail image selected by the user operation in the first horizontal width size, and displays the horizontal width size of each of the other thumbnail images in a horizontal width size smaller than the first horizontal width size. Specifically, the selected thumbnail image is displayed in the first width size, and some thumbnail images in the vicinity of the selected thumbnail image are displayed with the width reduced, and each of the other thumbnail images is displayed. Is displayed with a slight width. A rectangular frame may be further added to the selected thumbnail image.

  In the face thumbnail display area, a list of a plurality of face images is displayed. When face images are not detected continuously for a certain period or longer, thumbnail images of the entire frame may be displayed in the face thumbnail display area. In addition, a thumbnail image of the entire frame may be displayed in the face thumbnail display area at each scene change.

  FIG. 6 shows a configuration example of the face thumbnail display area.

  The face thumbnail display area includes a plurality of face image display areas arranged in a matrix including a plurality of rows and a plurality of columns. In FIG. 6, the face thumbnail display area is composed of 6 rows × 16 columns. The number of face image display areas included in the face thumbnail display area is 96.

  Each of the columns 1 to 16 includes, for example, a plurality of time zones having the same time length T obtained by dividing the total time length of the video content data by equal numbers of columns (= 16). Assigned to each.

  For example, if the total time length of the video content data is 2 hours, the 2 hours are divided into 16 time zones at equal intervals. In this case, the time length T of each time zone is 7.5 minutes. For example, column 1 is assigned the time zone from the beginning 0:00:00 to 0:07:30, and column 2 is assigned the time zone from 0:07:30 to 0:15:00. Column 3 is assigned a time zone from 0:15:00 to 0:22:30. The time length T of each time zone changes according to the total time length of the video content data.

  Of course, the length of the time zone assigned to each of the plurality of columns is not necessarily the same.

  The face image list display processing unit 301 uses the time stamp information corresponding to each face image extracted by the video processor 113 to display the time allocated to each column on the six face image display areas in each column. For example, the face images belonging to the band are displayed side by side in the above-mentioned frequency order. In this case, the face image list display processing unit 301 selects face images corresponding to the number of lines (six) from among the face images belonging to the time zone assigned to the display processing target column, and corresponds to the selected number of lines. Display face images side by side.

  In this way, the face thumbnail display area uses a time axis with the left end position (1, 1) as the base point and the right end position (6, 16) as the end of the video content data.

  The size of the face image displayed in each face image display area of the face thumbnail display area can be selected by the user from among “large”, “medium”, and “small”. The number of rows and columns is changed according to the size of the face image selected by the user. The relationship between the size of the face image and the number of rows and columns is as follows.

  (1) "Large"; 3 rows x 8 columns

  (2) “Medium”; 6 rows x 16 columns

  (3) "Small": 10 rows x 24 columns

  In the case of “large”, each face image is displayed with a size of, for example, 180 × 180 pixels. In the case of “medium”, each face image is displayed with a size of 90 × 90 pixels, for example. In the case of “small”, each face image is displayed with a size of 60 × 60 pixels, for example. The default face image size is set to “medium”, for example.

  Each face image in the face thumbnail display area is set to one of two states, a “standard” state that is not selected and a “focus” state that is selected. The size of the face image in the “focus” state is set larger than the size in the “standard” state (180 × 180, 90 × 90, or 60 × 60). FIG. 8 shows a case where the face image at the coordinates (1, 12) is in the “focus” state.

  The number of thumbnail images displayed in the loose thumbnail display area is set to, for example, 240, 144, 96, or 48 according to the user setting. The default is 240 sheets, for example.

  The thumbnail image is set to one of two states, a “standard” state that is not selected and a “focus” state that is selected. A thumbnail image in the “focus” state is displayed in a larger size than other thumbnail images.

  Next, it is selected by the user when playing the video content data that is started when a playback request event occurs in response to a user operation for selecting one face image in the face image list in the face thumbnail display area. A first embodiment for emphasizing and reproducing a frame including a face image will be described with reference to FIG.

  When the reproduction request event corresponding to the face image selection operation by the user occurs, the time stamp information assigned to the selected face image is read (step S100).

  Based on the time stamp information read in step S100, the face image list display processing unit 301 starts with a frame in which a value smaller than the read time stamp information by a predetermined value is assigned to the HDD 111. A frame acquisition request for acquiring a predetermined number of frame groups is issued (step S101).

  The reason for acquiring a predetermined number of frames including a frame to which a value smaller by a predetermined value than the value of the time stamp information read in step S100 is obtained is when the face image selected by the user appears. This is because the video content data is reproduced from a point in time before the predetermined time.

  Of the plurality of frame groups read from the HDD 111 in response to the frame acquisition request in step S101, a frame to which time stamp information having the same value as the value of the time stamp information read in step S100 is assigned is specified. (Step S102).

  In the reproduction of the plurality of frame groups read in response to the frame acquisition request in step S101, the reproduction processing unit 403 stops the reproduction for a predetermined time when reproducing the frame specified in step S102. That is, the playback processing unit 403 differs from the frame specified in step S102 for the frame specified in step S102 in the playback of a plurality of frame groups read in response to the frame acquisition request in step S101. Playback is performed over a longer time than the playback time of each frame (step S103).

  As described above, in the reproduction of the video content data, the reproduction is stopped for a predetermined time when the frame including one face image selected by the user from the face image list in the face thumbnail display area is reproduced. A frame including one face image selected by the user is emphasized and reproduced, and the user can easily recognize where in the video content data the frame including the face image selected by the user is located. Is possible.

  Next, a second embodiment will be described with reference to FIG. The processing different from that in the first embodiment described above is processing after step S103.

  The second embodiment is an example in which processing is performed on the frame specified in step S102. That is, as shown in (2) of FIG. 9, the background color of the frame specified in step S102 is designated as a specific color (step S203).

  In the reproduction of a plurality of frame groups read in response to the frame read request in step S101, the reproduction processing unit 403 reproduces a frame having the specific color designated in step S203 as a background color (step S204). .

  In this way, by reproducing a video content by designating a specific color as a background color of a frame including one face image selected by the user from the face image list in the face thumbnail display area. A frame including one face image selected by the user is emphasized and reproduced, and the user can easily recognize where in the video content the frame including the face image selected by the user is located. It becomes possible.

  Next, a third embodiment will be described with reference to FIG. The processing different from that in the first embodiment described above is processing after step S103.

  The third embodiment is an example in which a processing process is performed on the frame specified in step S102. In other words, as shown in (2) of FIG. 11, an area that matches the face image selected by the user in the frame specified in step S102 is highlighted. In the example shown in FIG. 11, the frame image is overlaid on the frame specified in step S102 so as to surround the area that matches the face image selected by the user included in the frame specified in step S102. Process (step S303). The process of step S303 is performed using the face area position information created during the process of cutting out the face area detected from the frame described above.

  In the reproduction of a plurality of frame groups read in response to the frame read request in step S101, the reproduction processing unit 403 reproduces the frame in which the frame image has been subjected to the overlay process in step S303 (step S304).

  As described above, the video content data is reproduced by reproducing the frame processed so as to enclose the area matching the one face image selected by the user from the face image list in the face thumbnail display area. The frame including one face image selected by the user is emphasized and reproduced, and the user easily recognizes where in the video content data the frame including the face image selected by the user is located. It becomes possible.

  In addition, by playing back a frame that has been framed with respect to an area that matches one face image selected by the user, where the face image selected by the user appears in the playback of video content data. The user can easily recognize.

  In the third embodiment described above, as an example of highlighting an area that matches the face image selected by the user in the specified frame, an example in which this area is surrounded by a frame has been described. For example, an area that matches the face image selected by the user may be enlarged, and the enlarged face image may be displayed superimposed on the frame.

  In the first to third embodiments described above, the user selects a face image, which is an example of a representative image extracted from the moving image data by the video indexing process, from the face image list in the face thumbnail display area. Although the configuration to be selected has been described, the configuration is not limited to this configuration, and an image other than a face image may be used as an example of a representative image.

  The present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The perspective view which shows the example of the external appearance of the electronic device which concerns on one Embodiment of this invention. 2 is an exemplary block diagram showing an example of the system configuration of the electronic apparatus of the embodiment. FIG. FIG. 3 is an exemplary block diagram for explaining a face image list display function of the electronic apparatus of the embodiment. 2 is an exemplary block diagram illustrating a functional configuration of a program used in the electronic apparatus of the embodiment. FIG. 6 is an exemplary view showing an example of an indexing view screen displayed on the display device by the electronic apparatus of the embodiment. FIG. The figure which shows the structural example of the face thumbnail display area contained in the indexing view screen of FIG. A first embodiment of video content playback that is started when a playback request event occurs in response to a user operation for selecting one face image in the face image list in the face thumbnail display area will be described. flow diagram. A second embodiment of the playback of video content that is started when a playback request event occurs in response to a user operation for selecting one face image in the face image list in the face thumbnail display area will be described. flow diagram. The figure which shows an example of the frame which overlaid the color with respect to the specified flame | frame. A third embodiment of the playback of video content that is started when a playback request event occurs in response to a user operation for selecting one face image in the face image list in the face thumbnail display area will be described. flow diagram. The figure which shows an example of the flame | frame processed so that the face area corresponded to one face image selected by the user may be enclosed with a frame.

Explanation of symbols

10 ... electronic device (computer), 111A ... database,
113 ... Video processor, 117 ... TV tuner, 301 ... Face image list display processing unit, 402 ... Indexing control unit, 403 ... Reproduction processing unit

Claims (18)

Image extracting means for extracting a plurality of representative images from video content data;
When a playback request event instructing playback of the video content data is input in a state where one of the plurality of representative images is selected by the user, the frame content constituting the video content data Playback means for enhancing and playing back a frame including the selected representative image;
An electronic device comprising: 2. The electronic device according to claim 1, wherein the reproduction unit is a reproduction unit that stops for a predetermined time in a frame including the selected representative image in a frame group constituting the video content data. . Further comprising processing means for processing a frame including the selected representative image in the frame group constituting the video content data,
2. The electronic apparatus according to claim 1, wherein the reproduction unit is a reproduction unit that reproduces a frame processed by the processing unit. 4. The electronic apparatus according to claim 3, wherein the processing unit is a unit that designates a color of a frame including the selected representative image as a specific color. 4. The electronic apparatus according to claim 3, wherein the processing unit is a unit that emphasizes a region that matches the representative image in a frame including the selected representative image. The electronic apparatus according to claim 5, wherein the processing unit is a unit that performs processing by enclosing a region that matches the representative image in a frame including the selected representative image with a frame. Image extracting means for extracting a plurality of face images from video content data;
Time stamp information output means for outputting time stamp information indicating a time point at which each of the plurality of face images extracted by the image extraction means appears in the video content data;
When a playback request event instructing playback of the video content data is input in a state where one of the plurality of face images is selected by a user, a time allocated to the selected face image Based on the stamp information, reproduction of the video content data is started from a time point a predetermined time before the time point when the selected face image appears, and the selected image is selected from the frame group constituting the video content data. Reproduction means for emphasizing and reproducing a frame including a face image that is present,
An electronic device comprising: 8. The reproduction means according to claim 7, wherein the reproduction means is a reproduction means that pauses and reproduces a frame including the selected face image within a frame group constituting the video content data for a predetermined time. Electronics. Processing means for processing a frame including the selected face image in a frame group constituting the video content data;
8. The electronic apparatus according to claim 7, wherein the reproducing unit is a reproducing unit that reproduces a frame processed by the processing unit. 10. The electronic apparatus according to claim 9, wherein the processing unit is a unit that designates a color of a frame including the selected face image as a specific color. 8. The electronic apparatus according to claim 7, wherein the processing means is means for emphasizing a region that matches the face image in a frame including the selected face image. 12. The electronic apparatus according to claim 11, wherein the processing unit is a unit that performs processing for enclosing a region that matches the face image in a frame including the selected face image with a frame. In an image display method for displaying a list of images appearing in video content data,
Extracting a plurality of representative images from the video content data;
When a playback request event instructing playback of the video content data is input in a state where one of the plurality of representative images is selected by the user, the frame content constituting the video content data An image display method, wherein a frame including a selected representative image is emphasized and reproduced. 14. The image display method according to claim 13, wherein a frame including the selected representative image in a frame group constituting the video content data is stopped and reproduced for a predetermined time. Processing a frame including the selected representative image in a frame group constituting the video content data;
14. The image display method according to claim 13, wherein the processed frame is reproduced. The image display method according to claim 15, wherein a color of a frame including the selected representative image is designated as a specific color. The image display method according to claim 15, wherein an area that matches the representative image in a frame including the selected representative image is enhanced. The image display method according to claim 17, wherein a region that matches the representative image in a frame including the selected representative image is surrounded by a frame.

Images