JP2005292691A - Moving image display device and moving image display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate and present moving image data resulting from enlarging and displaying part of an image, to a browser while analyzing the contents on a moving image display device like a portale phone having a small display screen. <P>SOLUTION: A moving image resulting from enlarging and displaying a part of an image is generated by a display moving image generation means 27 on the basis of scene switching data generated by a scene switching detection means 23 and display information data generated by a display information data management means 26, so that an enlarged moving image corresponding to contents of moving image data can be automatically generated and presented to the browser, and thus moving image reproduction which allows the browser to easily recognize the contents is realized on the moving image display device having a limited display screen. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a moving image display apparatus and a moving image display method, such as a mobile terminal, which receives a moving image serviced via a network and displays a part of the moving image in an enlarged manner.

In recent years, with the development of wireless communication technology and compression coding technology, a mobile terminal having a communication function such as a mobile phone is used as a video display device, and a video received from a video server via a mobile communication network is viewed. It is possible. In such a system, in the moving image server and the moving image display device, transmitting / receiving means for transmitting / receiving moving image data to be displayed, moving image compression encoding means for compressing and encoding moving image data to data that can be transmitted wirelessly, etc. It has. In addition, a system that can control the quality of a moving image to be reproduced in accordance with the communication speed and communication quality of a communication line has been proposed (for example, Patent Document 1). In addition, a system has been proposed in which a moving image is displayed by enlarging a part of the moving image and reducing the other part in consideration of the screen size of the display part included in the moving image display device when displaying the moving image ( For example, Patent Document 2). This system has a feature that the user can easily grasp the contents of the moving image even on a terminal having a small display screen such as a portable video display device.
JP 2000-209555 A JP 2003-84749 A

  In a conventional general moving image server and moving image display device, the moving image display device receives moving image data managed by the moving image server, and attributes such as a bit rate and a screen size when the moving image data is encoded. The data is compounded without being changed and reproduced by the display means of the moving image display device. At that time, in mobile terminals used as moving image display devices, the communication speed and communication quality when communicating moving image data become bottlenecks, making it difficult to play high-quality videos, and the screen size of mobile terminals Then, it is difficult to grasp the content of the moving image. In addition, in the moving image display device in Patent Document 2, a part of a moving image is enlarged and displayed, and the other part is reduced to make it easy to recognize a specific part. In the type of moving image display device, the display area is very small, and the contents cannot be grasped even if the display is reduced. In addition, in the moving image display device disclosed in Patent Document 2, it is necessary for the user to explicitly specify a portion to be enlarged and displayed, particularly when a moving image whose contents are not grasped by the user is reproduced. The operation becomes complicated and it becomes very difficult to enjoy the contents of the moving image.

  Accordingly, the present invention provides a moving image display device and a moving image display method that can display a portion of a moving image in an enlarged manner and reproduce it when browsing moving image data, and allow a viewer to easily grasp the contents of the moving image. The purpose is to provide.

The moving image display apparatus of the present invention according to claim 1 is a communication unit that receives moving image data from a moving image server, and a moving image data management unit that stores and manages the moving image data received from the moving image server. And a scene switching detection means for detecting scene transitions in the moving image data to generate scene switching data, and determining the enlargement range of the moving image to be displayed on the screen from the contents of the moving image for each scene and displaying information Display information data generating means for generating data, display moving image generating means for generating display moving image data in which a part of the moving image data is enlarged with reference to the scene switching data and the display information data, and the display And display means for displaying the moving image data for display generated by the moving image generation means.
According to a second aspect of the present invention, in the moving image display device according to the first aspect, the scene switching detection unit calculates a pixel data difference between frames in the moving image data, and the pixel data difference. Means for comparing with a predetermined value, and means for recognizing a frame having a pixel data difference larger than the predetermined value as a scene change, in a form in which the frame recognized as a scene change is associated with a time axis of a moving image. It is characterized by being converted into data and stored in the scene switching data management means as scene switching data.
According to a third aspect of the present invention, in the moving image display device according to the first aspect, the display information data generating means includes means for analyzing the frequency component of the frame image constituting the moving image data, and the analyzed frequency component. Means for recognizing the complexity of the content of the moving image data and the position to be noted in the screen of the moving image, And means for determining an enlargement range.
According to a fourth aspect of the present invention, there is provided the moving image display device according to the first aspect, further comprising display change information management means for storing setting change data changed by a user and managing the setting change data in association with the moving image data, The display moving image generation means changes the enlargement range of the moving image and the display image size based on the setting change data stored in the display change information management means.
According to a fifth aspect of the present invention, in the moving image display device according to the first aspect, the moving image data managing means receives the moving image data received from the moving image server instead of the moving image data for display. It is characterized by storing as it is.
According to a sixth aspect of the present invention, in the moving image display device according to the first aspect, the display moving image creating means displays a moving image for display for each scene described in the scene switching data. A portion specified by the display information data is enlarged and displayed after the entire moving image of the scene is copied.
According to a seventh aspect of the present invention, in the moving image display device according to the first aspect, the display means includes a moving image for display using an enlarged image created by the display moving image creating means, and the moving image data management. The original moving image data managed by the means is simultaneously displayed on the same screen.
The present invention according to claim 8 is the moving image display device according to claim 1, wherein the display means is composed of a plurality of display screens, and a moving image for display using an enlarged image created by the display moving image creating means. The image and the original moving image data managed by the moving image data managing means have a function of simultaneously reproducing them on different display screens.
The moving image display method of the present invention according to claim 9 is a moving image display method for displaying a moving image composed of a plurality of frame images on a moving image display device, and comprises moving image data received from a moving image server. Analyzing the frequency component of each frame image, recognizing a position to be noted in the moving image from the analyzed frequency component, and determining an enlarged range to be displayed on the screen from the recognized position of the moving image data .

According to the present invention, when viewing moving image data using a moving image reproduction terminal with a limited display screen area such as a mobile phone or a portable terminal, a portion of the moving image can be enlarged and reproduced, The viewer can easily grasp the contents of the moving image.
In addition, since the moving image playback method according to the present invention automatically determines the range and position of the enlarged display of the moving image according to the content of the moving image, the user does not need to specify the enlarged portion by himself and can easily The image can be viewed.
Furthermore, in the moving image reproduction method according to the present invention, it is possible to reproduce the moving image reflecting the preference of the moving image viewer by storing the contents changed by the user during the reproduction of the moving image and using it at the next reproduction or later. Become.

The moving image display apparatus according to the first embodiment of the present invention includes a communication unit that receives moving image data from a moving image server, and a moving image data management unit that stores and manages moving image data received from the moving image server. And scene change detection means for detecting scene changes in the moving image data to generate scene switching data, and display information data by determining the enlargement range of the moving image to be displayed on the screen from the contents of the moving image for each scene Display information data generating means for generating image data, display moving picture generating means for generating display moving image data in which a part of moving image data is enlarged with reference to scene switching data and display information data, and generated by display moving image generating means Display means for displaying the displayed moving image data. According to the present embodiment, a part of the moving image data to be reproduced can be enlarged and displayed to the user, and the contents of the moving image can be easily grasped even on a small screen.
According to a second embodiment of the present invention, in the moving image display device according to the first embodiment, the scene switching detection unit includes a unit that calculates a pixel data difference between frames in the moving image data, and a pixel data difference. And a means for recognizing a frame with a pixel data difference larger than a predetermined value as a scene change, and a frame recognized as a scene change corresponding to a time axis of a moving image. It is converted into data and stored in the scene switching data management means as scene switching data. According to the present embodiment, a portion where the change in the content of the moving image is small is managed as one scene, and the change in the enlargement position is reduced by enlarging and displaying the same part in the same scene, and the user can It is possible to reproduce a moving image that makes it easy to grasp the contents of the image.
According to the third embodiment of the present invention, in the moving image display apparatus according to the first embodiment, the display information data generation unit analyzes the frequency component of the frame image constituting the moving image data. Means for recognizing the complexity of the content of moving image data from the frequency component and the position to be noticed in the screen of the moving image, and displaying on the screen from the complexity of the content of the recognized moving image data and the position to be noticed And means for determining a moving image size and an enlargement range. According to the present embodiment, this configuration makes it possible to automatically enlarge and display the optimum portion according to the content of the moving image, omitting the procedure for the user to select the enlarged position, It is possible to realize comfortable moving image reproduction that makes it easy to grasp the contents.
According to a fourth embodiment of the present invention, in the moving image display apparatus according to the first embodiment, a display change information management unit that stores setting change data changed by a user and manages the setting change data in association with the moving image data. The display moving image generating means changes the enlarged range of the moving image and the display image size based on the setting change data stored in the display change information management means. According to the present embodiment, with this configuration, it is possible to reflect the content that the user changed last time during moving image reproduction, and it is possible to reproduce the moving image more reflecting the user's preferences.
According to a fifth embodiment of the present invention, in the moving image display apparatus according to the first embodiment, the moving image data management means receives the moving image data received from the moving image server instead of the moving image data for display. The original data is saved as it is. According to the present embodiment, it is not necessary to receive moving image data from the server each time the display information data is changed, as compared with a case where only a moving image for reproduction that is partially enlarged is stored. It becomes possible to flexibly respond to requests for changing the display size and the enlargement range at the time of moving image playback thereafter.
According to a sixth embodiment of the present invention, in the moving image display apparatus according to the first embodiment, the display moving image creating means creates a display moving image for each scene described in the scene switching data. Then, after copying the entire moving image of the scene to be displayed, the portion designated by the display information data is enlarged and displayed. According to the present embodiment, the user can see the entire screen before enlarging and displaying a part of each scene, so that the content of the moving image can be easily understood.
According to a seventh embodiment of the present invention, in the moving image display device according to the first embodiment, the display means includes a moving image for display using an enlarged image created by the display moving image creating means, and moving image data. It has a function of simultaneously displaying the original moving image data managed by the management means on the same screen. According to the present embodiment, when the user selects this function, both the original moving image and a partially expanded moving image can be simultaneously viewed on the same screen, and the entire screen is grasped. However, it is possible to check details as well.
According to an eighth embodiment of the present invention, in the moving image display device according to the first embodiment, the display unit is configured by a plurality of display screens, and a display using an enlarged image created by the display moving image creation unit. This has a function of simultaneously playing back the moving image for use and the original moving image data managed by the moving image data management means on different display screens. According to the present embodiment, in a video playback device configured with a plurality of screens, both the original moving image and a partially expanded moving image on different screens when the user selects this function. Can be viewed at the same time, and it is possible to grasp the entire screen and confirm details while effectively using a plurality of screens.
A moving image display method according to a ninth embodiment of the present invention is a moving image display method for displaying a moving image composed of a plurality of frame images on a moving image display device, and the moving image data received from a moving image server is received. Analyzes the frequency components of each frame image that composes, recognizes the position to be noted in the moving image from the analyzed frequency component, and determines the expansion range to be displayed on the screen from the position of the recognized moving image data . According to the present embodiment, by enlarging the portion and presenting it to the user, the user can easily grasp the contents of the moving image even on a portable terminal having a small screen size.

Hereinafter, a moving image display apparatus according to an embodiment of the present invention will be described.
FIG. 1 is a block diagram showing a moving image display apparatus according to an embodiment of the present invention as function realizing means, FIG. 2 is a flowchart showing the flow of each process until moving image display in the apparatus, and FIG. 3 is a scene of the apparatus 4 is a flowchart showing a flow of scene switching data generation processing in the switching detection means, FIG. 4 is a flowchart showing a flow of display information data generation processing in the display information data management means of the apparatus, and FIG. 5 is a display in display moving image generation means of the apparatus. 6 is a flowchart showing the flow of moving image generation processing, FIG. 6 is an image diagram of display means during moving image reproduction in the apparatus, and FIG. 7 is a flowchart showing the flow of display information change processing by a user operation during moving image reproduction in the apparatus. 8 is a flowchart showing the flow of the second and subsequent moving image playback processing in the apparatus, and FIG. Le video data and screen image diagram showing the simultaneous reproduction of the enlarged moving image data, FIG. 10 is a screen image diagram showing the simultaneous reproduction processing on the two screens of the original moving image data and the expanded video data in the apparatus.

First, the configuration of the moving image display apparatus in this embodiment will be described with reference to FIG.
The moving image display apparatus 20 includes a communication unit 21 that transmits / receives data to / from the moving image server 10. Based on the request data from the moving image display device 20, the moving image server 10 transmits the corresponding moving image data from the moving image data stored in the server in advance to the moving image display device 20. The moving image display apparatus 20 receives the moving image data transmitted from the moving image server 10 by the communication unit 21, and the received moving image data is accumulated and managed for each data type by the moving image data management unit 22. Is done.
The scene switching detection unit 23 recognizes a scene change from the moving image data stored in the moving image data management unit 22 and generates scene switching data. The scene switching detection means 23 sequentially searches each frame image in the moving image, and determines the timing at which the image content changes significantly as scene switching data. The scene switching data management means 24 accumulates and manages the scene switching data generated by the scene switching detection means 23 for each moving image data.
The display information data generation unit 25 determines a display method of moving image data to be reproduced, and generates display information data. In this display information data generation means 25, each scene of the moving image data acquired from the moving image data management means 22 by referring to the scene switching data acquired by the scene change detection means 23 and managed by the scene change data management means 24. In addition, display information data is generated by determining an enlargement position and an enlargement size in the moving image. The display information data management means 26 accumulates and manages the display information data generated by the display information data generation means 25 for each scene of moving image data.
The display moving image generation unit 27 generates reproduction moving image data to be reproduced by the display unit 28 and outputs it to the display unit 28. In this display moving image generation means 27, the scene switching data stored in the scene switching data management means 24 and the display information data stored in the display information data management means 26 are read, and the moving image acquired from the moving image data management means 22 is read. Reproduction moving image data in which the data is enlarged and displayed based on the display information data is generated.
The display change information management means 29 stores and manages data related to the change display method input from the display method change means 30 during moving image reproduction. In this display change information management means 29, change data relating to the enlargement position and enlargement size of the moving image when the user changes is stored in association with the moving image data. When the moving image is reproduced again, the display moving image generation unit 27 refers to the change data stored in the display change information management unit 29 and performs a moving image display process. The display means 28 corresponds to a liquid crystal screen or the like of a mobile phone or a mobile terminal device, and reproduces and outputs a moving image to the user.

Next, an outline of processing from when the moving image display apparatus 20 receives moving image data to when the moving image is reproduced will be described with reference to FIG.
First, the moving image display apparatus 20 transmits a request for moving image data that the user wants to see to the moving image server 10 from the communication unit 21, and the moving image transmitted from the moving image server 10 by the communication unit 21. Image data is received (step 11). As a communication method at this time, for example, a wireless communication function provided in a mobile phone or a mobile terminal device can be used. The received moving image data is stored and managed by the moving image data management means 22 for each type of moving image data without changing the received moving image data. Next, the process proceeds to a process for creating scene switching data (step 12). In step 12, in order to classify the moving image data into several scenes according to the contents, each frame image of the moving image data is analyzed, and a scene change data managing means using a scene whose scene changes greatly as scene change data. 24. In the subsequent processes, the saved scene switching data is used. After step 12, the process proceeds to display information data creation processing (step 13). In step 13, the scene switching data created in step 12 is referred to, and for each scene of the moving image data, the position and range that should be most noticed among them (to be noticed in order to grasp the contents of the scene) Judgment is made automatically from the contents of the scene, and it is stored as display information data. After step 13, the process proceeds to a display moving image creation process (step 14). In step 14, the display information data created in step 13 is referred to create a display moving image in which a part of the moving image data is displayed in an enlarged manner. Then, the display moving image created in step 14 is reproduced (step 15). Thereby, a moving image is displayed on the display means 28, and a user can browse the moving image. By performing the processing as described above, even a moving image display device with a small display screen can display an enlarged main part, so that the contents of the moving image can be easily grasped and browsed comfortably.

Next, the process of creating scene switching data in step 12 in FIG. 2 will be described with reference to FIG.
When the scene switching data creation process is started, difference data between the frame images of the target moving image data is calculated (step 21). From the difference data between the frame images, it is possible to detect a scene whose content changes greatly in the moving image data. In addition, when the amount of moving image data is large, it takes time for data processing to obtain the difference value for all the frame images. Therefore, the frame image is extracted at an appropriate interval, and the difference value between the extracted frame images is calculated. You may ask for it. Then, it is determined whether or not the difference value of the data obtained in step 21 is greater than or equal to a predetermined value, and frame images having the difference value greater than or equal to the predetermined value are extracted in time series order and detected as a scene switching point (step 22). ). Next, the position data detected at step 22 and its difference value are stored as scene switching data (step 23). Here, by saving not only the position data but also the difference value, when the user sets the change information by the display method changing means 30, for example, for a point where the difference value is equal to or less than the set value, It is possible to control the number of scene switching points by setting a condition not to allow.
In order to perform the above processing, the scene switching detection unit 23 calculates a pixel data difference between frames in moving image data, a unit that compares the pixel data difference with a predetermined value, and a pixel data difference that is a predetermined value. Means for recognizing a larger frame as a scene change. The frame recognized as scene change is converted into data corresponding to the time axis of the moving image and stored as scene switching data in the scene switching data management means, so that a portion with little change in the content of the moving image is obtained. By managing the scenes as one scene and enlarging and displaying the same part in the same scene, the change of the enlargement position is reduced, and the moving picture reproduction that allows the user to easily grasp the contents of the moving picture becomes possible.

Next, the display information data creation process in step 13 in FIG. 2 will be described with reference to FIG.
When the display information data creation process is started, screen size data of the moving image display device 20 is first acquired (step 31). The screen size data acquired here is referred to when determining the enlargement range of the moving image. The smaller the screen size is, the smaller the enlargement range of the moving image is. Conversely, when the screen is enlarged, the enlargement range is set larger. If the screen size is sufficiently large, the entire moving image screen is set to be enlarged.
Next, the process proceeds to moving image data frequency component calculation processing (step 32). In step 32, the frequency component of the first frame image of each scene is calculated. The calculated frequency component of the frame image is used to determine the complexity of the frame image. Since an image with many high-frequency components has a complicated image content, it is necessary to select a narrower range as an enlarged range and greatly enlarge it. Conversely, an image with many low-frequency components is determined to have simpler image content, and as much information as possible is included in the screen with a wide range as an enlarged range. As the frequency component calculation processing in step 32, discrete cosine transform (DCT) or fast Fourier transform (FFT) can be used. Next, the process proceeds to an enlarged position detection process (step 33). In step 33, the difference between the frame images in each scene in the moving image data is taken, a change between frames is detected for each pixel constituting the frame image, and a portion having a large change in the frame image is detected in the scene. It is determined that the portion is a notable portion, and a portion having a large change is determined as an enlargement position in the image. For example, in the case of a sport relay scene such as golf, in general, when a golf player hits a ball, the player is located in the center, and a gallery or background is often displayed around the player. When viewing such a scene on a small screen, the user wants to enlarge and play the player at the center, and if the difference between the frame images of this scene is taken, the part of the player who swings is the largest As a result, it is possible to automatically extract and enlarge the portion that the user wants to pay attention to (see FIG. 6 for this image). Further, for example, in a scene where a plurality of persons appear, since the person speaking the dialogue changes greatly in gesture and expression, it is possible to automatically enlarge and reproduce the person. Here, since it is a large processing load to calculate the difference between frames for all the pixels of the frame image, the frame image may be divided into several blocks and the difference between frames for each block may be calculated. .
Next, the enlargement range of the moving image is determined from the screen size data acquired in step 31 and the frequency component data calculated in step 32 (step 34). In step 34, an enlarged moving image that takes into consideration the screen size of the moving image display device and the content of the moving image data can be created by using the two data of the screen size data and the frequency component data to determine the enlarged range. It is possible to create an enlarged moving image that allows the user to easily understand the content of the moving image.
Next, the process proceeds to display information data storage processing (step 35). In step 35, the enlarged position data of the moving image determined in step 33 and the enlarged range data determined in step 34 are used as display information data, and the display information data is stored for each scene of the moving image data to create display information data. End the process.
In order to perform the above processing, the display information data generating unit 25 analyzes the frequency component of the frame image constituting the moving image data, the complexity of the content of the moving image data, and the moving image from the analyzed frequency component. Means for recognizing a position to be noted in the screen, and means for determining a moving image size and an enlargement range to be displayed on the screen from the complexity of the content of the recognized moving image data and the position to be noticed. Therefore, it is possible to automatically enlarge and display the optimal location according to the content of the moving image, omit the procedure for the user to select the enlargement position, and a comfortable moving image that makes it easy to grasp the content of the moving image. Reproduction can be realized.

Next, the display moving image creation processing in step 14 in FIG. 2 will be described with reference to FIG.
When the display moving image creation process is started, the display moving image generating unit 27 acquires the moving image data managed by the moving image data managing unit 22 (step 41). Further, the scene switching data stored in the scene switching data management means 24 is acquired (step 42). Further, the display information data stored in the display information data management means 26 is acquired (step 43). Then, the process proceeds to display moving image generation and reproduction processing (step 44). In step 44, for each scene recorded in the scene switching data acquired in step 42, the display moving image is referred to by referring to the enlargement position and the enlargement range on the screen recorded in the display information data acquired in step 43. An image is generated in real time, and a moving image is displayed on the display means 28. When generating a moving image for display, it is preferable to display the entire image once for a few seconds each time the scene being reproduced changes, and then perform a partial enlarged display. In this way, by displaying the moving image data before the enlargement for a predetermined time before the enlargement display, the user can see the image of the original data before the enlargement display for each scene. It is possible to easily determine whether the image is displayed in an enlarged manner, and it is possible to display a moving image that makes it easier for the user to grasp the content. Further, the data storage in the moving image data management means 22 is not performed after the enlarged moving image, but is stored as received original data, and a display moving image is generated and reproduced every time reproduction is performed. It becomes easy to cope with a change in enlargement method at the time of reproduction, and flexible moving image reproduction can be handled.

Next, the display method changing process during moving image reproduction will be described with reference to FIG.
The moving image data 31 indicates original data, the moving image data 32 indicates area data to be enlarged for moving image reproduction, and the moving image data 33 indicates display data when the moving image is actually reproduced by the display means. Yes.
The display method change means 30 is an enlargement range change button 34 that is pressed when changing the size (enlargement range) of the region to be enlarged, and an enlargement position change button that is pressed when changing the position (enlargement position) of the region to be enlarged. 35, a cursor button 36 used when performing each process, a moving image selection button 37 pressed when reproducing another moving image, a scene moving button 38 pressed when moving a scene to be reproduced, and a moving image reproduction process A stop button 39 to be pressed when stopping the playback, a playback button 40 to be pressed to start the playback processing of the moving image, and a simultaneous playback button 41 to be pressed when simultaneously playing the original moving image and the enlarged moving image for playback. have.
The user can change the contents of the enlarged moving image to be displayed by pressing the enlargement range changing button 34 or the enlargement position changing button 35 during the reproduction of the moving image and then specifying the degree of change with the cursor button 36. Can do.

This display method changing process will be described with reference to FIG.
When the display content changing operation is performed by the user during the moving image reproduction, first, the enlargement position or enlargement range of the moving image data currently being reproduced is changed as specified by the user (step 51). When the moving image data is changed in step 51, it is determined whether or not the reproduction of the scene whose display method has been changed by the user is completed (step 52). If it is still playing, continue playing the scene. When the reproduction of the scene is completed, the display change information data changed by the user is stored in the display change information management means 29 (step 53). This display change information data is used when reproducing the same moving image data again. Then, after the first moving image playback process is completed, information indicating the end of the first playback is added to the additional information recording portion of the moving image data. By adding this information, the display moving image generation means 27 can recognize that the moving image to be reproduced is the second reproduction at the next moving image reproduction.

Processing at the time of the second and subsequent reproduction of moving image data will be described with reference to FIG.
The processing in FIG. 8 is the same processing as the display moving image creation processing shown in FIG.
When the second and subsequent moving image reproduction processes are started, moving image data to be reproduced is acquired (step 61), and scene switching data is acquired (step 62). Then, it is confirmed whether display change information data is stored in the display change information management means 29 (step 63). If stored, an enlarged moving image of the scene is created and reproduced by referring to the display change information data. If the display change information data is not stored, the process proceeds to step 64 and step 65, and a moving image is reproduced by performing the same processing as the processing shown in FIG. Thus, by saving the display change information data by the user and using it for the second and subsequent video playback, the processing load for the second and subsequent times can be reduced, and moving image playback reflecting user preferences can be performed, It is possible to realize moving image playback that is more user-friendly.

  Next, the simultaneous reproduction processing of the original moving image and the enlarged moving image, which is an additional function of the moving image reproduction processing, will be described with reference to FIGS. 9 and 10 are obtained by extracting the portion of the display area 3 in FIG. When the user presses the simultaneous playback button (button 41 in FIG. 6) during playback of a moving image, as shown in FIG. 9, the original moving image data 44 managed by the moving image data management means, and the displayed moving image The display moving image data 43 generated by the generating means is simultaneously reproduced on the same screen 42. With this function, the user can see the enlarged moving image at the same time while always viewing the entire screen, and can efficiently grasp the entire contents and the detailed contents. Also, as shown in FIG. 10, when a playback apparatus that plays back moving images has a plurality of screens 45 and 46, the original moving image data 47 is played back on one screen 45 and enlarged on the other screen 46. It is also possible to play back the moving image data 48. For example, in a mobile phone having two liquid crystal screens, an original moving image can be reproduced on the main liquid crystal screen, and enlarged moving image data can be reproduced on the sub liquid crystal screen. With this function, the user can play back a moving image using either the main liquid crystal screen or the sub liquid crystal screen depending on the current usage state of the mobile phone. For example, this function usually plays video on the main LCD screen, and when the mobile phone needs to be closed or when the battery level is low, an enlarged video is displayed on the small sub-LCD screen on the back of the mobile phone. It can be used for image reproduction. In particular, when there is a restriction on the size of a device such as a mobile phone, it is preferable to display the operation buttons on the screen by software.

  The moving image display apparatus of the present invention can be used as a liquid image display panel for displaying moving images and a dedicated apparatus for displaying moving images provided with buttons for performing various operations. It can be effectively used in communication terminal devices and general-purpose portable terminals with communication functions.

The block diagram which shows the structure of the moving image display apparatus in this invention The flowchart which shows the flow of each process until the moving image display in the moving image display apparatus of this invention. The flowchart which shows the flow of the scene switching data generation process at the time of the scene switching position detection in the moving image data in the Example of this invention. The flowchart which shows the flow of the display information data generation process performed by the display information data management means in the Example of this invention. The flowchart which shows the flow of the display moving image production | generation process performed by the display moving image production | generation means in the Example of this invention. The image figure of the moving image display apparatus in moving image reproduction in the Example of this invention The flowchart which shows the flow of the display information change process by the user operation at the time of the moving image reproduction in the Example of this invention. The flowchart which shows the flow of the moving image reproduction process after the 2nd in the Example of this invention. Screen image showing simultaneous reproduction processing of original moving image data and enlarged moving image data in an embodiment of the present invention The screen image which showed the simultaneous reproduction | regeneration processing on two screens of the original moving image data and expansion moving image data in the Example of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Moving image server 20 Moving image display apparatus 21 Communication means 22 Moving image data management means 23 Scene switching detection means 24 Scene switching data management means 26 Display information data management means 27 Display moving image generation means 28 Display means 29 Display change information management means

Claims (9)

  Communication means for receiving moving image data from a moving image server, moving image data management means for storing and managing the moving image data received from the moving image server, and detecting a scene change in the moving image data Scene switching detection means for generating scene switching data, display information data generating means for generating display information data by determining an enlarged range of a moving image to be displayed on the screen from the contents of the moving image for each scene, and the scene switching The display moving image generation means for generating display moving image data in which a part of the moving image data is enlarged with reference to the data and the display information data, and the display moving image data generated by the display moving image generation means are displayed. A moving image display device comprising a display means.   The scene switching detecting means includes means for calculating a pixel data difference between frames in the moving image data, means for comparing the pixel data difference with a predetermined value, and a frame in which the pixel data difference is greater than a predetermined value. And a means for recognizing the change of the scene, and converting the frame recognized as the change of the scene into data corresponding to the time axis of the moving image and storing the data in the scene change data management means as the scene change data The moving image display apparatus according to claim 1.   The display information data generation means should be noted in the means for analyzing the frequency components of the frame images constituting the moving image data, the complexity of the contents of the moving image data from the analyzed frequency components, and the video screen. The moving image according to claim 1, further comprising means for recognizing a position, and means for determining a moving image size and an enlargement range to be displayed on the screen from the complexity of the contents of the recognized moving image data and a position to be noted Image display device.   Display change information management means for storing the setting change data changed by the user and managing the setting change data in association with the moving image data. The display moving image generation means stores the setting change data stored in the display change information management means. The moving image display device according to claim 1, wherein the moving image enlargement range and the display image size are changed based on the moving image display device.   2. The moving image display apparatus according to claim 1, wherein the moving image data management means stores the moving image data received from the moving image server as received original data instead of display moving image data.   The display moving image creation means, when creating a display moving image for each scene described in the scene switching data, a portion specified by the display information data after copying the entire moving image of the scene to be displayed The moving image display device according to claim 1, wherein the moving image is enlarged and displayed.   The display means simultaneously displays on the same screen the moving image for display using the enlarged image created by the display moving image creation means and the original moving image data managed by the moving image data management means. The moving image display device according to claim 1, which has a function.   The display means includes a plurality of display screens, a display moving image using the enlarged image created by the display moving image creation means, and original moving image data managed by the moving image data management means, The moving image display apparatus according to claim 1, wherein the moving image display apparatus has a function of simultaneously reproducing images on different display screens.   A moving image display method for displaying a moving image composed of a plurality of frame images on a moving image display device, analyzing frequency components of each frame image constituting moving image data received from a moving image server, and analyzing the analyzed frequency components A moving image display method comprising: recognizing a position to be noted in a moving image from the position and determining an enlarged range to be displayed on the screen from the position of the recognized moving image data.