JP4494294B2 - Image processing device - Google Patents

Description

  The present invention relates to an image processing apparatus for performing image processing for reproducing and displaying a moving image based on compressed moving image data including a plurality of compressed image data data compressed by a predetermined compression method on an image display means.

  2. Description of the Related Art Conventionally, an image processing apparatus that stores compressed moving image data compressed by an encoding method such as an encoding technique called MPEG and reproduces moving image using moving image data obtained by expanding the compressed moving image data has been used ( For example, see Patent Document 1).

  In general, for compressed moving image data (IP compressed moving image data) consisting only of an I picture (key picture, intra-frame encoded picture) and P picture (forward prediction encoded picture), each picture is expanded when the moving image is reproduced. Since the order of display and the order of display match, for example, the decompressed data of the forward I picture referred to when decompressing the P picture is held in the picture buffer as it is.

  In addition, for compressed moving image data (IPB compressed moving image data) including B pictures (bidirectional predictive coded pictures), the order in which the pictures are expanded and the order in which the pictures are displayed may not match when performing moving image reproduction. For example, the decompressed data of the forward picture referred to when decompressing the B picture is held in the picture buffer as it is, and the decompressed data of the backward picture referenced when decompressing the B picture is stored in advance. Stored in the picture buffer.

JP 2005-72655 A

  As described above, in the conventional image processing apparatus, when reproducing a moving image based on IP compressed moving image data, it is necessary to perform decompression processing of the picture one frame period before displaying each picture. When reproducing a moving image based on data, it is necessary to perform decompression processing of the picture two frame periods before displaying each picture. For this reason, when IP compressed moving image data and IPB compressed moving image data coexist, the timing for starting the picture expansion processing differs depending on the type of moving image data, and management of the execution timing of the expansion processing in moving image reproduction control is complicated. There was a problem that there was.

  Further, in the conventional image processing apparatus, when playing back a moving picture based on IP compressed moving picture data, the last picture is displayed one frame period after the frame period in which the picture is decompressed last. However, when the moving image is reproduced based on the IPB compressed moving image data, the last picture is displayed after two frame periods of the frame period in which the picture expansion process was performed last. For this reason, when IP compressed moving image data and IPB compressed moving image data are mixed, the timing for ending the moving image reproduction control of a picture differs depending on the type of moving image data. There has been a problem that the management of the execution timing of the decompression process in the moving image reproduction control of the compressed moving image data that is reproduced after the reproduction is complicated.

  Therefore, the present invention provides an image processing apparatus that can easily manage the execution timing of decompression processing in moving image reproduction control in an image processing device that uses both IP compressed moving image data and IPB compressed moving image data for presentation. The purpose is to provide.

  An image processing apparatus according to the present invention reproduces and displays a moving image based on compressed moving image data (for example, IP movie data and IPB movie data) including a plurality of compressed image data compressed by a predetermined compression method on an image display means. An image processing apparatus that performs image processing for the first compression moving image data (for example, IPB movie data) including bidirectional compressed image data (for example, B picture) compressed by bidirectional predictive encoding, and bidirectional Compressed moving image data storage means (for example, CGROM 105) for storing a plurality of compressed moving image data including second compressed moving image data (for example, IP movie data) that does not include compressed image data, and compression for each predetermined frame period Control information for setting control information (rendering instructions) for reproducing and displaying moving images based on video data Based on the setting means (for example, the part that executes steps S12 to S21 in the CPU 101) and the control information set by the control information setting means, the compressed moving image data is sequentially expanded to reproduce the moving image based on the compressed moving image data. Moving image reproduction means (for example, a portion of GCL 104 that repeatedly executes steps S31 to S41, S51, and S52), the moving image reproduction means includes an expansion instruction included in the control information set by the control information setting means In accordance with the decompression processing means for decompressing the compressed image data included in the compressed moving image data in a predetermined decompression order (for example, the part executing step S37 in the GCL 104), and control information setting In accordance with display instructions included in the control information set by the means, decompression processing Playback that performs playback display processing for playing back and displaying a moving image based on compressed video data by sequentially displaying an image based on the image data expanded by the stage on the image display means for each frame period in accordance with a predetermined display order Display processing means (for example, the part that executes step S52 in the GCL 104), and the control information setting means uses the first control information that is set when starting the reproduction display of the moving image for the reproduction display of the moving image. The compressed moving image data is designated (for example, step S16), the decompression instruction is started from the frame period in which the first control information designating the compressed moving image data is set (for example, step S19), and the control information for which the decompression instruction is started is set. The display instruction is started from the frame period next to the frame period (for example, steps S17 and S18). When the compressed moving image data designated by the first control information is the first compressed moving image data (for example, IPB movie data), the frame period (for example, the movie data shown in FIG. (F1 frame period) at a plurality of times (for example, twice), for example (step S19), and after the moving image is reproduced based on the first compressed moving image data by the moving image reproducing means, the compression is continued. When a moving image based on moving image data is reproduced (for example, see FIG. 15), a final display scheduled image (for example, a dummy picture) whose display order in the moving image based on the first compressed moving image data used for the previous reproduction is the last. ) To be displayed (for example, the frame period before the frame period (for example, F13 of IPB movie data in FIG. 15A) (for example, FIG. 1). In (A) IPB movie data F12 and IP movie data F1), the display order in the moving image based on the compressed moving image data (for example, IPB movie data, IP movie data) used for later playback is first. Control information including an instruction to decompress the earliest display image (eg, picture I1 of the IP movie data in FIG. 15A) is set, and a frame period (eg, in FIG. 15A) in which the final display scheduled image is to be displayed. In the IPB movie data F13 and the IP movie data F2), the earliest moving image based on the compressed moving image data used for the subsequent reproduction is set without setting the control information including the display instruction of the final display scheduled image. Display instruction of display image (for example, display of picture I1 of IP movie data in FIG. 15A) (For example, step S18), and the moving image reproducing means is based on the control information set by the control information setting means, and the moving image is based on the first compressed moving image data used for the previous reproduction. An image (for example, picture B5 of IPB movie data in FIG. 15A) whose display order in the image is one before the final display scheduled image is displayed as the final image of the moving image based on the first compressed moving image data (for example, Step S52), the frame period in which the final display scheduled image that is the frame period next to the frame period in which the final image is displayed (for example, IPB movie data F12 and IP movie data F1 in FIG. 15A) is to be displayed. The first display image is displayed in (for example, F2 of IP movie data in FIG. 15A) (for example, step S52) When the decompression processing unit reproduces the moving image based on the compressed moving image data after the moving image reproducing unit reproduces the moving image based on the first compressed moving image data (for example, FIG. 15A). Reference), image data indicating a final scheduled display image (for example, picture P5 in FIG. 15A) in the moving image based on the first compressed moving image data used for the previous reproduction is used as the moving image based on the first compressed moving image data. It is characterized in that it is used for decompression processing of compressed image data indicating other images in the image (for example, picture B4 and picture B5 in FIG. 15A).

  The decompression processing means performs a frame buffer storage process in which image data obtained by decompressing the compressed image data in the decompression process is stored in any of a plurality of frame buffers (for example, step S37), and the control set by the control information setting means The number of frame buffers for determining the number of frame buffers used in the decompression process according to whether the compressed moving image data used for reproducing and displaying the moving image designated by the information is the first compressed moving image data or the second compressed moving image data A determination unit (for example, a part for executing step S34 in the GCL 104) is provided, and the frame buffer number determination unit determines that the number of the first compressed moving image data is larger than that of the second compressed moving image data. (For example, in the case of IP movie data in step S34, the number of IP movie data is determined as three. Is determined to four) it is desirable.

  The decompression processing means performs a frame buffer storage process in which image data obtained by decompressing the compressed image data in the decompression process is stored in any of a plurality of frame buffers (for example, step S37), and the control set by the control information setting means Frame buffer setting means (for example, GCL104) that determines an image size in the moving image based on the compressed moving image data used for reproducing and displaying the moving image specified by the information, and sets a storage area having a size corresponding to the determination result as a frame buffer. The portion for executing step S33 in FIG.

  After the control information setting means gives the decompression instruction with the control information set in the predetermined frame period, the frame period ends before the decompression processing executed by the decompression processing means in response to the decompression instruction is finished. In this case, a display instruction for displaying an image based on the same image data as the predetermined frame period in the control information set in the next frame period may be issued (for example, step S18).

  The final display scheduled image (for example, the dummy picture P5 in FIG. 15A. Further, for example, the dummy picture P6 in FIG. 15B) is an image (in which the display order is one before the final display scheduled image). For example, the picture B5 in FIG. 15A and the dummy picture P5 in FIG.

  The compressed moving image data is a portion of the moving image based on the compressed moving image data where the moving speed of the display object is fast compared to a portion where the moving speed of the display object is low, and is compressed by intra-frame coding (for example, It may be configured to include a portion having a data structure using a large amount of (I picture data).

  The decompression processing means performs a frame buffer storage process for storing the image data obtained by decompressing the compressed image data in any of a plurality of frame buffers in the decompression process (for example, step S37), and a sprite image for displaying a sprite image A sprite image data storage unit (eg, CGROM 105) for storing data, and a reproduction display of a moving image based on the compressed moving image data by a reproduction display processing unit according to an image composition instruction included in the control information set by the control information setting unit When the processing is executed, the sprite image data is read from the sprite image data storage means to generate a sprite image, and a composite image generation means (for example, a sprite image is sequentially synthesized on each image in the moving image based on the compressed moving image data (for example, Step S39 in the GCL104, The control information setting means sets control information including an image compositing instruction for each frame period, and sets control information including a decompression instruction for every two frame periods (for example, FIG. 14 may be configured to perform a drawing instruction according to the display control data shown in FIG.

  According to the first aspect of the invention, the control information setting means designates the compressed moving image data used for the reproduction display of the moving image by the first control information set when starting the reproduction display of the moving image, The decompression instruction is started from the frame period in which the first control information specifying the compressed moving image data is set, and the display instruction is started from the frame period subsequent to the frame period in which the control information in which the decompression instruction is started is set. When the compressed moving image data designated in step 1 is the first compressed moving image data, a decompression instruction is issued a plurality of times during the frame period in which the decompression instruction is started, and a moving image based on the first compressed moving image data is generated by the moving image reproducing means. When a moving image based on compressed moving image data is reproduced after the image is reproduced, the moving image based on the first compressed moving image data used for the previous reproduction is displayed. In the frame period before the frame period in which the final display scheduled image in which the display order is to be displayed is to be displayed, the display order of the earliest display image in which the display order in the moving image based on the compressed video data used for later playback is first The control information including the decompression instruction is set and used for later reproduction without setting the control information including the display instruction of the final display scheduled image in the frame period in which the final display scheduled image is to be displayed. Control information including an instruction to display the earliest display image in the moving image based on the compressed moving image data is set, and the moving image reproduction unit is used for the previous reproduction based on the control information set by the control information setting unit. An image whose display order in the moving image based on the first compressed moving image data is one before the final display scheduled image is the final moving image based on the first compressed moving image data. The first display image is displayed in the frame period in which the final display scheduled image that is the frame period next to the frame period in which the final image is displayed is displayed, and the decompression processing unit includes the moving image reproduction unit. When the moving image based on the compressed moving image data is reproduced after the moving image based on the first compressed moving image data is reproduced, the final display in the moving image based on the first compressed moving image data used for the previous reproduction is performed. Since the image data indicating the scheduled image is used for the expansion process of the compressed image data indicating the other image in the moving image based on the first compressed moving image data, the execution timing of the expansion process in the moving image reproduction control is determined. Management can be facilitated. Also, all the image data in the first compressed moving image data can be used as necessary image data used for moving image reproduction control, so that the data capacity of the first compressed moving image data is not wasted. In addition, it is possible to prevent the load from increasing due to unnecessary processing by causing the decompression processing means to execute unnecessary decompression processing.

  In the invention according to claim 2, the decompression processing means performs frame buffer storage processing for storing the image data obtained by decompressing the compressed image data in any of the plurality of frame buffers in the decompression processing, and is set by the control information setting means The number of frame buffers used in the decompression process is determined according to whether the compressed moving image data used for reproducing and displaying the moving image specified by the control information is the first compressed moving image data or the second compressed moving image data. Since the frame buffer number determining means is configured to determine a larger number when it is the first compressed moving image data than when it was the second compressed moving image data, The capacity of the storage area used for moving image playback control is appropriately determined according to whether or not the compressed moving image data used for moving image playback display includes bidirectional compressed image data. It can be.

  In the invention according to claim 3, the decompression processing means performs a frame buffer storage process for storing the image data obtained by decompressing the compressed image data in any of the plurality of frame buffers in the decompression process, and is set by the control information setting means Frame buffer setting means for determining the image size of the moving image based on the compressed moving image data used for reproducing and displaying the moving image specified by the control information, and setting a storage area of the size according to the determination result as a frame buffer Therefore, the capacity of the storage area used for moving image reproduction control can be appropriately determined according to the image size of the moving image based on the compressed moving image data used for moving image reproduction display.

  According to the fourth aspect of the present invention, after the control information setting means gives an extension instruction with the control information set in a predetermined frame period, the extension processing means executes in accordance with the extension instruction. When the frame period ends before ending, the display information for displaying an image based on the same image data as the predetermined frame period is provided in the control information set for the next frame period. Therefore, flickering of the screen can be prevented.

  According to the fifth aspect of the present invention, since the final display scheduled image is the same image as the image whose display order is one before the final display planned image, even if the final display planned image is displayed in error. As a result, it is possible to prevent an uncomfortable appearance.

  In the invention according to claim 6, the compressed moving image data is compressed by intra-frame coding in a moving image based on the compressed moving image data in a portion where the moving speed of the display object is fast compared to a portion where the moving speed of the display object is slow. Therefore, the data structure of the compressed moving image data can be reduced as much as possible while maintaining the image quality.

  According to the seventh aspect of the present invention, the control information setting means is configured to set control information including an image composition instruction every frame period and set control information including a decompression instruction every two frame periods. Therefore, it is possible to prevent the control burden related to image composition from becoming heavy while realizing precise display.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a circuit configuration example of an image processing apparatus 100 according to an embodiment of the present invention. FIG. 1 also shows an image display device 120 including an image display unit that displays an image such as a moving image. Note that the image display device 120 may be built in the image processing device 100.

  In addition to the CPU 101, the image processing apparatus 100 includes a ROM 102 that stores an image processing control program, an effect pattern by moving images, and the like, and a RAM 103 that is used as a work memory. Note that the ROM 102 and the RAM 103 may be built in the CPU 101.

  When executing display control of the image display device 120, the CPU 101 gives a drawing instruction (control information for reproducing a moving image) according to a program for image processing control to a GCL (graphical controller LSI) 104. The GCL 104 reads necessary data from the CGROM 105 or the like according to the drawing instruction. The CGROM 105 stores various data used for displaying moving images such as movie data to be described later and character image data superimposed on the moving images. The CGROM 105 is sometimes called a character ROM because it is used to store character image data and the like. The character stored in the CGROM 105 is, for example, a person, an animal, or an image made up of characters, figures, symbols, etc. displayed on the image display device 120. Note that the character includes a moving image (video) and a still image obtained by actual shooting.

  The GCL 104 generates image data for displaying an image on the image display device 120 in accordance with a drawing instruction from the CPU 101, and a video signal (R (red (red)) as an image display signal for displaying the image indicated by the generated image data. ), G (green), B (blue) signal and synchronization signal) are output to the image display device 120.

  For example, the image display device 120 performs screen display by a dot matrix method using a large number of pixels. In this embodiment, the R, G, and B signals are each represented by 8 bits. Therefore, according to the image display signal from the GCL 104, the image display device 120 can perform multi-color display of about 16.7 million colors with each of R, G, and B having 256 gradations. Note that the number of bits of the R, G, and B signals may be other than 8 bits, and the number of bits of the R, G, and B signals may be different from each other.

  In addition to the CGROM 105, the image processing apparatus 100 includes various storage media such as an SDRAM (synchronous DRAM) 106. Note that a frame buffer area is secured in the SDRAM 106. The SDRAM 106 stores data relating to a display image such as character source data and palette data used for specifying or changing display colors. The source data is image data, and is expressed as source data in the sense of original image data. Further, an area used as a VRAM (video RAM) is also secured in the SDRAM 106.

  The GCL 104 includes various storage media such as a palette buffer 107 used for temporarily storing predetermined palette data and a CG data buffer 108 used for temporarily storing predetermined CG data. , A rendering control unit 109, a display signal control unit 110 for outputting a video signal to the image display device 120, and a moving image decompression unit 111 that decompresses compressed moving image data.

  The display signal control unit 110 outputs the video signal to a DAC (DA conversion circuit) 112. The DAC 112 outputs the video signal from the display signal control unit 110 as an analog signal to an LCD (liquid crystal display device) as the image display device 120.

  The drawing control unit 109 includes, for example, an attribute analysis unit, a VRAM address generation unit, a clipping unit, and a translucent luminance modulation unit. The attribute analysis unit analyzes parameters used when drawing the character. Information for designating an image drawing order, the number of colors, an enlargement / reduction ratio, a palette number, coordinates, and the like are set in the parameters.

  As shown in FIG. 1, a CG bus and a VRAM bus are provided in the GCL 104. A CG bus interface (CG bus I / F) 113 is installed between the CGROM 105 and the CG bus. A CPU I / F 114 is also connected to the CG bus, and the CPU 101 can access each unit connected to the CG bus via the CPU I / F 114.

  Specifically, the CPU 101 accesses the drawing control register 115 connected to the CG bus. The drawing control register 115 stores data such as a drawing instruction from the CPU 101 to the drawing control unit 109. Therefore, the CPU 101 writes a drawing instruction for the GCL 104 in the drawing control register 115, and the GCL 104 receives the drawing instruction from the CPU 101 via the drawing control register 115. A VRAM I / F 116 is installed between the SDRAM 106 and the VRAM bus. Note that the moving image decompression unit 111 can access the VRAM provided in the SDRAM 106 via the VRAM bus, and can access the drawing control register 115 via the CG bus.

  In response to a drawing instruction from the CPU 101, the GCL 104 reads movie data and character source data from the CGROM 105, and develops (draws) them in the VRAM. Further, the GCL 104 stores the image data expanded in the VRAM in the frame buffer. The display signal control unit 110 outputs the image data stored in the frame buffer to the image display device 120 via the DAC 112 as a video signal. Note that “develop in VRAM” means writing to VRAM, that is, storing in VRAM.

  FIG. 2 is an explanatory diagram showing an example of movie data (moving image data for reproducing a movie image) stored in the CGROM 105. As shown in FIG. 2, in this example, a plurality of types of movie data are stored in the CGROM 105 in advance.

  The movie data stored in the CGROM 105 includes a plurality of types of IPB movie data shown in FIG. 2A and a plurality of types of IP movie data shown in FIG. That is, a plurality of types of IPB movie data and a plurality of types of IP movie data are created in advance and stored in the CGROM 105.

  “IPB movie data” is compressed video data (including a I picture (key picture, intra-frame encoded picture), a P picture (forward prediction encoded picture), and a B picture (bidirectional predictive encoded picture)). IPB compressed moving image data). “IP movie data” is compressed moving image data including an I picture and a P picture. That is, the IP movie data is compressed moving image data (IP compressed moving image data) that does not include a B picture.

  An “I picture” is a picture called an intra-frame coded picture, and means a picture that is expanded by itself without using images before and after sequentially displayed images. A “P picture” is a picture called a forward predictive coded picture, and is one of images that are displayed in front of itself among images that are sequentially displayed (for example, a display of an I picture or a P picture). This means a picture that is decompressed using the closest picture in order. A “B picture” is a picture called a bi-predictive coding picture, and is one of the images displayed before the sequentially displayed image (for example, the display order of the previous one of the I picture or P picture is the previous one). It means a picture that is decompressed using the closest picture) and any of the images displayed later (for example, the closest picture in the display order of the I picture or P picture later).

  Note that “I picture”, “P picture”, and “B picture” mean one or both of compressed image data in a compressed state and image data in a decompressed state unless otherwise specified. Shall. The term “picture” may mean image data, an image based on image data, or both.

  Each movie data shown in FIG. 2 is stored in the CGROM 105 in a compressed state by an encoding technique called MPEG2, for example. In each movie data, the compressed image data of each image constituting the moving image is sequentially expanded under the control of the GCL 104 based on the drawing instruction from the CPU 101, and the image data of each image constituting the moving image is By being sequentially output to the image display device 120 as a video signal, it is used for reproducing and displaying a series of moving images on the image display device 120.

  Movie data A1 in the IPB movie data shown in FIG. 2A is movie data for movie 1 and is movie data for reproducing a moving image of movie 1. Similarly, movie data A2 to A7 are movie data for moving images 2 to 7, respectively, and are movie data for reproducing moving images of moving images 2 to 7. The movie data A8 is movie data for reproducing moving images of the first half of the moving image 8 and the moving image 9. The movie data A9 is movie data for reproducing the moving image of the latter half of the moving image 8, and the movie data A10 is movie data for reproducing the moving image of the latter half of the moving image 9. That is, the moving image 8 is reproduced by continuously displaying the movie data A8 and the movie data A9, and the moving image 9 is reproduced by displaying the movie data A8 and the movie data A10 continuously. .

  The moving images 1 to 9 are moving images having different display modes. However, the moving image 8 and the moving image 9 are moving images having the same display mode in the first half and different display modes in the second half. In addition, it is assumed that each of the moving images 1 to 9 completes the content of notification by the moving image by reproducing and displaying a series of moving images. Specifically, each of the videos 1 to 9 is used as a production video for performing a predetermined production using a series of moving images, a promotion video or an advertising video for performing a promotion or advertisement using a series of moving images, and the like. It is a video.

  2B. Movie data B1 in the IP movie data shown in FIG. 2B is movie data for background 1, and is movie data for reproducing a moving image of background 1. Similarly, movie data B2 to B5 are movie data for background 2 to background 5, respectively, and are movie data for reproducing moving images of background 2 to background 5.

  Backgrounds 1 to 5 are different display modes, and are moving images used as background images. Note that, as with the moving images 8 and 9 described above, the movie data for background includes movie data in which the first half is the same display mode and the second half is a moving image having a different display mode. Good.

  In addition, it is assumed that the backgrounds 1 to 5 are not completed with the notification content of the moving image by the reproduction display of the series of moving images. That is, each of the backgrounds 1 to 5 is, for example, a moving image used as a background moving image for displaying a background with a series of moving images by simply displaying a landscape or a landscape for a certain period of time. The background may be continuously displayed by repeatedly reproducing and displaying any one of the backgrounds 1 to 5, or two or more of the backgrounds 1 to 5 may be continuously displayed. The background may be displayed continuously by playing back and displaying. In addition, a moving image other than the background moving image may be used as long as the notification content by the moving image is not completed by a series of moving image reproduction display. In this way, movie data that is repeatedly and continuously reproduced and displayed is generated by IP movie data and stored in the CGROM 105, and only IP movie data is used as movie data that is repeatedly and continuously reproduced and displayed. Therefore, the control burden of moving image playback control can be reduced as much as possible.

  In this example, the IP movie data is used for the background moving image, but some or all of the moving images based on the plurality of IP movie data are used for performing a predetermined effect with a series of moving images. The notification content of the moving image may be completed by reproducing and displaying a series of moving images such as a moving image or a moving image for advertising or advertising using a series of moving images.

  Each movie data shown in FIG. 2A may be reproduced and displayed independently without combining sprite images, or may be reproduced and displayed after combining sprite images. Also, the background movie data shown in FIG. 2B is reproduced and displayed by combining the movie data and sprite image shown in FIG.

  In this example, the GCL 104 selects predetermined movie data to be used for movie image presentation from among a plurality of types of movie data shown in FIG. 2 based on a drawing instruction from the CPU 101. Then, the GCL 104 performs processing for reproducing and displaying a moving image based on the selected movie data based on a drawing instruction from the CPU 101.

  Each movie data described above has, for example, a data structure in which a large number of I pictures are used in a portion where the moving speed of the display object is high compared to a portion where the moving speed of the display object is slow in a moving image based on each movie data. ing. Because of such a data structure, the data amount of the compressed moving image data can be reduced as much as possible while maintaining the image quality.

Next, display control data stored in the ROM 102 will be described.
The display control data is used to determine the content of a drawing instruction for causing the GCL 104 to execute drawing control and output an image display signal. The GCL 104 executes drawing control and outputs an image display signal in order to display a moving image on the image display device 120 in accordance with the drawing instruction. It is assumed that the display control data is generated in advance and stored in the ROM 102 for each reproduced moving image, that is, in this example, for each of the moving images 1 to 9 (see FIG. 2).

  FIG. 3 is an explanatory diagram showing an example of the contents of the display control data. FIG. 3 illustrates a part of the content of the display control data (moving picture 1 display control data) for the moving picture 1.

  The display control data includes information for reproducing a movie image on the image display device 120. The display control data includes information about which picture of which movie data (one frame image constituting the movie image based on the movie data) is to be decompressed / expanded, and information about which timing to display each picture. , Information on how to synthesize which picture and which sprite image are displayed at which timing. Data in which such information is divided and set for each frame period is process data. As shown in FIG. 3, the display control data has a structure in which a plurality of process data are arranged in the order of use.

  Specifically, the display control data stored in the ROM 102 includes information indicating movie data to be used, information indicating that a picture is to be decompressed, information indicating that a picture is to be displayed, and a movie to be used Information indicating the image size of the moving image based on the data, information indicating the development mode, information indicating whether or not to synthesize the sprite image on the frame of the movie data, and information on the sprite image or movie image displayed on the image display device 120 The information includes information for specifying the size and position of the display area, the enlargement / reduction ratio of the sprite image or movie image, the transmittance of the sprite image or movie image, and the like.

  The “information specifying the size of the display area” means information indicating the size of the area for displaying the sprite image and the movie image on the display screen of the image display device 120. Note that the size of the area for displaying the sprite image and the movie image may change (enlarge, reduce, and deform) during the reproduction of a series of movie images.

  As shown in FIG. 3, in the process data (process data 1) selected first in the moving image 1 display control data, as the display control content, the movie data to be used is the movie data A1, and the movie data to be used. A1 is IPB movie data, which includes using expansion mode 4, instructing to decompress one picture, instructing to decompress another picture, and instructing to display one picture. ing. The display instruction in the process data 1 is to display using the image data if there is image data that has been expanded by the expansion instruction based on the previously used display control data but is not used for display. Used to indicate. Therefore, the display instruction in the process data 1 is valid only when the drawing instruction for reproducing the moving image based on the movie data to be reproduced later when the moving image based on the movie data is continuously reproduced. When the image is not continuously reproduced or when a drawing instruction for reproducing a moving image based on the movie data reproduced first when the image is continuously reproduced is invalid.

  Further, the process data 2 includes expanding one picture and displaying one picture as display control contents. In the process data 3, as a display control content, display of sprite images A, B, and C is started, display modes such as display positions and display sizes of the sprite images A, B, and C, and one picture are expanded. That includes displaying one picture. Similarly, the display control content for reproducing the moving image 1 is set for each of the process data 4 and later. In this example, the CPU 101 issues a drawing instruction based on the moving image 1 display control data, and the GCL 106 performs drawing control in response to the drawing instruction to output an image display signal, whereby the moving image 1 is displayed on the image display device 120. Is displayed.

  FIG. 4 is an explanatory diagram showing an example of a frame buffer used in this example. In FIG. 4A, three frame buffers 0 to 2 used in the expansion mode 3 are shown. In FIG. 4B, four frame buffers 0 to 3 used in the expansion mode 4 are shown. Each frame buffer is provided in a VRAM area in the SDRAM 106. In this example, the expansion mode 4 is selected when the movie data used for moving image playback is an IPB movie, and the expansion mode 3 is selected when the movie data used for playback of a moving image is an IP movie. .

Next, the operation of the image processing apparatus 100 of this example will be described.
FIG. 5 is a flowchart illustrating an example of the V blank interrupt process executed by the CPU 101. In this example, the V blank interrupt process is executed in response to the V blank interrupt from the GCL 104. The V blank interrupt is an interrupt generated by the GCL 104 in the same cycle as the cycle of the vertical synchronization signal supplied to the image display device 120. For example, when the screen change frequency (frame frequency) of the image display device 120 is 30 Hz, the generation period of the V blank interrupt is 33.3 ms, and when the frame frequency is 60 Hz, the occurrence of the V blank interrupt is generated. The period is 16.7 ms. The occurrence interval of the V blank interrupt is a frame period. For example, when the generation period of the V blank interrupt is 33.3 ms, the frame period is also 33.3 ms.

  In the V blank interruption process, first, the CPU 101 determines whether or not to start reproduction (step S12). If reproduction of a new moving image is not started, it is determined whether or not a moving image is currently being reproduced (step S13). Whether or not a moving image is being reproduced is determined, for example, based on the state of a moving image reproducing flag stored in the RAM 103.

  In step S12, it is determined to start moving image reproduction when a predetermined moving image reproduction start condition is satisfied. The moving image reproduction start condition is, for example, when a reproduction instruction operation (for example, a reproduction instruction operation by an input device provided in the apparatus 100) from the user of the image processing apparatus 100 is determined, It may be established when it arrives, when a predetermined video playback timing arrives, or when the previous video playback ends.

  In this example, as shown in steps S12 and S13, it is determined whether or not to newly start moving image reproduction regardless of whether or not the moving image is being reproduced. That is, even when a moving image is being played back, a new moving image can be started to be played back. In other words, even if the drawing instruction based on the display control data is not completed, the display control data is switched (including the case of switching to the same display control data), and the drawing instruction based on the switched display control data can be started. It has a possible configuration.

  If it is determined to start moving image playback, the CPU 101 sets the moving image playback flag, and then selects the type of moving image to be played in accordance with a predetermined moving image selection condition (step S14). In this example, one moving image to be reproduced is selected from the moving images 1 to 9 shown in FIG. The moving image selection condition may be, for example, following the instruction content of the reproduction instruction operation from the user of the image processing apparatus 100, following a predetermined reproduction order, or randomly determined by random lottery.

  When a moving image to be reproduced is selected, the CPU 101 reads display control data corresponding to the selected moving image from the ROM 102 to the RAM 103 (step S15). Next, the CPU 101 refers to the process data 1 in the read display control data, designates a moving image to be reproduced, etc., and confirms the presence / absence of the decompression instruction, the number of times, and the presence / absence of the display instruction (step S16). Specifically, the CPU 101 indicates data indicating a moving image (for example, moving image A1) to be reproduced as part of a drawing instruction (control information for reproducing a moving image), and whether the moving image is IPB movie data or IP movie data. Data indicating the video size, data indicating the video size of the video, and data indicating the expansion mode of the video are written to the drawing control register 115 and whether or not an expansion instruction is given. Confirm the number of decompression instructions and whether to give a display instruction. Then, the process proceeds to step S18.

  When it is determined in step S13 that the moving image is being reproduced, the CPU 101 refers to the process data next to the currently used process data, and changes the reproduction mode of the moving image being reproduced (for example, changes in the image size). ), And the presence / absence of the decompression instruction, the number of times, the presence / absence of the display instruction, etc. are confirmed (step S17). If the referenced process data includes data indicating the end of moving image reproduction, the moving image reproduction flag is reset. Then, the process proceeds to step S18.

  Next, if the referred process data (the process data referred to in step S16 or step S17) includes a display instruction, the CPU 101 issues a display instruction according to the set content of the process data (step S18). ). Specifically, the CPU 101 writes a display instruction in the drawing control register 115 as part of a drawing instruction (control information for reproducing a moving image). In step S18, if the decompression completion signal indicating that the decompression process based on the decompression instruction performed in the previous frame period has been completed is not received from the GCL 104, the previous frame period is based on the setting contents of the process data. The display instruction with the same content as the decompression instruction performed in step 1 is performed. That is, after the decompression instruction is performed in a predetermined frame period and before the decompression process executed by the GCL 104 is terminated according to the decompression instruction, the CPU 101 determines that the next frame period The same display instruction as that in the previous frame period is issued, and an image based on the same image data is displayed on the image display device 120.

  Also, if the referred process data (the process data referred to in step S16 or step S17) includes an instruction for decompression, the CPU 101 issues an decompression instruction once or twice according to the setting content of the process data. (Step S19). Specifically, the CPU 101 writes one or two decompression instructions in the drawing control register 115 as part of a drawing instruction (control information for reproducing a moving image).

  Next, the CPU 101 refers to the process data used this time (process data referenced in step S16 or step S17), and determines whether to start or update the display of the sprite image (step S20).

  When starting or updating the display of the sprite image, the CPU 101 refers to the process data used this time, and instructs the sprite image such as the type, display position, and display size of the sprite image to be displayed (sprite image display instruction). (Step S21). Specifically, the CPU 101 writes a sprite image display instruction in the drawing control register 115 as part of a drawing instruction (control information for reproducing a moving image).

  As described above, the CPU 101 issues a drawing instruction (control information for reproducing a moving image) including, for example, a display instruction and an expansion instruction to the GCL 104.

  FIG. 6 is a flowchart illustrating an example of the expansion process executed by the GCL 104. In the expansion process, the GCL 104 determines whether or not the CPU 101 has specified a moving image to be reproduced and displayed (step S31). If the moving image to be reproduced and displayed is designated, the GCL 104 sets the movie data indicating the designated moving image as movie data used for moving image reproduction (step S32). If the image size of the moving image to be reproduced and displayed is designated, the GCL 104 sets the frame buffer size according to the image size (step S33). If the expansion mode is specified for the moving image to be reproduced and displayed, the GCL 104 sets the expansion mode (step S34). If it is specified whether the movie data to be used for moving image playback is IPB movie data or IP movie data, the GCL 104 sets IPB movie data or IP movie data according to the specified content (step). S35). Note that the GCL 104 may determine whether the moving image to be reproduced and displayed is an image size, a development mode, IPB movie data, or IP movie data.

  The movie data includes information indicating the expansion order of each picture, information indicating the display order of each picture, and the like. The movie data includes information indicating the image size of a moving image reproduced and displayed with the movie data, information indicating whether the movie data is IPB movie data or IP movie data, and the like. Also good.

  Next, when there is a decompression instruction from the CPU 101 (step S36), the GCL 104 extracts and decompresses frame data (picture data) in the current decompression order in the movie data used for moving image reproduction, and provides it to the SDRAM. The data is expanded in a predetermined frame buffer in the stored VRAM (step S37). When the decompression process in step S37 is completed, the GCL 104 transmits an decompression process completion signal indicating that to the CPU 101. The CPU 101 can determine that the instructed decompression process has been completed by receiving the decompression process completion signal.

  When there is a sprite image display instruction from the CPU 101 (step S38), the GCL 104 extracts sprite image data for displaying the sprite image instructed from the CPU 101 from the ROM 105 according to the sprite image display instruction (step S39). ) If necessary, the sprite image data read out is subjected to processing for enlargement / reduction, rotation, and transmission of the sprite image, rearranged, and developed in the work memory (step S40).

  Further, the GCL 104 clips the arranged sprite image data within a range designated by the sprite image display instruction from the CPU 101 and develops it in the VRAM (step S41). At this time, if the frame data to be displayed next in the movie data is expanded in the frame buffer, the sprite image data is expanded on the frame data, and the movie image and the sprite image are synthesized.

  The GCL 104 sequentially generates the images of the respective screens displayed on the image display device 120 by executing the above-described processing in accordance with the drawing instruction from the CPU 101.

  FIG. 7 is a flowchart illustrating an example of image display processing executed by the GCL 104 every 33 ms in response to a display instruction from the CPU 101. When the display instruction from the CPU 101 is made every 33 ms, the image display processing is executed every 33 ms.

  In the image display process, the GCL 104 reads the image data in the current display order from the image data (for example, RGB luminance data) developed on the VRAM when a display instruction is received from the CPU 101 (step S51). The display signal control unit 110 is supplied (step S52). When the display process in step S52 is completed, the GCL 104 transmits a display process completion signal indicating that to the CPU 101. The CPU 101 can determine that the instructed screen display is completed by receiving the display processing completion signal.

  Note that when there is a display instruction from the CPU 101 in step S51, the GCL 104 determines that there is no image data in the current display order (for example, display order 1) in the image data developed on the VRAM. If image data that is not used for display is expanded, the image data is read out and supplied to the display signal control unit 110 in step S52. That is, when there is a display instruction based on the first process data in the display control data, if image data that is not used for display is expanded on the VRAM, the image data is read and displayed to the display signal control unit 110. Supply. When there is a display instruction based on the first process data in the display control data, if image data that is not used for display is not expanded on the VRAM, the image data is supplied to the display signal control unit 110. Not performed. When the image data is not supplied to the display signal control unit 110 in step S52, the GCL 104 transmits a display target image no signal indicating that to the CPU 101. The CPU 101 can determine that there is no display target image by receiving the no display target image signal.

  The display signal control unit 110 generates a control signal (video signal, image display signal) such as an LCD drive signal according to the supplied image data, and supplies the control signal to the image display device 120. Then, a frame image (picture) or background image in the movie image is displayed on the display screen of the image display device 120.

  By repeatedly executing each of the above processes (the processes shown in FIGS. 5 to 7), a playback image of the movie image is displayed on the image display device 120.

  Next, the development timing and display timing of each image (picture) constituting the movie image when the movie image based on the IP movie data is reproduced will be described.

  FIG. 8 is an explanatory diagram showing an example of the expansion timing and display timing of each picture when a movie image based on IP movie data is reproduced and displayed. FIG. 9 is an explanatory diagram showing an example of the storage state of the frame buffer when the IP movie data is processed at the timing shown in FIG. Here, for the sake of simplicity, description will be made using IP movie data in which a moving image is reproduced and displayed by processing for 13 frame periods as shown in FIG.

  When a movie image based on the IP movie data is played back and displayed, the pictures are displayed in the decompressed order without the order of expansion and display of the pictures being different. Therefore, the decompression order and the display order in each picture match.

  When the CPU 101 reproduces and displays a movie image based on IP movie data, the CPU 101 designates the type of movie data used for reproduction display to the GCL 104 based on the display control data in the first frame period (F1). After performing (see step S16), an extension instruction is given (see step S19).

  The GCL 104 reads the designated movie data from the CGROM 105 (see step S32), and sets the development mode 3 because the movie data designated as the movie data used for reproduction display is IP movie data (see step S34).

  In response to the decompression instruction, the GCL 104 decompresses the picture I1 whose decompression order is the first in the first frame period (F1) and expands it in the frame buffer 0 as shown in FIG. 9 ( (See step S37). Of the frame buffers 0 to 2, the frame buffer that expands image data is not used in the future, for example, for a frame buffer in which no image data is stored, or for display or expansion of other pictures. It is arbitrarily determined from a frame buffer in which image data is stored.

  Next, in the second frame period (F2), the CPU 101 issues a display instruction to the GCL 104 based on the display control data (see step S18) and an expansion instruction (see step S19).

  In response to the display instruction, the GCL 104 sends a video signal for displaying the picture I1 developed in the frame buffer 0 in the previous frame period (F1) to the image display device 120 in the second frame period (F2). (See step S52). Further, in response to the decompression instruction, the GCL 104 decompresses the picture P1 whose decompression order is second in the second frame period (F2) and develops it in the frame buffer 1 as shown in FIG. (See step S37).

  Thereafter, the CPU 101 repeatedly outputs a display instruction and an expansion instruction for each frame period (F3 to F12). The GCL 104 displays a video signal for displaying a picture developed in the previous frame period in accordance with a predetermined display order in accordance with a display instruction from the CPU 101 in each frame period (F3 to F12). Output to the display device 120 (see step S52). Further, the GCL 104 expands the picture displayed in the next frame period in accordance with a decompression instruction from the CPU 101 in each frame period (F3 to F12), and creates a desired frame buffer. Expand (see step S37).

  Then, in the last frame period (F13), the CPU 101 issues a display instruction to the GCL 104 based on the display control data (see step S18). Note that no decompression instruction is issued by the CPU 101 in the last frame period (F13). In response to a display instruction from the CPU 101 in the frame period (F13), the GCL 104 outputs a video signal for displaying the last picture P9 developed in the previous frame period (F12) to the image display device 120 ( Step S52).

  Next, the development timing and display timing of each image (picture) constituting the movie image when the movie image based on the IPB movie data is reproduced will be described.

  FIG. 10A is an explanatory diagram showing an example of the expansion timing and display timing of each picture when a movie image based on IPB movie data is reproduced and displayed. FIG. 11 is an explanatory diagram showing an example of the storage state of the frame buffer when IPB movie data is processed at the timing shown in FIG. Here, for the sake of simplicity, description will be made using IPB movie data in which a moving image is reproduced and displayed by processing for 13 frame periods as shown in FIG.

  When a movie image based on IPB movie data is reproduced and displayed, there are portions where the expansion order and display order of each picture are different. For this reason, there is a portion where the expansion order and the display order in each picture do not match.

  When the CPU 101 reproduces and displays a movie image based on the IPB movie data, the CPU 101 designates the movie data used for reproduction display on the GCL 104 based on the display control data in the first frame period (F1). After (see step S16), an extension instruction is performed twice (see step S19).

  The GCL 104 reads movie data designated as movie data used for reproduction display from the CGROM 105 (see step S32), and sets the development mode 4 because the designated movie data is IPB movie data (see step S34).

  Further, as shown in FIG. 11, the GCL 104 decompresses the picture I1 whose decompression order is the first in response to the first decompression instruction in the first frame period (F1) and expands it to the frame buffer 0 At the same time (see step S37), in response to the second decompression instruction, the picture P1 whose decompression order is second is decompressed and expanded in the frame buffer 1 (see step S37). That is, the GCL 104 executes the above-described decompression / decompression process in step S37 twice in the first frame period (F1). Of the frame buffers 0 to 3, the frame buffer for expanding the image data is, for example, a frame buffer in which no image data is stored, or image data that will not be used for display or expansion of other pictures in the future. Is arbitrarily determined from the stored frame buffers.

  Next, in the second frame period (F2), the CPU 101 issues a display instruction to the GCL 104 based on the display control data (see step S18) and an expansion instruction (see step S19).

  In response to the display instruction, the GCL 104 sends a video signal for displaying the picture I1 developed in the frame buffer 0 in the previous frame period (F1) to the image display device 120 in the second frame period (F2). (See step S52). Further, in response to the decompression instruction, the GCL 104 decompresses the picture P2 whose decompression order is third in the second frame period (F2) and develops it in the frame buffer 2 as shown in FIG. (See step S37).

  Thereafter, the CPU 101 repeatedly outputs a display instruction and an expansion instruction for each frame period (F3 to F11). The GCL 104 displays a video signal for displaying pictures developed up to the previous frame period in accordance with a predetermined display order in response to a display instruction from the CPU 101 in each frame period (F3 to F11). Is output to the image display device 120 (see step S52). Further, the GCL 104 is used for developing other pictures in the frame period after the next frame period in accordance with a predetermined expansion order in accordance with an expansion instruction from the CPU 101 in each frame period (F3 to F11). The picture to be displayed is expanded and developed in a desired frame buffer (see step S37).

  Then, the CPU 101 issues a display instruction to the GCL 104 based on the display control data in the second frame period (F12) from the end (see step S18). Note that no decompression instruction is issued by the CPU 101 in the second frame period (F12) from the end. In response to a display instruction from the CPU 101 in the frame period (F12), the GCL 104 displays an image of a video signal for displaying the picture B5 in the second display order from the last developed until the previous frame period (F11). Output to the display device 120 (see step S52).

  Furthermore, the CPU 101 issues a display instruction to the GCL 104 based on the display control data in the last frame period (F13) (see step S18). Note that no decompression instruction is issued by the CPU 101 even in the last frame period (F13). In response to a display instruction from the CPU 101 in the frame period (F13), the GCL 104 displays a video signal for displaying the last display order picture P5 developed by the previous frame period (F12). (See step S52).

  Conventionally, when a movie image based on IPB movie data is reproduced and displayed, as shown in FIG. 10 (B), the first picture I1 in the expansion order is expanded and expanded in the first frame period (F1). In the frame period (F2), the picture P1 having the second expansion order is expanded and expanded. Next, in the third frame period (F3), the third picture P2 in the expansion order is expanded and expanded, and the picture I1 in the first display order is displayed.

  In the subsequent frame periods (F3 to F12), in the same manner as in the frame period (F3), the pictures in the decompression order are decompressed and expanded in a desired frame buffer, and are in the display order. A process of displaying a picture is executed.

  Then, in the second frame period from the last (F13), the picture B5 developed up to the previous frame period is displayed according to a predetermined display order, and in the last frame period (F14), In accordance with a predetermined display order, a process of displaying the last picture P5 that has been expanded up to the previous frame period is executed.

  As described above, the CPU 101 instructs the compressed moving image data to be used for reproduction display of the moving image and starts the decompression instruction in the drawing instruction in the first frame period when starting the reproduction display of the moving image. When the display instruction is started by the next drawing instruction in the frame period next to the frame period in which the first drawing instruction is started, and the IPB movie data is instructed by the first drawing instruction, Since the extension instruction is performed twice in the frame period, it is possible to easily manage the execution timing of the extension process in the moving image reproduction control.

  That is, the picture expansion process can be started one frame period before the start of the display process of each picture, regardless of whether the IP movie data is reproduced or the IPB movie data is reproduced. Even when IP movie data and IPB movie data are mixed, the timing of starting the picture expansion process is shared, so that the expansion process in the moving image reproduction control for moving image reproduction Management of execution timing becomes easy.

  As described above, the expansion process is performed at a common execution timing regardless of the type of movie data, and the management of the execution timing of the expansion process in the moving image playback control is facilitated. It becomes easy to design the control content (for example, control flow, control program) of moving image reproduction control mixed with IPB movie data. Specifically, the designer who designs the control content of the video playback control is conscious of whether it is IP movie data or IPB movie data when assigning the appearance location of each movie data in the video playback control. Thus, it is possible to assign each movie data without performing the control, and to easily design the control content of the moving image reproduction control. Therefore, it is possible to reduce the work load for developing a control program for controlling the reproduction of moving images.

  Conventionally, as shown in FIG. 10B, for IPB movie data, the picture expansion process has been started two frames before the start of the display process for each picture. The timing for starting the picture decompression process was different from that when performing it. For this reason, the designer who designs the control content of the moving image reproduction control has a different period from the start of reproduction control to the start of moving image display depending on whether the movie data is IP movie data or IPB movie data (1). In consideration of the fact that the frame period shifts, it is necessary to assign the appearance location of each movie data in the moving image reproduction control. On the other hand, in the above-described embodiment, each movie data can be assigned without being conscious of whether it is IP movie data or IPB movie data, and the control contents of the moving image reproduction control can be easily designed. Can do it.

  In the above-described embodiment, when a moving image is reproduced and displayed based on IPB movie data, the extension instruction is performed twice in the first frame period. However, this is executed within one frame period. When the GCL 104 has a processing capability capable of completing each process, the decompression instruction may be performed three or more times. In this case, it is only necessary to increase the frame period during which the decompression instruction is not performed in the second and subsequent frame periods.

  In the above-described embodiment, when a moving image is reproduced and displayed based on the IPB movie data, the extension instruction is given twice in the first frame period. It does not have to be performed in the frame period, and may be performed in any frame period before the frame period in which the decompression instruction for instructing the decompression of the B picture is first made.

  FIG. 12 is an explanatory diagram showing another example of the development timing and display timing of each picture when a movie image based on IPB movie data is reproduced and displayed. FIG. 13 is an explanatory diagram showing an example of the storage state of the frame buffer when IPB movie data is processed at the timing shown in FIG. Here, it is assumed that the decompression instruction is given twice in the third frame period (F3) in which the decompression instruction for instructing the decompression of the B picture is first made. Here, for the sake of simplicity, description will be made using IPB movie data in which a moving image is reproduced and displayed by processing for 13 frame periods as shown in FIG.

  When the CPU 101 reproduces and displays a movie image based on the IPB movie data, the CPU 101 designates the movie data used for reproduction display on the GCL 104 based on the display control data in the first frame period (F1). After (see step S16), here, one extension instruction is given (see step S19).

  The GCL 104 reads the movie data designated from the CPU 101 as movie data used for reproduction display from the CGROM 105, and determines the development mode 4 because the designated movie data is IPB movie data.

  Further, as shown in FIG. 11, the GCL 104 decompresses the picture I1 whose decompression order is the first in response to the first decompression instruction in the first frame period (F1) and expands it to the frame buffer 0 (See step S37).

  Next, in the second frame period (F2), the CPU 101 issues a display instruction to the GCL 104 based on the display control data (see step S18) and issues a single decompression instruction (see step S19). ).

  In response to the display instruction, the GCL 104 sends a video signal for displaying the picture I1 developed in the frame buffer 0 in the previous frame period (F1) to the image display device 120 in the second frame period (F2). (See step S52). Further, in response to the decompression instruction, the GCL 104 decompresses the picture P1 whose decompression order is the second in the second frame period (F2) and develops it in the frame buffer 1 as shown in FIG. (See step S37).

  Next, in the third frame period (F3), the CPU 101 issues a display instruction to the GCL 104 based on the display control data (see step S18), and here performs a decompression instruction twice (step S18). (See S19).

  In response to the display instruction, the GCL 104 sends a video signal for displaying the picture P1 developed in the frame buffer 0 in the previous frame period (F2) to the image display device 120 in the third frame period (F3). (See step S52).

  Further, as shown in FIG. 13, the GCL 104 decompresses the picture P2 whose decompression order is third in response to the first decompression instruction in the third frame period (F3) and stores it in the frame buffer 2. While expanding (see step S37), in response to the second decompression instruction, the picture B1 whose decompression order is fourth is decompressed and expanded in the frame buffer 3 (see step S37). That is, the GCL 104 executes the above-described decompression / decompression process in step S37 twice in a frame period (here, F3) in which the B picture is decompressed / expanded first.

  Thereafter, the CPU 101 repeatedly outputs a display instruction and an expansion instruction for each frame period (F4 to F11). The GCL 104 displays a video signal for displaying pictures developed up to the previous frame period in accordance with a predetermined display order in accordance with display instructions from the CPU 101 in each frame period (F4 to F11). Is output to the image display device 120 (see step S52). Further, the GCL 104 is used for developing other pictures in the frame period after the next frame period in accordance with a predetermined expansion order in accordance with an expansion instruction from the CPU 101 in each frame period (F4 to F11). The picture to be displayed is expanded and developed in a desired frame buffer (see step S37).

  Then, the CPU 101 issues a display instruction to the GCL 104 based on the display control data in the second frame period (F12) from the end (see step S18). Note that no decompression instruction is issued by the CPU 101 in the second frame period (F12) from the end. In response to a display instruction from the CPU 101 in the frame period (F12), the GCL 104 displays a video signal for displaying the picture B5 in the second display order from the last developed until the previous frame period (F11). Output to the display device 120 (see step S52).

  Furthermore, the CPU 101 issues a display instruction to the GCL 104 based on the display control data in the last frame period (F13) (see step S18). Note that no decompression instruction is issued by the CPU 101 even in the last frame period (F13). In response to a display instruction from the CPU 101 in the frame period (F13), the GCL 104 displays a video signal for displaying the last display order picture P5 developed by the previous frame period (F12). (See step S52).

  As described above, the CPU 101 instructs the compressed moving image data to be used for moving image reproduction display and starts the decompression instruction and the decompression instruction by the drawing instruction in the first frame period when starting the moving image reproduction display. When the display instruction is started by the next drawing instruction in the frame period next to the frame period in which the first drawing instruction is started and the IPB movie data is instructed by the first drawing instruction, Even in the case of a configuration in which a decompression instruction is performed a plurality of times in a drawing instruction in a frame period before a frame period in which a decompression instruction for instructing decompression is first performed, as in the above-described embodiment, Management of the execution timing of the decompression process in the moving image reproduction control can be facilitated.

  In each of the above-described embodiments, when the GCL 104 is IPB movie data including a B picture, the number of frame buffers used in the decompression process is smaller than when the GCL 104 is IP movie data not including a B picture. Since it is configured to determine a large number (in the above example, it is determined to be four more than three), depending on whether or not the compressed moving image data used for moving image reproduction display includes a B picture The capacity of the storage area used for moving image reproduction control can be determined appropriately.

  In each of the embodiments described above, the GCL 104 determines the image size in the moving image based on the compressed moving image data used for reproducing and displaying the moving image instructed by the drawing instruction from the CPU 101 in the decompression process. Since a storage area having a size corresponding to the determination result is set as a frame buffer, a storage area used for moving image reproduction control according to the image size of the moving image based on the compressed moving image data used for moving image reproduction display Can be appropriately determined.

  Further, in each of the above-described embodiments, after the CPU 101 issues a decompression instruction in a predetermined frame period, the frame period ends before the decompression process executed by the GCL 104 according to the decompression instruction ends. In this case, the same display instruction is given in the next frame period as in the previous frame period, and an image based on the same image data is displayed on the image display device 120. In this case, when the GCL 104 receives a drawing instruction (for example, a display instruction) from the CPU 101 in the next frame period before the expansion process executed in response to the expansion instruction from the CPU 101 in a certain frame period ends. Then, it is only necessary to abandon (erase) the image data that is being decompressed and expanded by the decompression process and output a video signal corresponding to the received display instruction. Therefore, in such a case, the same image as that displayed in the previous frame period is displayed again. With this configuration, it is possible to prevent screen flickering.

  Although not particularly mentioned in each of the above-described embodiments, the GCL 104 is decompressed by decompression processing every two frame periods every time a sprite image synthesized on the image data is updated every frame period. The processed image data may be stored in the frame buffer. In this case, for example, the processes of steps S20 and S21 may be performed every frame period, and the processes of steps S18 and S19 may be performed every two frames. Specifically, for example, the CPU 101 may issue a drawing instruction based on display control data as shown in FIG. That is, for example, based on the display control data shown in FIG. 14, the CPU 101 issues a decompression instruction and a display instruction as necessary and a sprite image display instruction as necessary during the frame period when the process data number is an odd number. In the frame period when is an even number, a sprite image display instruction may be issued as needed without performing an expansion instruction or a display instruction. When the GCL 104 receives a sprite image display instruction without receiving a decompression instruction or a display instruction in a certain frame period, it transmits a video signal indicating the same image data as that used in the previous frame period. You can do it. If comprised in this way, it can prevent that the control burden regarding image composition becomes heavy, implement | achieving a precise display.

  In the above-described embodiment, when IPB movie data is played back and displayed, only the display is performed without decompressing / decompressing the picture during the last two frame periods (FIG. 10). As shown in the IP movie data, when the IPB movie data is played back and displayed, the picture in the last display order is not displayed and the picture is not expanded or expanded only for the last one frame period. It is preferred that only be done. In this case, the set display control data is switched to the IP movie data display control data indicating the moving image to be reproduced and displayed in the frame period in which the picture in the last display order in the IPB movie data is displayed. You can do it.

  FIG. 15A shows an expansion timing and a display timing when the last display order picture is not displayed when IPB movie data in which the last expansion order picture is a B picture is played back. FIG. Here, for the sake of simplicity, if a picture in the last display order as shown in FIG. 15A is displayed, a moving image is reproduced and displayed by processing for 13 frame periods. Description will be made using IPB movie data in which a moving image is reproduced and displayed by processing for 12 frame periods because it is not displayed. In the example shown in FIG. 15A, a moving image based on IP movie data is reproduced and displayed after IPB movie data. FIG. 16 is an explanatory diagram showing an example of display control data used for reproducing the IPB movie data shown in FIG. FIG. 17 is an explanatory diagram showing an example of display control data used for reproducing the IP movie data shown in FIG. Here, it is assumed that IP movie data B1 is not movie data for background but movie data for effect display.

  In the IPB movie data shown in FIG. 15A, the picture (final display scheduled image: here picture P5), which is the last display order, is at least visually hindered even if it is not displayed in the reproduced moving image. It is assumed that no dummy picture has been generated. As the “dummy picture”, for example, an image of the entire color or a picture that is the last display order in the display (in the example shown in FIG. 15A, set to be displayed one frame period before the picture P5) The same image as the picture B5) being considered can be considered. If the dummy picture is the same as the last picture in the display order, the same picture is already displayed even if the dummy picture is not displayed, so there is no visual problem. Even if it is displayed, it is possible to prevent an uncomfortable appearance. The dummy picture is not displayed as a dummy when the playback display based on the movie data is not continuously performed (when the moving image is not continuously played back and displayed).

  In each frame period (F1 to F11), the CPU 101 issues a drawing instruction such as a display instruction or an expansion instruction to the GCL 104 based on the display control data (see step S18 and step S19).

  In response to a drawing instruction from the CPU 101, the GCL 104 sends a video signal for displaying a picture developed in the frame buffer up to the previous frame period to the image display device 120 in each frame period (F1 to F11). And the like (step S52), the process of expanding each picture in accordance with the expansion order and expanding it in the frame buffer (see step S37), and the like.

  Then, when the twelfth frame period (F12) is started (see step S12), the CPU 101 determines to start a new moving image playback (see Y in step S12). Here, the movie data B1 is stored. 17 (see step S14), and the display control data is switched to the IP movie data display control data shown in FIG. 17 (see step S15). Based on the process data), in addition to specifying the IP movie data B1 (see step S16), a display instruction (see step S18) and an expansion instruction (see step S19) are performed. That is, the twelfth frame period in the IPB movie data display control data is switched to the first frame period in the newly set IP movie data display control data. As described above, the CPU 101 instructs the display of the picture in the second display order from the end (picture B5 in this example) in the twelfth frame period (F12) and the last display order in the thirteenth frame period (F13). The drawing instruction based on the display control data of the IPB movie data is terminated without giving the display instruction of the picture (picture P5 in this example), and the drawing instruction based on the display control data of the newly set IP movie data is started. To do.

  In the first frame period (F1) based on the display control data newly set by the CPU 101, the GCL 104 sets the IP movie data B1 in accordance with the designation of the movie data from the CPU 101 (steps S32 to S32). (See S35).

  Further, the GCL 104 is expanded in the frame buffer by the previous frame period in response to a display instruction from the CPU 101 in the first frame period (F1) based on the display control data newly set by the CPU 101. A video signal for displaying the picture B5 of the IPB movie data A2 is output to the image display device 120 (see step S52). That is, when the GCL 104 receives a display instruction from the CPU 101, the image data corresponding to the display order 1 in the next display order is not developed in the frame buffer. A video signal for displaying the picture B5 having the earliest display order among the pictures not displayed is output to the image display device 120.

  Further, the GCL 104, in the first frame period (F1) based on the display control data newly set by the CPU 101, in response to the decompression instruction from the CPU 101, the decompression order of the IP movie data B1 is the first picture I1. Is expanded in the frame buffer (see step S37).

  Thereafter, in each frame period (F2 to F6) for the IP movie data B1, the CPU 101 issues a drawing instruction such as a display instruction or an expansion instruction to the GCL 104 based on the display control data (step S18, step S19). reference).

  In response to a drawing instruction from the CPU 101, the GCL 104 sends a video signal for displaying the picture developed in the frame buffer in the previous frame period to the image display device 120 in each frame period (F2 to F6). And the like (step S52), the process of expanding each picture in accordance with the expansion order and expanding it in the frame buffer (see step S37), and the like.

  In this way, after the reproduction / display of the moving image by the IPB movie data is completed, the reproduction / display of the moving image by the IP movie data is started. Note that when the playback and display of a moving image using IPB movie data is subsequently started, as long as the display process is started in the frame period subsequent to the frame period in which the decompression process is started, the same as in the above-described example. It is possible to perform processing.

  As described above, the CPU 101 instructs the compressed moving image data to be used for moving image reproduction display and starts the decompression instruction and the decompression instruction by the drawing instruction in the first frame period when starting the moving image reproduction display. When the display instruction is started by the next drawing instruction in the frame period next to the frame period in which the first drawing instruction is started and the IPB movie data is instructed by the first drawing instruction, A drawing instruction is given a plurality of times in a drawing instruction in a frame period before a frame period in which an extension instruction for instructing extension is first issued, and a picture in the last display order of IPB movie data is displayed. Without starting to display the second picture from the end, the next IP movie data playback display is started. Therefore, even when the IP movie data is reproduced and displayed after the IPB movie data is reproduced and displayed, the timing for starting the moving image reproduction control for the IP movie data to be reproduced and displayed can be made common. Thus, the management of the execution timing of the moving image reproduction control can be facilitated.

  That is, whether the IP movie data is subsequently played back after the IP movie data or the IP movie data is played back after the IPB movie data, the last movie data that is played back and displayed last. It becomes possible to start moving image playback control of IP movie data from the frame period next to the frame period for which the decompression instruction has been issued, and even if IP movie data and IPB movie data are mixed, The timing for starting the picture expansion process in the IP movie data to be continuously played back when the IP movie data is continuously played after the movie data and when the IP movie data is continuously played after the IPB movie data is made common. Therefore, the execution timing of decompression processing in video playback control Grayed management becomes easy.

  As described above, the expansion processing of the IP movie data to be reproduced and displayed later is started at a common execution timing regardless of the type of movie data to be reproduced and displayed first, and the IP movie data to be reproduced subsequently is started. Since it is easy to manage the execution timing of decompression processing in video playback control, it is easy to design control content (for example, control flow and control program) of video playback control in which IP movie data and IPB movie data are mixed. It becomes. Specifically, when the designer who designs the control content of the video playback control assigns the appearance location of each movie data in the video playback control, the type of the movie data to be played back and displayed first is IP movie data. Regardless of whether it is IPB movie data or not, it is possible to assign each IP movie data to be continuously reproduced and displayed, and it is possible to easily design the control content of the moving image reproduction control. Therefore, it is possible to reduce the work load for developing a control program for controlling the reproduction of moving images.

  In particular, in the above example, the IPB movie data to be reproduced first is image data indicating the final display scheduled image that is not actually displayed. Other pictures (picture B4 and picture B5 in the example shown in FIG. 15A) Therefore, all the pictures in the IPB movie data can be used as necessary pictures for moving image reproduction control, and the data capacity of the movie data is not wasted. In addition, it is possible to prevent the GCL 104 from executing unnecessary decompression / expansion processing and increasing the load due to unnecessary processing. In other words, the expansion / decompression process of the final display scheduled image in the GCL 104 can be an effective process.

  FIG. 15B shows an example of decompression timing and display timing when the picture in the last display order is not displayed when playing back IPB movie data in which the picture in the last decompression order is not a B picture. FIG. Here, for the sake of simplicity, if a picture in the last display order as shown in FIG. 15B is displayed, a moving image is reproduced and displayed by processing for 13 frame periods. Description will be made using IPB movie data in which a moving image is reproduced and displayed by processing for 12 frame periods because it is not displayed. In the example shown in FIG. 15B, a moving image based on IP movie data is reproduced and displayed after IPB movie data. FIG. 18 is an explanatory diagram showing an example of display control data used for reproducing the IPB movie data shown in FIG. The display control data used for reproducing the IP movie data shown in FIG. 15B is the same as the example shown in FIG. Here, it is assumed that IP movie data B1 is not movie data for background but movie data for effect display.

  In the IPB movie data shown in FIG. 15B, the picture (final display scheduled image: here picture P6) which is the last display order is at least visually troublesome even if it is not displayed in the reproduced moving image. It is assumed that no dummy picture has been generated.

  In each frame period (F1 to F11), the CPU 101 issues a drawing instruction such as a display instruction or an expansion instruction to the GCL 104 based on the display control data (see step S18 and step S19).

  In response to a drawing instruction from the CPU 101, the GCL 104 sends a video signal for displaying a picture developed in the frame buffer up to the previous frame period to the image display device 120 in each frame period (F1 to F11). And the like (step S52), the process of expanding each picture in accordance with the expansion order and expanding it in the frame buffer (see step S37), and the like.

  Then, when the twelfth frame period (F12) is started (see step S12), the CPU 101 decides to start a new moving image reproduction (see Y in step S12). Here, the movie data B1 is stored. 17 (see step S14), and the display control data is switched to the IP movie data display control data shown in FIG. 17 (see step S15). Based on the process data), in addition to specifying the IP movie data B1 (see step S16), a display instruction (see step S18) and an expansion instruction (see step S19) are performed. That is, the twelfth frame period in the IPB movie data display control data is switched to the first frame period in the newly set IP movie data display control data. In this way, the CPU 101 instructs the display of the picture in the second display order from the last (picture P5 in this example) in the twelfth frame period (F12) and the last display order in the thirteenth frame period (F13). The drawing instruction based on the display control data of the IPB movie data is terminated without issuing the display instruction of the picture (picture P6 in this example), and the drawing instruction based on the display control data of the newly set IP movie data is started. To do.

  In the first frame period (F1) based on the display control data newly set by the CPU 101, the GCL 104 sets the IP movie data B1 in accordance with the designation of the movie data from the CPU 101 (steps S32 to S32). (See S35).

  Further, the GCL 104 is expanded in the frame buffer by the previous frame period in response to a display instruction from the CPU 101 in the first frame period (F1) based on the display control data newly set by the CPU 101. A video signal for displaying the picture P5 of the IPB movie data A3 is output to the image display device 120 (see step S52). That is, when the GCL 104 receives a display instruction from the CPU 101, the image data corresponding to the display order 1 in the next display order is not developed in the frame buffer. A video signal for displaying the picture P5 having the earliest display order among the pictures that have not been displayed is output to the image display device 120.

  Further, the GCL 104, in the first frame period (F1) based on the display control data newly set by the CPU 101, in response to the decompression instruction from the CPU 101, the decompression order of the IP movie data B1 is the first picture I1. Is expanded in the frame buffer (see step S37).

  Thereafter, in each frame period (F2 to F6) for the IP movie data B1, the CPU 101 issues a drawing instruction such as a display instruction or an expansion instruction to the GCL 104 based on the display control data (step S18, step S19). reference).

  In response to a drawing instruction from the CPU 101, the GCL 104 sends a video signal for displaying the picture developed in the frame buffer in the previous frame period to the image display device 120 in each frame period (F2 to F6). And the like (step S52), the process of expanding each picture in accordance with the expansion order and expanding it in the frame buffer (see step S37), and the like.

  In this way, after the reproduction / display of the moving image by the IPB movie data is completed, the reproduction / display of the moving image by the IP movie data is started. Note that when the playback and display of a moving image using IPB movie data is subsequently started, as long as the display process is started in the frame period subsequent to the frame period in which the decompression process is started, the same as in the above-described example. It is possible to perform processing.

  As described above, the CPU 101 instructs the compressed moving image data to be used for moving image reproduction display and starts the decompression instruction and the decompression instruction by the drawing instruction in the first frame period when starting the moving image reproduction display. When the display instruction is started by the next drawing instruction in the frame period next to the frame period in which the first drawing instruction is started and the IPB movie data is instructed by the first drawing instruction, A configuration in which a decompression instruction is given a plurality of times in a drawing instruction in a frame period before the first frame period in which a decompression instruction for instructing decompression is first made, and the picture in the last decompression order is not a B picture The last display order picture of the IPB movie data (final display scheduled image: picture P6 here) is displayed without displaying the picture. Since the playback of the next IP movie data is started following the display of the second picture from the end, after the playback and display of the IPB movie data whose last decompression order is not a B picture. Even when IP movie data is subsequently played back and displayed, the timing for starting the moving image playback control for the IP movie data to be played back and displayed continuously can be made common, and the execution timing of the moving image playback control can be managed. Can be easily. Note that in the IPB movie data in which the last picture in the decompression order is not a B picture as described above, the picture in the last decompression order is the final display scheduled image. The frame period to be performed is the final frame period of control based on the display control data of the IPB movie data to be reproduced and displayed first, and the IPB movie data to be reproduced and displayed first and the IP movie data to be reproduced and displayed later. The switching timing can be easily grasped, and the management of the execution timing of the moving image reproduction control can be facilitated.

  That is, whether the IP movie data is subsequently played back after the IP movie data or the IP movie data is played back after the IPB movie data, the last movie data that is played back and displayed last. It becomes possible to start moving image playback control of IP movie data from the frame period next to the frame period for which the decompression instruction has been issued, and even if IP movie data and IPB movie data are mixed, The timing for starting the picture expansion process in the IP movie data to be continuously played back when the IP movie data is continuously played after the movie data and when the IP movie data is continuously played after the IPB movie data is made common. Therefore, the execution timing of decompression processing in video playback control Grayed management becomes easy.

  As described above, the expansion processing of the IP movie data to be reproduced and displayed later is started at a common execution timing regardless of the type of movie data to be reproduced and displayed first, and the IP movie data to be reproduced subsequently is started. Since it is easy to manage the execution timing of decompression processing in video playback control, it is easy to design control content (for example, control flow and control program) of video playback control in which IP movie data and IPB movie data are mixed. It becomes. Specifically, when the designer who designs the control content of the video playback control assigns the appearance location of each movie data in the video playback control, the type of the movie data to be played back and displayed first is IP movie data. Regardless of whether it is IPB movie data or not, it is possible to assign each IP movie data to be continuously reproduced and displayed, and it is possible to easily design the control content of the moving image reproduction control. Therefore, it is possible to reduce the work load for developing a control program for controlling the reproduction of moving images.

  In particular, in the above example, the IPB movie data to be reproduced first is subjected to decompression / decompression processing of image data indicating a final display scheduled image (picture P6 in the example shown in FIG. 15B) that is not actually displayed. Since the frame period to be performed is the frame period immediately before switching to the display control data for the IP movie data, the display control data is switched in the frame period next to the frame period in which the final display scheduled image expansion / decompression process is executed. By doing so, it is possible to set the start timing of decompression processing of IP movie data to be reproduced later. Therefore, by using movie data whose final decompressed picture is not a B picture as IPB movie data to be played back first, it is possible to easily determine the switching timing of movie data to be controlled when movie data is played back continuously. Thus, it is possible to easily manage the execution timing of the decompression process in the moving image reproduction control when the movie data is continuously reproduced.

  In the above embodiment, the moving image playback control for the next IP movie data is started from the next frame period without blanking after the moving image playback control for the IPB movie data is completed. After the above moving image reproduction control is completed, the moving image reproduction control of the next movie data may be started with a blank for one or more frame periods. Even with this configuration, it is possible to share the timing for starting the moving image reproduction control for the movie data to be reproduced and displayed continuously, thereby facilitating management of the execution timing of the moving image reproduction control. .

  In addition, the image processing apparatus 100 in each of the embodiments described above can be applied to any apparatus or system that reproduces and displays moving images based on a plurality of types of movie data. Specifically, For example, it is applied to game machines, pachinko machines, slot machines, and other game machines, advertisement display devices that display advertisements using movies on the streets and trains, display devices that display screen savers using multiple types of movies, etc. Is possible.

  Here, a gaming machine to which the above-described image processing apparatus 100 can be applied will be described in detail. First, the overall configuration of a first type pachinko gaming machine that is an example of a gaming machine will be described. FIG. 19 is a front view of the pachinko gaming machine as viewed from the front.

  The pachinko gaming machine 1 includes an outer frame (not shown) formed in a vertically long rectangular shape, and a game frame attached to the inside of the outer frame so as to be openable and closable. Further, the pachinko gaming machine 1 has a glass door frame 2 formed in a frame shape that is provided in the game frame so as to be opened and closed. The game frame includes a front frame (not shown) installed to be openable and closable with respect to the outer frame, a mechanism plate to which mechanism parts and the like are attached, and various parts attached to them (excluding a game board described later). Is a structure including

  As shown in FIG. 19, the pachinko gaming machine 1 has a glass door frame 2 formed in a frame shape. On the lower surface of the glass door frame 2 is a hitting ball supply tray (upper plate) 3. Under the hitting ball supply tray 3, an extra ball receiving tray 4 for storing game balls that cannot be accommodated in the hitting ball supply tray 3 and a hitting operation handle (operation knob) 5 for firing the hitting ball are provided. A game board 6 is detachably attached to the back surface of the glass door frame 2. The game board 6 is a structure including a plate-like body constituting the game board 6 and various components attached to the plate-like body. A game area 7 is formed on the front surface of the game board 6.

  Near the center of the game area 7, a variable display device (special variable display section) 9 including a plurality of variable display sections each variably displaying a symbol as identification information is provided. The variable display device 9 has, for example, three variable display portions (symbol display areas) of “left”, “middle”, and “right”. In this example, the variable display device 9 has the function of the image display device 120 described above. The variable display device 9 is provided with four special symbol start memory display areas (start memory display areas) 18 for displaying the number of effective winning balls that have entered the start winning opening 14, that is, the start winning memory number. Every time there is an effective start prize (start prize when the start prize memory number is less than 4), the start memory display area 18 for changing the display color (for example, changing from blue display to yellow display) is increased by one. Each time the variable display of the variable display device 9 is started, the start memory display area 18 in which the display color is changed is reduced by 1 (that is, the display color is returned to the original).

  Below the variable display device 9, a variable winning ball device 15 including a start winning opening 14 is provided. The winning ball that has entered the start winning opening 14 is guided to the back of the game board 6 and detected by a start opening switch (not shown). The variable winning ball apparatus 15 includes left and right opening / closing pieces that perform opening / closing operations. The opening / closing piece is opened by a solenoid (not shown).

  An opening / closing plate 20 that is opened by a solenoid (not shown) in a specific gaming state (big hit state) is provided below the variable winning ball device 15. The opening / closing plate 20 is a means for opening and closing the special winning opening. Of the winning balls guided from the opening / closing plate 20 to the back of the game board 6, the winning ball entering one (V winning area) is detected by a V winning switch (not shown), and the winning balls from the opening / closing plate 20 are counted. It is detected by a switch (not shown). A solenoid (not shown) for switching the route in the special winning opening is also provided on the back of the game board 6.

  When a game ball wins the gate 32 and is detected by a gate switch (not shown), a predetermined random number value is extracted if the normal symbol start winning memory has not reached the upper limit. And if it is a state which can start the variable display in which a display state changes in the normal symbol display 10, the variable display of the display of the normal symbol display 10 will be started. If the normal symbol display 10 is not in a state where variable display in which the display state changes can be started, the value of the normal symbol start winning memory is incremented by one. In the vicinity of the normal symbol display 10, there is provided a normal symbol start memory display 41 having a display unit with four LEDs for displaying the number of normal symbol start winning memorized numbers. Each time there is a prize at the gate 32, the normal symbol start memory display 41 increases the number of LEDs to be turned on by one. Each time variable display on the normal symbol display 10 is started, the number of LEDs to be lit is reduced by one. The special symbol and the normal symbol can be variably displayed on one variable display device. In that case, the special variable display unit and the normal variable display unit are realized by one variable display device.

  In this example, the left and right lamps (the symbols can be visually recognized when lit) are alternately lit, so that the normal symbols are variably displayed, and the variable display continues for a predetermined time (for example, 29.2 seconds). If the left lamp is turned on at the end of the variable display, it is a win. Whether or not to win is determined by whether or not the value of the random number extracted when the game ball wins the gate 32 matches a predetermined hit determination value. When the display result of the variable display on the normal symbol display 10 is a win, the variable winning ball apparatus 15 is opened for a predetermined number of times for a predetermined time so that the game ball is likely to win. That is, the state of the variable winning ball device 15 changes from a disadvantageous state to a player's advantageous state when the normal symbol is a winning symbol.

  Furthermore, in the probability variation state as the special game state, the probability that the stop symbol in the normal symbol display 10 becomes a winning symbol is increased, and one or both of the opening time and the number of times of opening of the variable winning ball device 15 are increased. And more advantageous for the player. Further, in a predetermined state such as a probability change state, the variable display period (fluctuation time) in the normal symbol display 10 may be shortened, which may be more advantageous for the player.

  The game board 6 is provided with a plurality of winning holes 29, 30, 33, 39, and winning of game balls to the winning holes 29, 30, 33, 39 is detected by a winning hole switch. Around the left and right sides of the game area 7, there are provided decorative lamps 25 that are blinked and displayed during the game, and at the bottom there is an out mouth 26 that absorbs the hit ball that has not won. In addition, two speakers 27 that emit sound effects and sounds are provided on the left and right upper portions outside the game area 7. On the outer periphery of the game area 7, a top frame lamp 28a, a left frame lamp 28b, and a right frame lamp 28c are provided.

  In this example, a prize ball lamp 51 that is turned on when there is a remaining number of prize balls is provided in the vicinity of the left frame lamp 28b, and a ball that is turned on when the supply ball is cut out in the vicinity of the right frame lamp 28c. A cut lamp 52 is provided.

  The game balls launched from the hit ball launching device enter the game area 7 through the hit ball rail, and then descend the game area 7. When the hit ball enters the start winning opening 14 and is detected by the start opening switch, if the variable display of the symbol can be started, the variable display device 9 starts the variable display (variation) of the special symbol. If it is not in a state where the variable display of symbols can be started, the start winning memory number is increased by one.

  The variable display of the special symbol on the variable display device 9 stops when a certain time has elapsed. If the combination of the special symbols at the time of the stop is a jackpot symbol (specific display mode), the game shifts to a jackpot gaming state. That is, the opening / closing plate 20 is opened until a predetermined time elapses or a predetermined number (for example, 10) of hit balls wins. When the hit ball enters the V winning area while the opening / closing plate 20 is opened and is detected by the V winning switch, the right to continue is generated and the opening / closing plate 20 is opened again. The generation of the continuation right is allowed a predetermined number of times (for example, 15 rounds).

  When the combination of special symbols in the variable display device 9 at the time of stopping is a combination of jackpot symbols (probability variation symbols) with probability fluctuations, the probability of the next jackpot increases. That is, it becomes a more advantageous state (special game state) for the player, which is a probable change state.

  In the gaming machine as shown in FIG. 19, display control of a movie image or the like on the variable display device 9 may be performed by the image processing device 100. In the gaming machine, the display control of the variable display device 9 for variably displaying the symbols is performed by, for example, effect control means mounted on an effect control board provided in the game machine. Therefore, the function of the CPU 101 described above may be added to the function of the effect control means. In this case, it is conceivable to perform a reach effect, a jackpot effect, a notice effect, or the like using a movie image.

  Next, an overall configuration of a slot machine (slot machine) which is another example of the gaming machine will be described. FIG. 20 is a front view of the slot machine as seen from the front.

  As shown in FIG. 20, in the slot machine 500, a game panel 501 is detachably attached near the center. In addition, a variable display device 502 for variably displaying a plurality of types of symbols is provided near the center of the front surface of the game panel 501. In this embodiment, the variable display device 502 has three symbol display areas of “left”, “middle”, and “right”, and the symbol display reels 502a, 502b, and 502c correspond to the symbol display areas, respectively. Is provided.

  Below the game panel 501, an operation table 520 is provided in which various input switches and the like for the player to perform various operations are arranged. On the back side of the operation table 520, a BET switch 521 for betting (putting) coins one by one, and a MAXBET switch 522 for betting coins by the maximum number (three in this example) that can be placed in one game. A settlement switch 523 and a coin insertion slot 524 are provided. Coins inserted into the coin insertion slot 524 are detected by an inserted coin sensor (not shown).

  On the front side of the operation table 520, a start switch 525, a left reel stop switch 526a, a middle reel stop switch 526b, a right reel stop switch 526c, and a coin jam elimination switch 527 are provided. Lamps 528a and 528b are provided on the left and right sides of the operation table 520, respectively. A speaker 530 for outputting sound effects and the like is provided below the operation table 520.

  On the upper part of the game panel 501, an image display device (LCD: liquid crystal display device) 540 for notifying the player of a game method, a game state, and the like is provided. For example, when a winning occurs, an image in which a character performs a predetermined action is displayed on the image display device 540 to notify the player that a winning flag, which will be described later, is set. In this example, the image display device 540 has the function of the image display device 120 described above. Two speakers 541L and 541R that emit sound effects are provided on the left and right of the image display device 540.

  The winning combinations generated in the slot machine 500 include a small winning combination, a replay winning, a big bonus winning, and a regular bonus winning. In the slot machine 500, random numbers are extracted at the timing when the start switch 525 is operated, and it is determined whether or not the winning of any winning combination is allowed. The fact that winnings are allowed is said to be “winning internally”. When the internal winning is made, a winning flag indicating that is set in the slot machine 500. In the game with the winning flag set, the reels 502a to 502c are controlled so that the winning combination corresponding to the winning flag can be drawn. On the other hand, in a game in which the winning flag is not set, the reels 502a to 502c are controlled so that no winning occurs.

Next, an outline of the game provided by the slot machine will be described.
For example, when a multiplier is set by inserting a coin from the coin insertion slot 524 and pressing the BET switch 521 or the MAXBET switch 522, the operation of the start switch 525 becomes effective. When the player operates the start switch 525, the symbol display reels 502a to 502c provided in the variable display device 502 start rotating. In addition, when a regular bonus prize or a big bonus prize is internally won at the timing when the start switch 525 is operated, for example, a screen on which a predetermined character performs a predetermined action is displayed on the image display device 540. Thus, the player or the like is notified that the internal winning is made.

  When a predetermined time elapses after the symbol display reels 502a to 502c start rotating, the operations of the reel stop switches 526a to 526c become effective. In this state, when the player presses one of the reel stop switches 526a to 526c, the rotation of the reel corresponding to the operated stop switch is stopped. When the symbol display reels 502a to 502c are left for a predetermined period or more without being stopped, the symbol display reels 502a to 502c are automatically stopped.

  When all the symbol display reels 502a to 502c are stopped, the symbol display reels 502a to 502c displayed on the variable display device 502 are determined according to the number of symbols in the upper, middle, and lower three symbols. Whether or not a prize is won is determined by a combination of symbols positioned on a valid winning line. When the multiplying number is 1, only the middle one horizontal winning line in the variable display device 502 is valid. When the multiplying number is 2, the three rows of winning lines in the upper, middle, and lower rows in the variable display device 502 are valid. When the number of multiplications is 3, a total of five pay lines of three horizontal rows and two diagonal diagonal lines in the variable display device 502 are effective lines.

  When a combination of symbols on the active line becomes a specific display mode determined in advance and a winning occurs, a predetermined game effect is made by sound, light, display on the image display device 540, etc. The game according to is started.

  In the slot machine 500, the effect control means mounted in the slot machine 500 performs display control of the image display device 540 provided in the slot machine 500. Therefore, the function of the CPU 101 described above may be added to the function of the effect control means. The image display device 540 displays various kinds of information such as a decorative pattern change display and a display for notifying a game state and a game method under the control of the effect control means. Various information such as a decorative symbol display, a display for notifying a game state and a game method, and the like are displayed by a movie image, and display control of the movie image is performed by the image processing apparatus 100. do it.

  INDUSTRIAL APPLICABILITY The present invention is useful for facilitating management of the execution timing of decompression processing in moving image reproduction control in an image processing apparatus that uses both IP compressed moving image data and IPB compressed moving image data for production.

It is a block diagram which shows the example of the image processing apparatus in one embodiment of this invention. It is explanatory drawing which shows the example of the movie data memorize | stored in CGROM. It is explanatory drawing which shows the example of the content of display control data. It is explanatory drawing which shows the example of a frame buffer. It is a flowchart which shows the example of the V blank interruption process performed by CPU. It is a flowchart which shows the example of the image expansion process performed by GCL. It is a flowchart which shows the example of the image display process performed by GCL. It is explanatory drawing which shows the example of the expansion | deployment timing and display timing of each picture when the movie image based on IP movie data is reproduced and displayed. It is explanatory drawing which shows the example of the storage state of a frame buffer when IP movie data is processed. FIG. 10A is an explanatory diagram showing an example of the development timing and display timing of each picture when a movie image based on the IPB movie data of this example is reproduced and displayed. FIG. 10B is an explanatory diagram showing an example of the development timing and display timing of each picture when a movie image based on conventional IPB movie data is reproduced and displayed. It is explanatory drawing which shows the example of the storage state of a frame buffer when IPB movie data is processed. It is explanatory drawing which shows the other example of the expansion | deployment timing of each picture, and a display timing when the movie image based on IPB movie data is reproduced and displayed. It is explanatory drawing which shows the other example of the storage state of a frame buffer when IPB movie data is processed. It is explanatory drawing which shows the other example of the content of display control data. FIG. 15A shows an example of decompression timing and display timing when IPB movie data in which the last decompression order picture is a B picture is reproduced and displayed without displaying the last display order picture. It is a timing diagram. FIG. 15B is a timing diagram showing an example of expansion timing and display timing when IPB movie data in which the last expansion order picture is not a B picture is reproduced and displayed without displaying the last display order picture. is there. It is explanatory drawing which shows the example of the display control data used in order to reproduce | regenerate IPB movie data. It is explanatory drawing which shows the example of the display control data used in order to reproduce | regenerate IP movie data. It is explanatory drawing which shows the other example of the display control data used in order to reproduce | regenerate IPB movie data. It is the front view which looked at the pachinko game machine from the front. FIG. 4 is a front view of the slot machine as viewed from the front.

Explanation of symbols

100 Image processing apparatus 101 CPU
102 ROM (control ROM)
103 RAM
104 GCL
105 CGROM (image ROM)
106 SDRAM (VRAM)
DESCRIPTION OF SYMBOLS 107 Palette buffer 108 CG data buffer 109 Drawing control part 110 Display signal control part 111 Movie expansion | extension part 120 Image display apparatus

Claims (7)

An image processing apparatus that performs image processing for reproducing and displaying a moving image based on compressed moving image data including a plurality of compressed image data that has been compressed by a predetermined compression method on an image display means,
Compressed moving image storing a plurality of compressed moving image data including first compressed moving image data including bidirectional compressed image data compressed by bidirectional predictive coding and second compressed moving image data not including the bidirectional compressed image data Data storage means;
Control information setting means for setting control information for reproducing and displaying a moving image based on compressed video data for each predetermined frame period;
A moving image reproducing unit that sequentially expands the compressed moving image data and reproduces a moving image based on the compressed moving image data based on the control information set by the control information setting unit;
The moving image reproducing means includes
Decompression processing for performing decompression processing for decompressing compressed image data included in the compressed moving image data in a predetermined decompression order in response to an decompression instruction included in the control information set by the control information setting unit Means,
In response to a display instruction included in the control information set by the control information setting unit, an image based on the image data expanded by the expansion processing unit is displayed for each frame period according to a predetermined display order. Replay display processing means for performing replay display processing for replaying and displaying a moving image based on the compressed moving image data by sequentially displaying on the display means,
The control information setting means includes
A frame period in which the compressed video data used for the playback and display of the moving image is specified by the first control information set when starting the playback and display of the moving image, and the first control information specifying the compressed moving image data is set The extension instruction is started from
The display instruction is started from the frame period next to the frame period in which the control information for starting the extension instruction is set,
When the compressed moving image data designated by the first control information is the first compressed moving image data, a decompression instruction is performed a plurality of times in a frame period in which the decompression instruction is started,
When a moving image based on the compressed moving image data is reproduced after the moving image is reproduced based on the first compressed moving image data by the moving image reproducing means, the first compressed moving image data used for the previous reproduction is reproduced. In the frame period before the frame period in which the final display scheduled image in which the display order in the original moving image is last is to be displayed, the display order in the moving image based on the compressed moving image data used for later playback is the first. After setting the control information including the instruction to decompress the previous display image, and without setting the control information including the instruction to display the final display scheduled image in the frame period in which the final display planned image is to be displayed, Setting of control information including an instruction to display the earliest display image in a moving image based on compressed video data used for playback of
The moving image reproduction means includes
Based on the control information set by the control information setting means, an image whose display order in the moving image based on the first compressed moving image data used for the previous playback is one before the final display scheduled image is the first image. Display as the final image of the moving image based on the compressed moving image data, and display the earliest display image in the frame period in which the final display scheduled image that is the frame period next to the frame period in which the final image is displayed And
The extension processing means includes:
When a moving image based on the compressed moving image data is reproduced after the moving image is reproduced based on the first compressed moving image data by the moving image reproducing means, the first compressed moving image data used for the previous reproduction is reproduced. An image processing apparatus, wherein image data indicating a final scheduled display image in a moving image based on the image data is used for decompression processing of compressed image data indicating another image in the moving image based on the first compressed moving image data. The decompression processing means performs a frame buffer storage process for storing the image data obtained by decompressing the compressed image data in any of a plurality of frame buffers in the decompression process,
Used in the decompression process depending on whether the compressed moving image data used for reproducing and displaying the moving image designated by the control information set by the control information setting means is the first compressed moving image data or the second compressed moving image data. Frame buffer number determining means for determining the number of frame buffers;
The image processing apparatus according to claim 1, wherein the frame buffer number determination unit determines the number of first compressed moving image data to be larger than that of second compressed moving image data. The decompression processing means performs a frame buffer storage process for storing the image data obtained by decompressing the compressed image data in any of a plurality of frame buffers in the decompression process,
The image size in the moving image is determined based on the compressed moving image data used for reproducing and displaying the moving image specified by the control information set by the control information setting means, and the storage area of the size corresponding to the determination result is used as a frame buffer. The image processing apparatus according to claim 1, further comprising a frame buffer setting unit for setting. The control information setting means performs the decompression instruction with the control information set in the predetermined frame period, and then ends the frame period before the decompression processing executed by the decompression processing means in response to the decompression instruction is completed. The display instruction to display an image based on the same image data as the predetermined frame period in the control information set in the next frame period is performed. Processing equipment. The image processing apparatus according to any one of claims 1 to 4, wherein the final display scheduled image is the same image as an image whose display order is one before the final display planned image. Compressed video data includes a larger amount of intra-frame compressed image data compressed by intra-frame coding in a moving image based on the compressed moving image data than in a portion where the moving speed of the displayed object is high compared to a portion where the moving speed of the display object is slow. The image processing apparatus according to claim 1, comprising a portion having a data structure used. The decompression processing means performs a frame buffer storage process for storing the image data obtained by decompressing the compressed image data in any of a plurality of frame buffers in the decompression process,
Sprite image data storage means for storing sprite image data for displaying a sprite image;
From the sprite image data storage unit, when the reproduction display processing unit executes the moving image reproduction display processing based on the compressed moving image data in accordance with the image synthesis instruction included in the control information set by the control information setting unit. A sprite image is generated by reading out the sprite image data, and the sprite image is sequentially synthesized on each image in the moving image based on the compressed moving image data,
The control information setting means sets control information including the image composition instruction every frame period, and sets control information including an extension instruction every two frame periods. The image processing apparatus described.

Images