JP4749508B2 - Image decoding method - Google Patents

Description

  The present invention relates to an image decoding technique, and more particularly to a method for preferentially decoding a partial area of an image.

  In ISO / ITU-T, JPEG2000 using discrete wavelet transform (DWT) is standardized as a successor to JPEG (Joint Photographic Expert Group), which is a standard technology for compression coding of still images. JPEG2000 can encode a wide range of image quality from low bit rate encoding to lossless compression with high performance, and it is easy to realize a scalability function that gradually increases image quality. In addition, JPEG2000 provides various functions not found in the conventional JPEG standard.

  As one of the functions of JPEG2000, ROI encoding that encodes and transmits a region of interest (ROI) of an image with priority over other regions is standardized. With ROI encoding, when there is an upper limit on the encoding rate, the reproduction image quality of the attention area can be preferentially made high quality, and when the encoded stream is sequentially decoded, the attention area is quickly improved in quality. Will be able to play.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for intensively improving image quality when an image in an important range designated by an operator is encoded.

JP-A-7-203434

  However, since the above-mentioned Patent Document 1 encodes images in a specified range and other ranges with specified image quality, the image is limited by the image quality when decoded, and is decoded at various resolutions. It was difficult to do. Also, it has been difficult to realize a reproduction process such as reproducing only a specified range.

  The present invention has been made in view of these problems, and an object of the present invention is to realize various processes that make use of the decoding side when a region of interest is specified for a part of the image. It is to provide a decoding method.

  In order to solve the above-described problem, an image encoding method according to an aspect of the present invention explicitly includes information for identifying a region of interest defined on an image in an encoded stream including encoded data of the image. Describe in. The “information for specifying the region of interest” may be information encoded with reference to difference information between frames. This “difference information” may indicate at least one of the position, size, and shape of the region of interest by the amount of change between frames. Further, it may be a difference between at least one average value of values representing the position, size, and shape of the region of interest in each frame, and their corresponding values in the encoding target frame. Alternatively, the difference between the average value of the amount of change between at least one frame of the value representing the position, size, and shape of the region of interest and the amount of change in the corresponding value between frames in the encoding target frame. Also good. Furthermore, it may be a difference between the average value of the amount of change between frames and at least one of the values representing the position, size, and shape of the region of interest in each frame. These are effective when the region of interest is greatly enlarged or reduced. “Information for identifying a region of interest defined on an image” may be encoded as a function of time. This is effective when the attention area changes with a certain regularity.

  According to this aspect, by explicitly describing the above-described information in the encoded stream, when the attention area is set in the image, it is possible to provide useful information to the decoding side, and various processes relating to the attention area Can be realized.

  Another aspect of the present invention is an image encoding device. This apparatus includes an attention area setting section that defines an attention area on an image, an image encoding section that encodes an image, an attention area information encoding section that encodes information for specifying the attention area, And an encoded stream generation unit that explicitly includes the information and generates an encoded stream. The “attention area setting unit” may define an attention area on the image by user designation or by automatically recognizing an object or the like.

  According to this aspect, by explicitly describing the above information in the encoded stream and generating the encoded stream, it is possible to provide useful information to the decoding side when a region of interest is set in the image. Various processes related to the attention area can be realized.

  The information described above includes the priority when a plurality of attention areas are set in the image. According to this aspect, the priority of a plurality of attention areas can be recognized on the decoding side, and finer processing can be performed.

  When a plurality of attention areas are defined on the image, the above-described information may be described in order of priority. According to this aspect, it is possible to make the decoding side recognize the priorities of a plurality of attention areas with a small code amount.

  Yet another embodiment of the present invention is also an image decoding method. This method includes the region of interest with reference to information for specifying a region of interest defined on the moving image, which is explicitly described in an encoded stream including encoded data of the moving image. A region is decoded from the encoded stream.

Yet another aspect of the present invention is an image decoding method. This method encodes a region including a region of interest by referring to information for specifying a region of interest defined on the image that is explicitly described in an encoded stream including encoded data of the image. Decode from the stream. The “area including the attention area” may be an attention area, an area including the attention area and its peripheral area, or an entire image area.
According to this aspect, it is possible to realize various processes related to the attention area by referring to the information explicitly described in the encoded stream.

  Yet another embodiment of the present invention is also an image decoding device. The apparatus includes a region-of-interest information decoding unit that decodes information for specifying a region of interest defined on the moving image, which is explicitly described in an encoded stream including encoded data of the moving image. An image decoding unit that decodes a region including the region of interest from the encoded stream with reference to the decoded information.

Yet another embodiment of the present invention is an image decoding device. This apparatus includes an attention area information decoding unit that decodes information for specifying an attention area defined on an image that is explicitly described in an encoded stream including encoded data of an image, and decoded information. , And an image decoding unit that decodes a region including the region of interest from the encoded stream.
According to this aspect, it is possible to realize various processes related to the attention area by referring to the information explicitly described in the encoded stream.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a computer program, a recording medium, and the like are also effective as an aspect of the present invention.

  According to the present invention, when a region to be focused on a part of an image is designated, various processes using the decoding can be realized.

1 is a configuration diagram of an image encoding device according to Embodiment 1. FIG. It is a figure which shows an example of the transition of a ROI area | region. It is a figure which shows an example of an encoding stream. 6 is a configuration diagram of an image decoding device according to Embodiment 2. FIG. It is a figure which shows the ROI area | region in each division | segmentation level.

Embodiment 1
FIG. 1 is a configuration diagram of an image encoding device 100 according to Embodiment 1. The configuration of the image encoding apparatus 100 can be realized in hardware by a CPU, memory, or other LSI of an arbitrary computer, and is realized by a program having an encoding function loaded in a memory in software. However, here, functional blocks that are realized by their cooperation are depicted. Accordingly, those skilled in the art will understand that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  The image encoding apparatus 100 compresses and encodes the input original image as an example using the JPEG2000 method. The original image input to the image encoding device 100 is a moving image frame. The image encoding device 100 can continuously encode each frame of a moving image by the JPEG2000 system to generate a moving image encoded stream.

  The wavelet transform unit 10 divides the input original image into subbands, calculates wavelet transform coefficients of each subband image, and generates layered wavelet transform coefficients. Specifically, the wavelet transform unit 10 applies a low-pass filter and a high-pass filter in the x and y directions of the original image, divides it into four frequency subbands, and performs wavelet transform. These subbands are LL subbands having low frequency components in both x and y directions, and HL subbands having low frequency components in either one of x and y directions and high frequency components in the other direction. And an HH subband having a high frequency component in both the x and y directions. The number of vertical and horizontal pixels in each subband is ½ that of the image before processing, and a subband image having a resolution, that is, a quarter of the image size, can be obtained by one filtering.

  Of the subbands thus obtained, the wavelet transform unit 10 performs the filtering process again on the LL subband, further divides it into four subbands LL, HL, LH, and HH, and performs wavelet transform. . The wavelet transform unit 10 performs this filtering a predetermined number of times, hierarchizes the original image into subband images, and outputs wavelet transform coefficients for each subband. The quantization unit 12 quantizes the wavelet transform coefficient output from the wavelet transform unit 10 with a predetermined quantization width.

  The entropy encoding unit 14 entropy encodes the quantization value quantized by the quantization unit 12. For example, encoding is performed while scanning sequentially from the upper bit brain. Thus, the encoding target of the entropy encoding unit 14 is an original image and functions as an image encoding unit.

  The ROI setting unit 20 sets an ROI area in a partial area of the original image. The shape of the ROI region may be a rectangle, a circle, or other complex shapes. Its shape may be fixed or dynamically changing. For example, the shape of the ROI region may be changed between the central portion and the peripheral portion of the image. A plurality of ROI areas may be set for one image.

  Such an ROI region may be set manually by the user, or the region in which the system is moving may be automatically recognized and set. Specifically, the user or the system sets the position, size, shape, priority order when a plurality of ROI areas are set, and the like in the ROI setting unit 20 as initial values. When the user designates an object or when the system automatically recognizes, the ROI setting unit 20 may automatically set a predetermined range including the object in the ROI area. In the case of a moving image, the user or the system may set the ROI area for each frame, specify the ROI area first, and thereafter cause the ROI area to follow the movement of the object in the ROI area. . This can be realized by detecting the motion vector of the object.

  The ROI setting unit 20 outputs information for specifying the ROI region (hereinafter referred to as ROI information) such as the start position and size of the ROI region to the ROI prediction processing unit 22. When the tracking process described above is performed, a motion vector of the ROI area set based on the motion vector of the object may be output.

  The ROI prediction processing unit 22 performs inter-frame prediction processing on the ROI information. The ROI prediction processing unit 22 includes a memory for storing ROI information. For example, the ROI prediction processing unit 22 stores ROI information of a reference frame therein and calculates difference information from the current frame.

  FIG. 2 is a diagram illustrating an example of transition of the ROI region. FIG. 2A shows a state in which the ROI region R is set in the image. Since this ROI region R is rectangular, it can be expressed by the top left vertex coordinates, the horizontal size, and the vertical size. Here, this is expressed as coordinates (A, B) and size (X, Y). First, the ROI prediction processing unit 22 outputs these pieces of information as ROI information to the ROI information encoding unit 24 and stores them in the memory. This frame is a reference for the next frame.

  FIG. 2B shows a frame next to the frame shown in FIG. 2A, and shows a state where the ROI region R has moved. Here, in the image, the ROI region R has moved to the right by M1 pixels. When the ROI information of this ROI region R is expressed by the same method as described above, it is expressed as coordinates (A + M1, B) and size (X, Y). In this regard, the ROI prediction processing unit 22 can express the ROI information of the current frame with the difference using the ROI information of the previous frame stored in the memory. For example, when the ROI information of the previous frame is subtracted from the ROI information generated in the current frame, it can be expressed as coordinates Δ (M1, 0) and size Δ (0, 0). The ROI prediction processing unit 22 outputs the ROI information to the ROI information encoding unit 24 again and stores it in the memory.

  FIG. 2C shows a frame next to the frame shown in FIG. 2B, and shows a state where the ROI region R has moved and the shape of the ROI region R itself has changed. Here, in the image, the ROI region R has moved down by N2 pixels, and the ROI region R has increased by M2 pixels in the horizontal direction. When the ROI information of the current frame is expressed by the same method as described above using the ROI information of the previous frame stored in the memory, the ROI prediction processing unit 22 has coordinates Δ (0, −N2) and size Δ It can be expressed as (M2,0). The ROI prediction processing unit 22 outputs the ROI information to the ROI information encoding unit 24 again and stores it in the memory.

  In this way, when the inter-frame prediction process is used, the appearance frequency of 0 and its neighboring values is increased, and the ROI information can be statistically biased. If such ROI information is entropy encoded by the ROI information encoding unit 24 described later, the code amount can be reduced. Entropy encoding can reduce the amount of codes as the appearance frequency bias increases.

  Note that the inter-frame prediction process is not limited to the above-described process of simply taking a difference from the previous frame, and for example, a motion compensation prediction process may be used. In the motion compensation prediction process, a motion vector indicating the direction and distance in which the ROI region R has moved is obtained, and the difference between the position information represented by this motion vector and the current frame can be used as ROI information. In particular, it is possible to increase the appearance frequency of 0 and its neighboring values for a moving image with a large movement in the ROI region R. As described above, the frame to be subjected to the inter-frame prediction is not limited to the previous frame, but may be the next future frame. Furthermore, not only one frame before and after, but also processing using the average value using several frames before and after can be realized.

  Of course, it is also possible to generate ROI information within each frame without using inter-frame prediction processing. In that case, memory capacity and calculation amount can be reduced. Therefore, the user may be able to select whether to use inter-frame prediction processing according to the characteristics of the moving image. In particular, in the case of a fast moving image, even if the inter-frame prediction process is used, the code amount may not be reduced much in spite of the increase in the calculation amount. In such a case, ROI information may be simply generated for each frame.

  The ROI information encoding unit 24 encodes the ROI information input from the ROI prediction processing unit 22. For example, entropy encoding is performed. Then, the encoded ROI information is output to the encoded stream generation unit 16.

  The encoded stream generation unit 16 generates an encoded stream based on the encoded data of the image input from the entropy encoding unit 14, the encoded data of the ROI information input from the ROI information encoding unit 24, and the like. . Then, the generated encoded stream is output to a recording medium or a network. Here, SDRAM, a flash hard disk drive, etc. can be used as a recording medium.

  The encoded data of ROI information is described in the header. There are various levels in the header, but they can be described at any level. For example, ROI information can be described in a stream header, a sequence header, a GOP (Group of Picture) header, a frame header, a picture header, a header attached in units of areas, and the like.

  The header attached in units of the areas refers to the following headers. For example, when a plurality of ROI areas are set in one frame or picture, the frames and pictures are arranged in the order of image data of ROI area 1 → image data of ROI area 2 →. To do. The header is a header attached to each image data of the ROI area 1 and image data of the ROI area 2 at such time.

  FIG. 3 is a diagram illustrating an example of an encoded stream. Here, the encoded stream is indicated by the term sequence used in MPEG (Moving Picture Experts Group). In MPEG, an encoded signal of one entire video program is called a sequence. As shown in FIG. 3, the sequence starts with a sequence header, ends with a sequence end, and describes a plurality of GOPs therebetween. GOP describes a GOP header and a plurality of pictures. In the example of FIG. 3, a plurality of ROI information is described in this GOP header. Various parameters necessary for decoding such as encoding conditions are described in the GOP header. In the present embodiment, ROI information is also described there.

  The ROI information described above is information indicating vertex coordinates and size. In this regard, the ROI information is not limited to such information, but can include various types of information, and the ROI information can be specified by such information. Examples are given below.

  First, the basic coordinates are required. As described above, vertex coordinates, center point coordinates, barycentric coordinates, and the like are applicable. From these, coordinates suitable for the shape of the ROI region can be used. For example, when the ROI region is a circle, the center point coordinates are optimum coordinates. Next, when the ROI area is specified by the information in each frame, the size is necessary. For example, a horizontal size and a vertical size are required. Next, when using inter-frame prediction processing, difference data from the previous frame, difference data from the subsequent frame using motion vectors, coefficients of various functions such as affine transformation coefficients, and the like can be used.

  Next, when a plurality of ROI areas are set for one image, the priority may be included in the ROI information. For example, not only the priority order but also information such as whether the display of the ROI area is essential may be included. Further, this priority order may be expressed in the order of ROI information. That is, it is possible to use a method in which the information of the ROI region with higher priority is described earlier. Moreover, you may include the information content of each ROI area | region. For example, the code amount, compression rate, calculation amount, etc. of the ROI area. Further, the image quality for each ROI region and the image quality ratio with other regions may be included.

  Furthermore, information indicating whether or not the ROI area can be independently decoded may be included. For example, in the JPEG2000 system, three types of processing paths, an S pass (significance propagation pass), an R pass (magnitude refinement pass), and a C pass (cleanup pass), are used as each coefficient bit in the bit plane. In the S pass, a non-significant coefficient around which a significant coefficient exists is decoded, in the R pass, a significant coefficient is decoded, and in the C pass, the remaining coefficients are decoded. Each processing pass of the S pass, R pass, and C pass has a large contribution to the image quality in this order. Each processing pass is executed in this order, and the context of each coefficient is determined in consideration of information on neighboring coefficients. Therefore, when encoding is performed independently for each pass, variable length decoding can be interrupted. Such information is useful information for the decoding side. In addition, as long as the information can be used as useful information at the time of decoding, information other than the above-described examples may be included in the ROI information. In addition, although the example which describes ROI information in a header was demonstrated, you may describe in the user area | region which a user can use freely.

  As described above, according to the first embodiment, information necessary or useful for decoding the ROI region is explicitly included in the encoded stream as ROI information, so that various information can be utilized on the decoding side. Can be realized. For example, when fast-forward playback is performed, an ROI area or an area including several pixels around the ROI area can be taken out and easily reproduced and displayed.

  Also, by encoding ROI information using inter-frame prediction processing, the amount of code of ROI information can be reduced. For example, in JPEG2000, since an image is handled as a still image and encoded, ROI information must be provided for each image when encoding the ROI area. For this reason, when ROI encoding is performed on an image having no motion, the same ROI information is added to each successive image data, and a wasteful code is generated as a whole. become. In such a case, the aspect using the inter-frame prediction process is particularly effective. Furthermore, by reducing the amount of codes, the processing can be speeded up and the power consumption can be reduced.

Embodiment 2
FIG. 4 is a configuration diagram of the image decoding apparatus 200 according to Embodiment 2. In the second embodiment, the image decoding apparatus 200 decodes the encoded stream encoded in the first embodiment. A moving image can be reproduced by continuously decoding each encoded frame of a moving image input as an encoded stream.

  The ROI information decoding unit 40 decodes the ROI information described in the encoded stream and outputs it to the ROI prediction processing unit 42. The ROI information is described in a header at any level in the encoded stream.

  The ROI prediction processing unit 42 performs inter-frame prediction processing on the decoded ROI information. The ROI prediction processing unit 42 includes a memory for storing ROI information. For example, the ROI prediction processing unit 42 stores ROI information of a reference frame. By adding the ROI information of the current frame given by the difference information and the ROI information stored in the memory, the ROI information of the current frame is restored to the original data format.

  For example, when the ROI area of the reference frame is a rectangle, the ROI area is expressed by the upper left vertex coordinates (A, B), the horizontal size, and the vertical size (X, Y). Can do. First, the ROI prediction processing unit 42 outputs these pieces of information as ROI information to the ROI region control unit 44 and stores them in the memory. This frame is a reference for the next frame.

  When ROI information is encoded using the method of the first embodiment, assuming that the ROI area has moved to the right by M1 pixels in the next frame, the difference information is coordinate Δ (M1, 0), large ΔI (0, 0) and ROI information are given. The ROI prediction processing unit 42 calculates the absolute coordinates (A + M1, B) and size (X, Y) of the current frame by adding this difference information to the ROI information of the previous frame stored in the memory. be able to.

  In this way, the ROI prediction processing unit 42 decodes and acquires the ROI information of the next screen before decoding the image. As a result, various processes relating to the ROI region can be performed. When other inter-frame prediction encoding is used, a restoration method corresponding to that is used.

  The ROI area control unit 44 sets various processes related to the ROI area according to a user or system request. For example, it is possible to perform processing for reproducing only an image in the ROI area or an area including its peripheral pixels. A method for determining this peripheral pixel will be described later. In addition, when searching for a scene using object recognition, a search process for only objects in the ROI area is also possible. In either case, high-speed processing is possible. When performing these processes, the processes can be performed with reference to the priority information included in the ROI information. For example, an ROI area that is not required to be displayed or has a low priority may not be displayed, or may be excluded from the search target.

  In addition, the ROI area control unit 44 can set the image quality of the ROI area and the image quality ratio with other areas according to the designation by the ROI information and the request of the user or the system.

  The encoded data extraction unit 30 extracts encoded data from the input encoded stream. At that time, there are cases where only the encoded data of the area designated by the ROI area control unit 44 is extracted. The entropy decoding unit 32 decodes the extracted encoded data for each bit plane, and obtains a quantized wavelet transform coefficient obtained as a result of the decoding. The inverse quantization unit 34 inversely quantizes the wavelet transform coefficient. The wavelet inverse transform unit 36 inversely transforms the inversely quantized wavelet transform coefficients and outputs the obtained decoded image.

  Next, a method for determining the coordinates and size of the region including the ROI region and its peripheral region by the ROI region control unit 44 will be described. FIG. 5 is a diagram showing ROI regions at each division level of wavelet transform coefficients. FIG. 5A shows a state in which the ROI area 90 is set on the original image 80 at the division level 0. FIG. FIG. 5B shows a converted image 82 at the division level 1 obtained by performing the wavelet transform on the original image 80 only once. The division level 1 converted image 82 includes four subbands LL1, HL1, LH1, and HH1. The ROI region control unit 44 converts the ROI regions 91 to 94 on the conversion image 82 at the division level 1 necessary for restoring the ROI region 90 of the original image 80 into the sub-bands LL1, HL1, LH1, Specified in HH1.

  FIG. 5C shows a conversion image 84 at the division level 2 obtained by further wavelet transforming the subband LL1 of the lowest frequency component of the conversion image 82 of FIG. 5B. As shown in the figure, the division level 2 converted image 84 includes four subbands LL2, HL2, LH2, and HH2 at division level 2 in addition to the three subbands HL1, LH1, and HH1 at division level 1. The ROI region control unit 44 converts the ROI regions 95 to 98 on the divided level 2 transformed image 84 necessary for restoring the ROI region 91 in the subband LL1 of the divided level 1 transformed image 82 into the subbands LL2 and HL2. , LH2, and HH2.

  Similarly, the ROI area 90 corresponding to the ROI area 90 of the original image 80 is recursively specified at each division level by the number of wavelet transforms, thereby restoring the ROI area 90 in the final division level converted image. Therefore, it is possible to specify all the ROI conversion areas necessary for the purpose.

  The ROI region control unit 44 performs wavelet transform to be decoded in each subband at each division level so as to decode up to the original image 80 without generating noise in the peripheral region of the ROI region set on the original image 80. The starting position and size of the target area of the coefficient are determined. It is set in the encoded data extraction unit 30.

  When the x or y coordinate where the ROI region starts in the original image 80 is P and the size of the ROI region in the x or y direction is Q, the start coordinate and size of the decoding target region at each division level are as follows. become.

Division level 1 ... start coordinate P / 2-α, size Q / 2 + β
Division level 2 ... start coordinate (P / 2-α) / 2-α, size (Q / 2 + β) / 2 + β
Division level 3 ... start coordinates {(P / 2-α) / 2-α} / 2-α,
Size {(Q / 2 + β) / 2 + β} / 2 + β
Division level J: start coordinate [...] / 2-α, size [...] / 2 + β

  By performing the above calculation for x and y, the starting coordinates and size of the decoding target area at each division level can be obtained. At the start coordinate, if a decimal point occurs in the value immediately before subtracting the last α, it is rounded down. On the other hand, in terms of magnitude, if a fractional part occurs in the value immediately before adding the last β, it is rounded up. The values of α and β can be arbitrarily set by the designer. For example, α = 1, β = 2, α = 2, β = 4 can be set. When the peripheral area is provided symmetrically on the top, bottom, left, and right of the ROI area, β is twice the value of α. This value depends on the filter used. As the number of times of filtering increases, it is better to take more pixels in the peripheral area.

  As described above, according to the second embodiment, it is possible to decode ROI information explicitly described in an encoded stream and implement various processes by utilizing the information. For example, it is possible to extract an ROI area or an area including peripheral pixels and easily reproduce and display it. Also, the ROI area and other areas can be reproduced with desired image quality.

  The present invention has been described based on the embodiments. The embodiments are exemplifications, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are within the scope of the present invention. . Such a modification is shown below.

  In the above embodiment, the ROI area may be an object-only area. In this case, the system can describe information for specifying the object in the header or the like as the ROI information. Similar to the embodiment, by describing the information on the shape change of the object using the inter-frame prediction processing, the code amount of the information can be reduced.

  In the above-described embodiment, the encoded stream of the moving image continuously encoded by the JPEG2000 method is decoded. That's fine.

  In the above embodiment, the wavelet transform has been described as spatial filtering for image coding, but other spatial frequency transforms may be used. For example, discrete cosine transform used in the JPEG standard may be used.

  10 wavelet transform unit, 12 quantization unit, 14 entropy encoding unit, 16 encoded stream generation unit, 20 ROI setting unit, 22 ROI prediction processing unit, 24 ROI information encoding unit, 30 encoded data extraction unit, 32 entropy Decoding unit, 34 Inverse quantization unit, 36 Wavelet inverse transform unit, 40 ROI information decoding unit, 42 ROI prediction processing unit, 44 ROI region control unit, 100 image encoding device, 200 image decoding device

Claims (7)

Region-of- interest information decoding step for decoding region- of- interest information for specifying a plurality of regions of interest defined on the image, which are explicitly described in an encoded stream including encoded data of the image;
An image decoding step of referring to the decoded attention area information and decoding the area including the attention area from the encoded stream,
The region-of-interest information decoding step obtains information indicating a priority order among a plurality of regions of interest included in the region-of-interest information and information indicating whether display of each region of interest is essential,
The image decoding step refers to information indicating whether or not display of each region of interest is essential, removes the region of interest that is not essential to display, and decodes the region including the remaining region of interest,
The image decoding method, wherein the attention area is an area set by a user. Region-of- interest information decoding step for decoding region- of- interest information for specifying a plurality of regions of interest defined on the image, which are explicitly described in an encoded stream including encoded data of the image;
An image decoding step of referring to the decoded attention area information and decoding the area including the attention area from the encoded stream,
The region-of-interest information decoding step obtains information indicating a priority order among a plurality of regions of interest included in the region-of-interest information and information indicating whether display of each region of interest is essential,
The image decoding step refers to information indicating whether or not display of each region of interest is essential, removes the region of interest that is not essential to display, and decodes the region including the remaining region of interest,
The attention area is a predetermined range including an object when the user designates the object. In the image decoding step, the attention area to be displayed is selected with reference to the information indicating the priority order among the plurality of attention areas, and the other attention areas are excluded from the display objects and selected as the display objects. 3. The image decoding method according to claim 1, wherein a region including the region of interest is decoded. The image decoding step refers to information indicating the priority order between the plurality of attention areas, selects attention areas to be displayed during fast-forward playback, and removes the other attention areas from the display objects. The image decoding method according to claim 3. Region-of- interest information decoding step for decoding region- of- interest information for specifying a plurality of regions of interest defined on the moving image, which are explicitly described in an encoded stream including encoded data of the moving image;
An image decoding step of referring to the decoded attention area information and decoding the area including the attention area from the encoded stream,
The region-of-interest information decoding step obtains information indicating a priority order among a plurality of regions of interest included in the region-of-interest information and information indicating whether display of each region of interest is essential,
The image decoding step refers to information indicating whether or not display of each region of interest is essential, removes the region of interest that is not essential to display, and decodes the region including the remaining region of interest,
An image decoding method, wherein information for specifying a plurality of regions of interest defined on the moving image is described in a group unit in which a plurality of frames of the moving image are collected. In the image decoding step, the attention area to be displayed is selected with reference to the information indicating the priority order among the plurality of attention areas, and the other attention areas are excluded from the display objects and selected as the display objects. 6. The image decoding method according to claim 5, wherein a region including the region of interest is decoded. The image decoding step refers to information indicating the priority order between the plurality of attention areas, selects attention areas to be displayed during fast-forward playback, and removes the other attention areas from the display objects. The image decoding method according to claim 6.

Images