TWI524739B - Sample adaptive offset (sao) in accordance with video coding - Google Patents

Description

Sample Point Adaptive Offset (SAO) based on video encoding

The present invention generally relates to digital video processing; and more particularly to processing and operations in accordance with the digital video processing.

Communication systems that operate to transfer digital media (eg, images, video, data, etc.) have been in development for many years. For such a communication system employing some form of video data, a plurality of digital images are output or displayed at a certain frame rate (for example, frames per second) to realize video signals suitable for output and consumption. In a plurality of such communication systems operating with video data, the video and the throughput (e.g., the number of image frames that can be transmitted from the first location to the second location) and the signal that is ultimately to be output or displayed / or there is a compromise between image quality. The current technology does not provide sufficient or acceptable means to provide video data from a first location to a second location based on providing sufficient or acceptable video and/or image quality to ensure communication-related A relatively small amount of overhead, and relatively low complexity of communication devices at each communication link end.

(1) A communication device apparatus comprising: at least one input for receiving a video signal from at least one additional device; and receiving a plurality of band offsets from the at least one additional device via signaling; and a processor for And analyzing: a plurality of pixels related to at least one maximum coding unit (LCU) Generating a prime value distribution, wherein the maximum coding unit is related to the video signal; inferringly identifying a plurality of frequency band indices based on the pixel value distribution; and filtering according to the video signal or a signal based on the video signal Processing, applying the plurality of frequency band offsets to the plurality of frequency band indices; performing sample point adaptive offset (SAO) filtering processing on the video signal or the signal based on the video signal to generate a first filtered signal, The sampling point adaptive offset filtering process applies the multiple frequency band offsets to the plurality of frequency band indices; and performs deblocking filtering processing on the first filtered signals to generate a second filtered signal.

(2) The communication device device of (1), wherein the processor is configured to: analyze a plurality of pixels associated with the at least one maximum coding unit to generate a pixel value histogram representing the pixel value distribution a picture, wherein the maximum coding unit is associated with the video signal; and based on the pixel value histogram, identifying the plurality of frequency band indices to which the plurality of frequency band offsets are to be applied.

(3) The communication device device of (1), wherein: the plurality of band indices have a discontinuous distribution such that at least two consecutive band indices of the plurality of band indices are separated from each other by at least one band index value .

(4) The communication device device of (1), wherein: the pixel value distribution indicates a plurality of subsets of the plurality of pixels respectively associated with at least a portion of the plurality of band indices; The plurality of frequency band indices to be applied to the plurality of frequency band offsets correspond to at least one subset of the plurality of subsets of the plurality of pixels, wherein the at least one subset and the plurality of pixels Other subsets in multiple subsets have a relatively larger or largest number of pixels.

(5) The communication device device according to (1), wherein: The device is a communication device operating in at least one of a satellite communication system, a wireless communication system, a wired communication system, a fiber optic communication system, and a mobile communication system.

(6) A communication device apparatus comprising: an input for receiving a video signal and a plurality of band offsets from at least one additional device; and a processor for: analyzing a plurality of associated with at least one maximum coding unit (LCU) a pixel to identify a pixel value distribution for identifying a plurality of band indices, the maximum coding unit being associated with the video signal; and filtering processing according to the video signal or a signal based on the signal of the video signal A plurality of band offsets are applied to the plurality of band indices.

(7) The communication device device of (6), wherein the processor is configured to: perform a sample point adaptive offset (SAO) filtering process on the video signal or a signal based on the video signal to generate a first a filter signal, wherein the sample point adaptive offset filter process applies the plurality of band offsets to the plurality of band indices; and performs deblocking filtering processing on the first filter signal to generate a second Filter signal.

(8) The communication device device of (6), wherein the processor is configured to: analyze a plurality of pixels associated with the at least one maximum coding unit to generate a pixel value histogram representing the pixel value distribution And wherein the maximum coding unit is associated with the video signal; and based on the pixel value histogram, identifying a plurality of frequency band indices to which the plurality of frequency band offsets are to be applied.

(9) The communication device device of (6), wherein: the plurality of band indices have a discontinuous distribution such that the plurality of band indices At least two consecutive frequency band indices are separated from each other by at least one band index value.

(10) The communication device device of (6), wherein: the pixel value distribution indicates a plurality of subsets of the plurality of pixels respectively associated with at least a portion of the plurality of band indices; The plurality of frequency band indices to be applied to the plurality of frequency band offsets correspond to at least one subset of the plurality of subsets of the plurality of pixels, wherein the at least one subset and the plurality of pixels Other subsets in multiple subsets have a relatively larger or largest number of pixels.

(11) The communication device device of (6), wherein: the plurality of band offsets are received by the device from the at least one additional device via signaling; and the processor is configured to be based on the pixels The value distribution inferentially identifies the plurality of band indices.

(12) The communication device device of (6), wherein: the communication device device is a receiver communication device including a video decoder; the at least one additional device is a transmitter communication device including a video encoder; The receiver communication device and the transmitter communication device are coupled or communicatively coupled via at least one communication channel.

(13) The communication device device according to (6), wherein: the communication device device is a communication operation in at least one of a satellite communication system, a wireless communication system, a wired communication system, a fiber-optic communication system, and a mobile communication system. device.

(14) A method of operating a communication device, the method comprising: receiving, via an input of the communication device, a video signal and a plurality of frequency band offsets from at least one additional communication device; analyzing and at least one maximum coding unit (LCU) Correlated multiple pixels to identify a pixel value distribution for identifying a plurality of band indices, wherein the maximum code list The element is associated with the video signal; and applying the plurality of frequency band offsets to the plurality of frequency band indices according to the video signal or a filtering process based on the signal of the video signal.

(15) The method for operating a communication device according to (14), further comprising: performing a sample point adaptive offset (SAO) filtering process on the video signal or a signal based on the video signal to generate a first filtered signal The sampling point adaptive offset filtering process includes applying the plurality of frequency band offsets to the plurality of frequency band indices; and performing deblocking filtering processing on the first filtered signal to generate a second filtered signal .

(16) The method of operating a communication device according to (14), further comprising: analyzing a plurality of pixels associated with the at least one maximum coding unit to generate a pixel value histogram representing the pixel value distribution, Wherein the maximum coding unit is associated with the video signal; and based on the pixel value histogram, identifying a plurality of frequency band indices to which the plurality of frequency band offsets are to be applied.

(17) The method of operating a communication device according to (14), wherein: the plurality of band indices have a discontinuous distribution such that at least two consecutive band indices of the plurality of band indices are separated from each other by at least one band Index value.

(18) The method of operating a communication device according to (14), wherein: the pixel value distribution indicates a plurality of subsets of the plurality of pixels respectively associated with at least a portion of the plurality of frequency band indices And the plurality of frequency band indices to be applied to the plurality of frequency band offsets corresponding to at least one subset of the plurality of subsets of the plurality of pixels, wherein the at least one subset and the plurality of pictures The other subsets of the plurality of primes have a relatively large or maximum number of pixels.

(19) The operating method of the communication device according to (14), further comprising: receiving the plurality of frequency band offsets from the at least one additional communication device via signaling Shifting; and inferringly identifying the plurality of band indices based on the pixel value distribution.

(20) The operating method of the communication device according to (14), wherein the communication device operates in at least one of a satellite communication system, a wireless communication system, a wired communication system, a fiber-optic communication system, and a mobile communication system.

100‧‧‧Communication system

110‧‧‧Communication equipment

112‧‧‧transmitter

114‧‧‧Encoder

116‧‧‧ Receiver

118‧‧‧Decoder

120‧‧‧Communication equipment

122‧‧‧ Receiver

124‧‧‧Decoder

126‧‧‧transmitter

128‧‧‧Encoder

130‧‧‧Satellite communication channel

132‧‧‧Satellite antenna

134‧‧‧Satellite antenna

140‧‧‧Wireless communication channel

142‧‧‧ tower

144‧‧‧ tower

150‧‧‧Wired communication channel

152‧‧‧Local antenna

154‧‧‧Local antenna

160‧‧‧Fiber communication channel

162‧‧‧Electrical (E/O) interface

164‧‧‧Photoelectric (O/E) interface

199‧‧‧Communication channel

200‧‧‧Communication system

201‧‧‧Message Bits

202‧‧‧ encoded information bits

203‧‧‧Discrete value modulation symbol sequence

204‧‧‧Continuous time transmission signal

205‧‧‧Filtered continuous time transmission signal

206‧‧‧Continuous time to receive signals

207‧‧‧Filtered continuous time reception signal

208‧‧‧Discrete time receiving signal

209‧‧‧ metrics

210‧‧‧Best estimate of discrete-valued modulation symbols and the information bits encoded therein

220‧‧‧Encoder and symbol mapper

222‧‧‧Encoder

224‧‧‧symbol mapper

230‧‧‧Transmission driver

232‧‧‧Digital Analog Converter (DAC)

234‧‧‧Transmission filter

260‧‧‧ analog front end (AFE)

262‧‧‧ Receive Filter

264‧‧‧ Analog Digital Converter (ADC)

270‧‧‧Metric Generator

280‧‧‧Decoder

280a‧‧‧Processing Module

280b‧‧‧Processing module

297‧‧‧transmitter

298‧‧‧ Receiver

299‧‧‧Communication channel

301‧‧‧ computer

302‧‧‧Note Computer

303‧‧‧High Definition (HD) TV

304‧‧‧Standard Definition (SD) TV

305‧‧‧Handheld media unit

306‧‧‧Set-top box (STB)

307‧‧‧Digital Video Disc (DVD) Player

308‧‧‧Common digital image and / or video processing equipment

400‧‧‧ Implementation

500‧‧‧ implementation

600‧‧‧ implementation

700‧‧‧ Implementation

800‧‧‧ Implementation

900‧‧‧ implementation

1000‧‧‧ implementation

1100‧‧‧ Implementation

1200‧‧‧ implementation

1300‧‧‧ implementation

1400‧‧‧ implementation

1500‧‧‧ implementation

1600‧‧‧ implementation

1700‧‧‧ Implementation

1800‧‧‧ method

1810~1830‧‧‧ box

1900‧‧‧ method

1910~1940‧‧‧ box

Figures 1 and 2 illustrate various embodiments of a communication system.

Figure 3A shows an embodiment of a computer.

Figure 3B shows an embodiment of a notebook computer.

Figure 3C illustrates an embodiment of a high definition (HD) television.

Figure 3D illustrates an embodiment of a standard definition (SD) television.

Figure 3E illustrates an embodiment of a handheld media unit.

Figure 3F shows an embodiment of a set-top box (STB).

Figure 3G illustrates an embodiment of a digital video disc (DVD) player.

Figure 3H illustrates an embodiment of a general purpose digital image and/or video processing device.

4, 5, and 6 are diagrams showing various embodiments of a video coding architecture.

FIG. 7 is a diagram showing an embodiment of intra prediction processing.

FIG. 8 is a diagram showing an embodiment of an inter prediction process.

9 and 10 are diagrams showing various embodiments of a video decoding architecture.

Figure 11 illustrates an embodiment of a band offset sample point adaptive offset (SAO) filtering process.

Figure 12 illustrates an alternate embodiment of a video coding architecture.

Figure 13 illustrates various embodiments of an indication (adaptive and/or explicit signaling) of a transmission band offset in a Sample Point Adaptive Offset (SAO) band offset mode.

Figure 14 illustrates various embodiments of an indication of frequency band granularity (adaptive and/or explicit signaling) in the SAO band offset mode.

Figure 15 illustrates an embodiment of implicit band index signaling.

Figure 16 illustrates an alternate embodiment of implicit band index signaling.

Figure 17 illustrates an embodiment of band offset coding.

18 and 19 illustrate various embodiments of a method for operating one or more devices (eg, communication devices, receivers and/or decoder devices, transmitters, and/or encoder devices, etc.).

In a plurality of devices using digital media, such as digital video, each image is represented by a pixel (which is digital in nature). In some communication systems, digital media can be transferred from a first location to a second location where such media can be output or displayed. The purpose of digital communication systems, including communication systems for communicating digital video, is to transfer digital data from one location or subsystem to another without error or at an acceptable low bit error rate. As shown in Figure 1, data can be transmitted over various communication channels in various communication systems: magnetic media, wired, wireless, fiber optic, copper, and/or other types of media.

1 and 2 illustrate various embodiments of communication systems 100 and 200, respectively.

Referring to Figure 1, an embodiment of communication system 100 is a communication channel 199 that communicates communication device 110 (including transmitter 112 having encoder 114 and receiver 116 having decoder 118) at one end of communication channel 199. It is coupled to another communication device 120 (including a transmitter 126 having an encoder 128 and including a receiver 122 having a decoder 124) located at the other end of the communication channel 199. In some embodiments, one of the communication devices 110 and 120 may only include a transmitter or receiver. There are several different types of media through which communication channel 199 can be implemented (e.g., satellite communication channel 130 using dished satellite antennas 132 and 134, wireless communication channels using towers 142 and 144 and/or local antennas 152 and 154) 140. Wired communication channel 150 and/or fiber optic communication channel 160 using an electro-optic (E/O) interface 162 and an optoelectronic (O/E) interface 164. In addition, more than one type of medium can be implemented and interfaced together to form communication channel 199.

It is to be noted that without departing from the scope and spirit of the invention, The communication device 110 and/or 120 can be a stationary device or a mobile device. For example, one or both of communication devices 110 and 120 may be implemented at a fixed location or may have more than one network access point (eg, in a mobile communication system environment including one or more wireless local area networks (WLANs) Respective access points (APs), respective different satellites in a mobile communication system environment including one or more satellites, or typically in a mobile communication system environment including one or more network access points Each of the different network access points, through which the communication devices 110 and/or 120 can be utilized to enable communication, the ability to communicate and/or communicate with the mobile communication device.

Error correction and channel coding schemes are often used to reduce transmission errors that are unavoidable in communication systems. In general, these error correction and channel coding schemes involve the use of an encoder at the transmitter end of communication channel 199 and the use of a decoder at the receiver end of communication channel 199.

In any such desired communication system (eg, including those described with respect to FIG. 1), any message storage device (eg, a hard disk drive (HDD), network message storage device, and/or server, etc.) or Any of a variety of types of ECC codes described may be employed in any application in which the message is encoded and/or decoded.

In general, when considering the transmission of video data from one location or subsystem to another, it is generally considered that the video data is encoded at the transmission end of the communication channel 199. Generally, the video data can be decoded in the communication channel 199. The receiving end performs.

Similarly, although the embodiment of the diagram illustrates two-way communication between communication devices 110 and 120, it is to be noted that, in some embodiments, communication device 110 may only include video data encoding functionality, communication devices. 120 may only include video data decoding functionality and vice versa (eg, according to a one-way implementation of a video broadcast implementation).

Referring to the communication system 200 of FIG. 2, at the transmitting end of the communication channel 299, a message bit 201 (e.g., corresponding to video data in one embodiment) is provided to the transmitter 297, the transmitter being operable to utilize the encoder And symbol mapper 220 (can Encoder 222, which is considered to be an independent functional block, and symbol mapper 224, respectively, encodes coded information bits 202 to symbol mapper 224 for decoding of these message bits 201, thereby generating a series of discrete value modulation symbols. Sequence 203 provides the series of discrete value modulation symbols to transmit driver 230, which uses digital analog converter (DAC) 232 to generate continuous time transmission signal 204 and utilizes transmit filter 234 to generate substantially commensurate with communication channel 299. The filtered continuous time transmission signal 205. At the receiving end of communication channel 299, a continuous time receive signal 206 is provided to an analog front end (AFE) 260, which includes a receive filter 262 (which generates a filtered continuous time receive signal 207) and an analog digital converter (ADC). 264 (which generates a discrete time receive signal 208). The metric generator 270 calculates a metric 209 (e.g., based on symbols and/or bits) that the decoder 280 uses to best estimate the best estimated discrete value modulation symbols and the message bits encoded therein by the encoded message bits 210. .

In each of the transmitter 297 and the receiver 298, any desired integration of various components, blocks, functional blocks, circuits, and the like can be implemented therein. For example, the figure shows that processing module 280a includes an encoder and symbol mapper 220 and all associated corresponding components therein, showing that processing module 280b includes metric generator 270 and decoder 280 and all associated corresponding components therein. . Such processing modules 280a and 280b can be corresponding integrated circuits. Of course, other boundaries and groupings may alternatively be made without departing from the scope and spirit of the invention. For example, all components in the transmitter 297 may be included in the first processing module or integrated circuit, and all components in the receiver 298 may be included in the second processing module or integrated circuit. Alternatively, the components in each of the transmitter 297 and the receiver 298 can be arbitrarily combined in other embodiments.

As with the previous embodiments, such communication system 200 can be used for communication of video data from one location or subsystem to another (e.g., from transmitter 297 to receiver 298 via communication channel 299).

It can be realized by any of the respective devices shown in FIG. 3A to FIG. 3H below. The video processing of digital images and/or digital images and/or media (including individual images of digital video signals) allows the user to view such digital images and/or video. These various devices do not include an exhaustive list of devices in which the image and/or video processing described herein can be implemented, it being noted that any general purpose digital image can be implemented without departing from the scope and spirit of the invention. And/or a video processing device for performing the processing described herein.

FIG. 3A shows an embodiment of a computer 301. The computer 301 can be a desktop computer, or a hosted enterprise storage device (such as a server) attached to a storage array (such as a stand-alone disk redundancy array (RAID), storage router, edge router, storage switch, and/or storage guide) Device). The user can utilize the computer 301 to view static digital images and/or video (eg, a series of digital images). A variety of image and/or video viewing programs and/or media player programs are often included on computer 301 to allow a user to view such images (including video).

FIG. 3B illustrates an embodiment of a notebook computer 302. Such a notebook computer 302 can be found and used in any of a variety of situations. In recent years, with the increasing processing power and functionality of notebook computers, such notebook computers have been sampled in many cases of previous high-end and more capable desktop computers. Like computer 301, notebook computer 302 can include various image viewing programs and/or media player programs to allow a user to view such images (including video).

FIG. 3C illustrates an embodiment of a high definition (HD) television 303. Many HD televisions 303 include an integrated tuner that allows media content (e.g., television broadcast signals) to be received, processed, and decoded thereon. Alternatively, sometimes the HD television 303 receives media content from another source that receives, processes, and decodes cable and/or satellite television broadcast signals, such as digital video disc (DVD) players, set-top boxes (STBs). Regardless of the particular implementation, HD television 303 can be implemented to perform image and/or video processing as described herein. In general, HD television 303 has the ability to display HD media content and is often implemented with an aspect ratio of 16:9 widescreen.

FIG. 3D illustrates an embodiment of a standard definition (SD) television 304. of course, The SD television 304 is somewhat similar to the HD television 303, with at least one difference in that the SD television 304 does not include the ability to display HD media content, and the SD television 304 is often implemented with a full screen aspect ratio of 4:3. Nonetheless, even SD TV 304 can be implemented to perform image and/or video processing as described herein.

FIG. 3E illustrates an embodiment of a handheld media unit 305. Handheld media unit 305 can operate for image/video content messages for playback by a user (such as Joint Photographic Experts Group (JPEG) files, Tagged Image File Format (TIFF), bitmaps, Moving Picture Experts Group (MPEG) Files, Windows Media (WMA/WMV) files, other types of video files such as MPEG4 files, and/or other types of messages that can be stored in digital format for general storage or storage. Historically, such handheld media units are primarily used to store and play back audio media; however, such handheld media unit 305 can be used to store and play back any virtual media (eg, audio media, video media, image media, etc.) ). Moreover, such handheld media unit 305 can also include other functions, such as integrated communication circuitry for wired and wireless communications. Such handheld media unit 305 can be implemented to perform image and/or video processing as described herein.

FIG. 3F illustrates an embodiment of a set-top box (STB) 306. As noted above, the STB 306 can sometimes be implemented to receive, process, and decode cable and/or satellite television broadcast signals to be provided to any suitable display available device, such as SD television 304 and/or HD television 303. Such STBs 306 can operate independently or in concert with display available devices for image and/or video processing as described herein.

FIG. 3G illustrates an embodiment of a digital video disc (DVD) player 307. Such a DVD player may be a Blu-ray DVD player, an HD-available DVD player, an SD-available DVD player, an upsampling available DVD player (eg, from SD to HD, etc. without departing from the scope and spirit of the present invention). ). The DVD player can provide signals to any suitable display available device, such as SD TV 304 and/or HD TV 303. DVD player 307 can be implemented to perform as herein The described image and/or video processing.

FIG. 3H illustrates an embodiment of a general purpose digital image and/or video processing device 308. In addition, as described above, the various devices described above do not include an exhaustive list of devices that can implement the image and/or video processing described herein, and it is noted that it can be implemented without departing from the scope and spirit of the present invention. Any general purpose digital image and/or video processing device 308 is utilized to perform the image and/or video processing described herein.

4, 5, and 6 are diagrams showing various embodiments 400, 500, and 600 of a video coding architecture, respectively.

Referring to the embodiment 400 of FIG. 4, it can be seen for the figure that the input video signal is received by the video encoder. In some embodiments, the input video signal is comprised of a coding unit (CU) or a macroblock (MB). Such coding units or macroblocks are variable in size and may include a plurality of pixels that are typically arranged in a square. In one embodiment, the size of such coding unit or macroblock is 16 x 16 pixels. However, it is generally noted that the macroblocks can have any desired size, such as NxN pixels, where N is an integer (eg, 16x16, 8x8, or 4x4). Of course, although square coding units or macroblocks are employed in the preferred embodiment, some implementations may include non-square coding units or macroblocks.

The input video signal can generally be referred to as corresponding to the original frame (or picture) image data. For example, raw frame (or picture) image data may undergo processing to generate luminance and chrominance samples. In some embodiments, the set of luma samples in a macroblock is a particular arrangement (e.g., 16 x 16), and the sets of chroma samples are different specific arrangements (e.g., 8 x 8). In accordance with embodiments described herein, a video encoder processes the samples on a block-by-block basis.

The input video signal then undergoes mode selection, and the input video signal selectively undergoes intra and/or inter prediction processing in accordance with the mode. In general, the input video signal undergoes compression along the compression path. When operating without feedback (eg, not based on inter prediction, nor based on intra prediction), the input video signal is provided via a compression path to undergo a transform operation (eg, according to a discrete cosine transform (DCT)). Of course, in Other transformations may be employed in alternative embodiments. In this mode of operation, the input video signal itself is the compressed signal. The compression path can be compressed using the human eye lacking high frequency sensitivity.

However, feedback can be performed along the compression path by selectively using intra or inter prediction video coding. Based on the feedback or prediction mode of operation, the compression path operates on (relatively lower energy) redundancy (e.g., difference) resulting from subtracting the current macroblock prediction value from the current macroblock. Generating a current macroblock and redundancy between at least a portion of the same frame (or picture) or at least a portion of the macroblock prediction based on at least one other frame (or picture) based on which prediction form is employed in the specified instance Difference.

The resulting modified video signal then undergoes a transform operation along the compression path. In one embodiment, a discrete cosine transform (DCT) operates on a set of video samples (eg, luminance, chrominance, redundancy, etc.) to calculate coefficient values for each of a predetermined number of base modes. For example, one embodiment includes 64 basis functions (eg, for an 8x8 sample). In general, different embodiments may employ different numbers of basis functions (eg, different transforms). Any combination of these various basis functions, including suitable and selectively weighted basis functions, can be used to represent a given set of video samples. Additional details relating to the various ways in which the transform operation is performed are described in the technical literature associated with video coding including those standard/draft standards as described above incorporated by reference. The output of the transform process includes the respective coefficient values. This output is provided to the quantizer.

In general, most image blocks typically produce coefficients (e.g., DCT coefficients in an embodiment based on discrete cosine transform (DCT) operation) such that the frequency of most of the associated DCT coefficients is lower. For this reason and the sensitivity of the human eye to high frequency visual effects is relatively poor, the quantizer can be operated to convert most of the less relevant coefficients to zero values. That is to say, those coefficients whose relative contribution rate is lower than a certain predetermined value (for example, a certain threshold) can be eliminated according to the quantization process. The quantizer can also operate to convert significant coefficients to values that can be encoded more efficiently than values produced by the variation process. For example, the quantization process can be performed by dividing each corresponding coefficient by The integer value is discarded and any remainder is discarded for operation. When operating on a typical coding unit or macroblock, this process typically produces a relatively small number of non-zero coefficients, which are then transmitted to an entropy encoder for lossless encoding and for selecting intra-frame based on video coding. / or feedback path for inter prediction processing to use.

The entropy encoder operates in accordance with a lossless compression encoding process. In contrast, quantitative operations are usually lossy. The entropy encoding process operates on the coefficients provided by the quantization process. Those coefficients can represent individual features (eg, brightness, chrominance, redundancy, etc.). Entropy encoders can employ various types of encoding. For example, the entropy coder may perform context adaptive binary arithmetic coding (CABAC) and/or context adaptive variable length coding (CAVLC). For example, converting data to (run-level paring) according to at least a portion of the entropy encoding scheme (eg, converting data 14, 3, 0, 4, 0, 0, -3 to each (running) , level) pairs (0, 14), (0, 3), (1, 4), (2, -3)). In advance, a table is assigned to assign variable length codes to pairs of values to assign relatively short length codes to relatively common value pairs and relatively long length codes to relatively rare value pairs.

As understood by the reader, the operations of inverse quantization and inverse transform correspond to the operations of quantization and transformation, respectively. For example, in embodiments where DCT is used for transform operations, inverse DCT (IDCT) is the transform employed in the inverse transform operation.

A picture buffer (or digital picture buffer or DPB) receives signals from the IDCT module; the picture buffer operates to store the current frame (or picture) and/or one or more other frames (or pictures), such as A frame (or picture) used according to intra prediction and/or inter prediction operations by video coding. It is to be noted that, according to intra prediction, a relatively small amount of storage is sufficient, as it may not be necessary to store the current frame (or picture) or any other frame (or picture) in the sequence of frames (or pictures). When inter-predicting based on video coding, the stored information can be used for motion compensation and/or motion estimation.

In one possible implementation, for motion estimation, a corresponding luma sample set (eg, 16×16) and frame (or picture) sequence from the current frame (or picture) The comparison is made for each buffer counterpart in other frames (or pictures) (eg, according to inter prediction). In one possible implementation, the best matching region (eg, prediction reference) is located and a vector offset (eg, motion vector) is generated. Multiple motion vectors can be found in a single frame (or picture), but not all motion vectors must point in the same direction. One or more operations performed in accordance with motion estimation are operatively used to generate one or more motion vectors.

Motion compensation operatively employs one or more motion vectors that can be generated from motion estimation. The predictive reference set of samples is identified and delivered for deduction from the original input video signal in an attempt to produce a relative (eg, ideal, multiple) lower energy redundancy. If such an operation does not result in lower energy redundancy, motion compensation is not necessary, and the transform operation can operate only on the original input video signal without performing redundancy (eg, based on providing the input video signal directly to the transform) The operation is such that no intra prediction is performed, and the operation mode of inter prediction is not performed, or intra prediction is performed and the redundancy generated by the intra prediction is subjected to a transform operation. Likewise, if the motion estimation and/or motion compensation operation is successful, the motion vector can also be sent to the entropy encoder along with the corresponding redundancy coefficients for lossless entropy coding.

The output from the entire video encoding operation is the output bit stream. It should be noted that the output bit stream can of course be processed according to the generation of a continuous time signal (which can be transmitted via the communication channel). For example, some embodiments operate in a wireless communication system. In this case, the output bit stream can perform appropriate digital analog conversion, frequency transform, scaling, filtering, modulation, symbol mapping, and/or in a wireless communication device for generating continuous time signals and the like that can be transmitted via the communication channel. Or any other operation.

Referring to the embodiment 500 of FIG. 5, it can be seen for the figure that the input video signal is received by the video encoder. In some embodiments, the input video signal is comprised of coding units or macroblocks (and/or can be divided into coding units (CUs)). The size of the coding unit or macroblock may vary and may include multiple pixels that are typically arranged in a square. In one embodiment, the size of the coding unit or macroblock is 16 x 16 pixels. however, It is generally noted that a macroblock can have any desired size, such as an NxN pixel, where N is an integer. Of course, although square coding units or macroblocks are employed in the preferred embodiment, some implementations may include non-square coding units or macroblocks.

The input video signal can generally be referred to as corresponding to the original frame (or picture) image data. For example, raw frame (or picture) image data can be processed to generate luminance and chrominance samples. In some embodiments, the set of luma samples in a macroblock is a particular arrangement (e.g., 16 x 16), and the sets of chroma samples are different specific arrangements (e.g., 8 x 8). In accordance with embodiments described herein, a video encoder processes the samples on a block-by-block basis.

The video signal is input and then the mode is selected, and the input video signal is selectively subjected to intra and/or inter prediction processing according to the mode. Generally, the input video signal is compressed along the compression path. When operating without feedback (eg, not based on inter prediction, nor based on intra prediction), the input video signal is provided via a compression path for transform operations (eg, according to discrete cosine transform (DCT)). Of course, other transformations may be employed in alternative embodiments. In this mode of operation, the input video signal itself is the compressed signal. The compression path can be compressed using the human eye lacking high frequency sensitivity.

However, feedback can be performed along the compression path by selectively using intra or inter prediction video coding. Based on the feedback or prediction mode of operation, the compression path operates on (relatively lower energy) redundancy (e.g., difference) resulting from subtracting the current macroblock prediction value from the current macroblock. Generating a current macroblock and redundancy between at least a portion of the same frame (or picture) or at least a portion of the macroblock prediction based on at least one other frame (or picture) based on which prediction form is employed in the specified instance Difference.

The resulting modified video signal is then transformed along the compression path. In one embodiment, a discrete cosine transform (DCT) operates on a set of video samples (eg, luminance, chrominance, redundancy, etc.) to calculate coefficient values for each of a predetermined number of base modes. For example, one embodiment includes 64 basis functions (eg, for an 8x8 sample). In general, different implementations can use different numbers of bases. Functions (for example, different transforms). Any combination of these basis functions including suitable selective weighting can be used to represent a given set of video samples. Additional details relating to the various ways in which the transform operation is performed are described in the technical literature associated with video coding including those standard/draft standards as described above incorporated by reference. The output of the transform process includes the respective coefficient values. This output is provided to the quantizer.

In general, most image blocks typically produce coefficients (e.g., DCT coefficients in an embodiment based on discrete cosine transform (DCT) operation) such that the frequency of most of the associated DCT coefficients is lower. For this reason and the sensitivity of the human eye to high frequency visual effects is relatively poor, the quantizer can be operated to convert most of the less relevant coefficients to zero values. That is, those coefficients whose relative contributions are below a certain predetermined value (eg, a certain threshold) can be eliminated according to the quantization process. The quantizer can also operate to convert significant coefficients to values that can be encoded more efficiently than values produced by the variation process. For example, the quantization process can operate by dividing the respective coefficients by an integer value and discarding any remainder. When operating on a typical coding unit or macroblock, this process typically produces a relatively small number of non-zero coefficients that are then transmitted to an entropy encoder for lossless encoding and selection of intra and/or frames based on video coding. The feedback path of the inter prediction process is used.

The entropy encoder operates in accordance with a lossless compression encoding process. In contrast, quantification operations are usually lossy. The entropy coding process operates on the coefficients provided by the quantization process. Those coefficients can represent individual features (eg, brightness, chrominance, redundancy, etc.). Entropy encoders can employ various types of encoding. For example, the entropy coder may perform context adaptive binary arithmetic coding (CABAC) and/or context adaptive variable length coding (CAVLC). For example, converting data to (run-level paring) according to at least a portion of the entropy encoding scheme (eg, converting data 14, 3, 0, 4, 0, 0, -3 to each (running) , level) pairs (0, 14), (0, 3), (1, 4), (2, -3)). In advance, a table is created that assigns variable length codes to value pairs to assign relatively short length codes to relatively common value pairs and relatively long length codes to relatively rare value pairs.

As understood by the reader, the operations of inverse quantization and inverse transform correspond to the operations of quantization and transform, respectively. For example, in embodiments where DCT is used for transform operations, inverse DCT (IDCT) is the transform employed in the inverse transform operation.

An adaptive loop filter (ALF) is implemented to process the output from the inverse transform block. An adaptive loop filter (ALF) is applied to the decoded picture before the decoded picture is stored in a picture buffer (sometimes referred to as a DPB, digital picture buffer). An adaptive loop filter (ALF) is implemented to reduce the encoding noise of the decoded image, and the luminance and chrominance can be selectively filtered separately, regardless of whether the adaptive loop filter (ALF) is at the slice level or in blocks. Level application. Two-dimensional (2D) finite impulse response (FIR) filtering can be used in adaptive loop filter (ALF) applications. The coefficients of the filter can be designed piece by piece in the encoder and then passed to the decoder (eg, from a transmitter communication device including a video encoder (or encoder) to include a video decoder ( Or a receiver communication device called a decoder).

One embodiment operates by generating coefficients according to a Wiener filter design. In addition, whether or not filtering processing is performed and whether the decision is passed to the decoder according to a quadtree structure (eg, from a transmitter communication device including a video encoder (or encoder) to a video decoder (or The receiver communication device for the decoder) can be applied one by one in the encoder, where the block size is determined by rate-distortion optimization. It should be noted that the implementation of 2D filtering can introduce complexity based on encoding and decoding. For example, by using 2D filtering in accordance with an adaptive loop filter (ALF) and implementation, there may be certain in the encoder (which is implemented in the transmitter communication device) and the decoder (which is implemented in the receiver communication device). Increased complexity.

In some alternative embodiments, the output from the deblocking filter is provided to one or more other in-loop filters implemented to process the output from the inverse transform block (eg, according to an adaptive loop filter (ALF) , Sample Point Adaptive Offset (SAO) filter and/or any other filter type implementation). For example, the decoded picture is stored in ALF is applied to the decoded picture before the picture buffer (sometimes called DPB, digital picture buffer). The ALF is implemented to reduce the encoding noise of the decoded image, and the luminance and chrominance can be separately filtered on a slice-by-slice basis, regardless of whether the ALF is applied at the slice level or at the block level. Two-dimensional (2D) finite impulse response (FIR) filtering can be used in ALF applications. The coefficients of the filter can be designed piece by piece in the encoder and then passed to the decoder (eg, from a transmitter communication device including a video encoder (or encoder) to include a video decoder ( Or a receiver communication device called a decoder).

One embodiment operates to generate coefficients based on Wiener filtering design operations. In addition, whether or not filtering processing is performed and whether the decision is passed to the decoder according to a quadtree structure (eg, from a transmitter communication device including a video encoder (or encoder) to a video decoder (or The receiver communication device for the decoder) can be applied block by block in the encoder, where the block size is determined according to rate-distortion optimization. It should be noted that the implementation of 2D filtering can introduce complexity based on encoding and decoding. For example, by using 2D filtering in accordance with ALF and implementation, there may be some added complexity in the encoder (which is implemented in the transmitter communication device) and the decoder (which is implemented in the receiver communication device).

As described for other embodiments, the use of ALF can provide one of a series of improvements in accordance with this video processing, including improving the objective quality measurement by performing a peak signal to noise ratio (PSNR) resulting from random quantization denoising. Additionally, the subjective quality of the subsequently encoded video signal can be achieved by illumination compensation, which can be introduced according to ALF processing, based on performing offset processing and scaling processing (eg, based on application gain).

For one type of in-loop filter, the use of an adaptive loop filter (ALF) can provide one of a series of improvements based on this video processing, including improved peak-to-noise-to-noise ratio (PSNR) by random quantization denoising. Objective quality measurement. In addition, the subjective quality of the subsequently encoded video signal can be achieved by illumination compensation, which can be offset according to adaptive loop filter (ALF) processing. Processing and scaling processing (eg, based on application gain) is introduced.

A picture buffer (or digital picture buffer or DPB) receives the signal output from the ALF; the picture buffer operates to store the current frame (or picture) and/or one or more other frames (or pictures), such as A frame (or picture) used by video coding according to intra prediction and/or inter prediction operations. It is to be noted that, according to intra prediction, a relatively small amount of storage is sufficient, as it may not be necessary to store any other frames (or pictures) or current frames (or pictures) in the sequence of frames (or pictures). When inter-predicting based on video coding, the stored information can be used for motion compensation and/or motion estimation.

In one possible implementation, for motion estimation, a corresponding luma sample group (eg, 16×16) from a current frame (or picture) and other frames in a frame (or picture) sequence (eg, according to inter prediction) Each buffer counterpart in (or picture) is compared. In one possible implementation, the best matching region (eg, prediction reference) is located and a vector offset (eg, motion vector) is generated. Multiple motion vectors can be found in a single frame (or picture), but not all motion vectors must point in the same direction. One or more motion vectors are operatively generated based on one or more operations performed by the motion estimation.

Motion compensation operatively employs one or more motion vectors that can be generated from motion estimation. The predictive reference set of samples is identified and delivered for deduction from the original input video signal in an attempt to produce relatively (eg, ideally multiple) lower energy redundancy. If such an operation does not result in lower energy redundancy, motion compensation is not necessary, and the transform operation can operate only on the original input video signal without performing redundancy (eg, based on providing the input video signal directly to the transform) The operation is such that no intra prediction is performed, and the operation mode of inter prediction is not performed, or intra prediction is performed and the redundancy generated by the intra prediction is subjected to a transform operation. Likewise, if the motion estimation and/or motion compensation operation is successful, the motion vector can also be sent to the entropy encoder along with the corresponding redundancy coefficients for lossless entropy coding.

The output from the entire video encoding operation is the output bit stream. To be careful of, The output bit stream can of course be processed according to the generation of a continuous time signal (which can be transmitted via the communication channel). For example, some embodiments operate in a wireless communication system. In this case, the output bit stream can be subjected to appropriate digital analog conversion, frequency transform, scaling, filtering, modulation, symbol mapping in a wireless communication device (which is used to generate continuous time signals that can be transmitted via a communication channel, etc.) And/or any other operation.

Referring to the embodiment 600 of FIG. 6, an alternative embodiment of a video encoder is described for the video encoder that performs prediction, variation, and encoding processes to produce a compressed output bitstream. Such a video encoder may be based on one or more video coding protocols, standards, and/or recommended practices (such as Part 10 of ISO/IEC 14496-10-MPEG-4, AVC (Advanced Video Coding) (or H. Part 10 of 264/MPEG-4 or AVC (Advanced Video Coding), ITU H.264/MPEG4-AVC) operates and is compatible.

It is noted that a corresponding video decoder, such as a video decoder located within the device at the other end of the communication channel, operates complementary processing for decoding, inverse transform, and reconstruction to produce a corresponding decoded video sequence, which is ideally ) indicates the input video signal.

When the map is compared to the previous graph, the signal path output from the inverse quantization and inverse transform (e.g., IDCT) blocks supplied to the intra prediction block is also supplied to the deblocking filter. Providing the output from the deblocking filter to one or more other in-loop filters implemented to process the output from the inverse transform block (eg, based on adaptive loop filter (ALF), sample point adaptive offset (SAO) ) Filters and/or any other filter type implementation). For example, in one possible implementation, the SAO filter is applied to the decoded picture before the decoded picture is stored in a picture buffer (sometimes referred to as a DPB, digital picture buffer).

With regard to any video encoder architecture that is implemented to generate an output bitstream, it is noted that such an architecture can be implemented in any of a variety of communication devices. The output bit stream can undergo additional processing (including error correction code (ECC), forward direction Error Correction (FEC), etc., to generate a modified output bit stream with additional redundant transactions therein. Again, as can be appreciated with respect to this digital signal, any suitable processing can be performed in accordance with the generation of continuous time signals suitable for or suitable for transmission via the communication channel. That is, such a video encoder architecture can be implemented in a communication device for transmitting one or more signals via one or more communication channels. Additional processing of the output bitstream generated by such a video encoder architecture can be performed to generate a continuous time signal that can be transmitted into the communication channel.

FIG. 7 is a diagram showing an embodiment 700 of intra prediction processing. As can be seen for this figure, the current block of video data (e.g., typically square and typically including NxN pixels) is processed to estimate individual pixels therein. Pre-coded pixels located above and to the left of the current block are used according to intra prediction. In some ways, the intra prediction direction can be considered to correspond to a vector that extends from the current pixel to a reference pixel located above or to the left of the current pixel. The details of the intra prediction applied to the encoding according to H.264/AVC are specified in the corresponding standards incorporated by reference above (for example, International Telecommunication Union, ITU-T, TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU, H.264 ( 03/2010), SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS, Infrastructure of audiovisual services-Coding of moving video, Advanced video coding for generic audiovisual services, Recommendation ITU-T H.264 (or International Telecomm ISO/IEC 14496-10 - Part 10 of MPEG-4, AVC (Advanced Video Coding), Part 10 of H.264/MPEG-4 or AVC (Advanced Video Coding), ITU H.264/MPEG4-AVC or equivalent).

Redundancy, which is the difference between the current pixel and the reference or predicted pixel, is coded redundancy. As can be seen from this figure, intra prediction operates using pixels within a common frame (or picture). It is of course to be noted that a given pixel may have its own distinct component associated with it, and each component may have a different set of samples.

FIG. 8 is a diagram showing an embodiment 800 of inter prediction processing. Unlike intra prediction, inter prediction is used based on the current pixel within the current frame (or picture). A group or sets of reference or predicted pixels within one or more other frames (or pictures) within a frame (or picture) sequence to identify motion vectors (eg, inter prediction directions). It can be seen that the motion vector extends from the current frame (or picture) within the frame (or picture) sequence to another frame (or picture). Inter prediction may use subpixel interpolation such that the predicted pixel value corresponds to a function of a plurality of pixels in a reference frame or picture.

Redundancy may be calculated according to inter prediction processing, although such redundancy is different from redundancy calculated according to intra prediction processing. According to the inter prediction process, the redundancy of each pixel again corresponds to the difference between the current pixel and the predicted pixel value. However, according to the inter prediction process, the current pixel and the reference or predicted pixel are not located in the same frame (or picture). Although the figure shows inter prediction with respect to one or more previous frames or pictures, it is also noted that alternative embodiments may operate with frames that correspond to before and/or after the current frame. For example, multiple frames can be stored according to appropriate buffering and/or memory management. When operating on a given frame, references can be generated from other frames before and/or after a given frame.

In conjunction with the CU, the base unit can be used to predict the partitioning mode (ie, prediction unit or PU). It is also noted that the PU is only limited for the last depth CU and the corresponding size is limited to the size of the CU.

9 and 10 are diagrams showing various embodiments 900 and 1000 of a video decoding architecture, respectively.

In general, this video decoding architecture operates on input bitstreams. Of course, it should be noted that this input bit stream can be generated based on the signal received by the communication device from the communication channel. Various operations can be performed on the continuous time signals received from the communication channel, including, for example, digital sampling, demodulation, scaling, filtering, etc., which can be appropriately generated from the input bit stream. Moreover, certain embodiments in which one or more error correction codes (ECC), forward error correction (FEC), etc., may be implemented, may be appropriately decoded in accordance with ECC, FEC, etc., to generate an input bit stream. That is, some additional redundancy has been performed in accordance with the generation of a corresponding output bit stream (eg, an output bit stream that can be transmitted from a transmitter communication device or a transmitter portion of a transceiver communication device) In an embodiment, appropriate processing can be performed based on generating an input bit stream. In general, such a video decoding architecture unfortunately handles the input bit stream to generate an output video signal corresponding to the original input video signal as closely and completely as possible, for output to one or more The video shows the available devices.

Referring to implementation 900 of FIG. 9, in general, a decoder such as an entropy decoder (eg, which may be implemented in accordance with CABAC, CAVLC, etc.) processes according to complementary processing of encoding (as performed in a video encoder architecture) Enter the bit stream. The input bit stream can be viewed (as closely and completely ideally as possible) of the compressed output bit stream generated by the video encoder architecture. Of course, in practical applications, some errors may have been experienced in the signals transmitted via one or more communication links. The entropy decoder processes the input bitstream and extracts appropriate coefficients, such as DCT coefficients (e.g., information representing chrominance, luminance, etc.), and provides the coefficients to the inverse quantization and inverse transform blocks. If a DCT transform is employed, the inverse quantization and inverse transform blocks can be implemented to perform an inverse DCT (IDCT) operation. The A/D block filter is then implemented to generate individual frames and/or pictures corresponding to the output video signal. These frames and/or pictures may be provided to a picture buffer or digital picture buffer (DPB) for use in performing other operations including motion compensation. In general, such motion compensation operations can be considered to correspond to inter predictions associated with video coding. Similarly, it is also possible to inter-predict the signals output from the inverse quantization and inverse transform blocks. Similar to video coding, such a video decoder architecture can be implemented for mode selection, based on decoding of input bitstreams, not by intra prediction or inter prediction, by inter prediction or by intra prediction. , thereby generating an output video signal.

Referring to embodiment 1000 of FIG. 10, in some alternative implementations, such as one or more in-loop filters that may be implemented in accordance with video coding used to generate an output bitstream (eg, according to an adaptive loop filter) (ALF), Sample Point Adaptive Offset (SAO) filter and/or any other filter type implementation), the corresponding one or more in-loop filters can be implemented in a video decoder architecture. In one embodiment, one or more in-loop filters are suitably implemented after the deblocking filter.

According to some possible implementations, after completing the deblocking filtering process of the decoded picture (eg, according to the SAO filtering implemented in other in-loop filters in FIG. 6), sample point adaptive offset (SAO) may be performed. deal with. This processing is performed based on an area defined as one or more complete maximum coding units (LCUs).

FIG. 11 illustrates an embodiment 1100 of a band offset sample point adaptive offset (SAO) filtering process. This figure shows the concept of the band offset SAO. After each offset is applied, the resulting pixels are cropped to a valid 8-bit pixel range [0, 255]. In this figure, the offset is applied to four consecutive, active bands; the remaining bands are not modified. Of course, in other embodiments, such offsets can be applied to discontinuous bands.

FIG. 12 illustrates an alternative embodiment 1200 of a video coding architecture. In this embodiment 1200, any one or more other in-loop filters (eg, implemented according to an adaptive loop filter (ALF), a sample point adaptive offset (SAO) filter, and/or any other filter type) The in-loop filter can be implemented to process the output of the inverse quantization and inverse transform blocks (eg, before the deblocking filter). In other words, in such embodiments, one or more other in-loop filters (e.g., SAO filters in one embodiment) may be applied prior to the deblocking process. In alternative embodiments, such in-loop filters may be implemented prior to deblocking processing (eg, according to adaptive loop filter (ALF), sample point adaptive offset (SAO) filters, and/or any other filtering In-loop filter implemented by the type of the device). However, prior to deblocking, aspects, embodiments, and/or their equivalents of the present invention operationally apply such in-loop filters (eg, based on adaptive loop filter (ALF), sample point adaptive offset (SAO) filter and/or any other filter type implemented in-loop filter), as shown in Figure 12.

According to some embodiments, when the SAO is operational and on (eg, implementations of this SAO for output from the deblocking process), some undesirable blockiness artifacts may occur. In these embodiments, it is mainly because two adjacent LCUs are using different band offset values. To alleviate this problem, this SAO can be applied before the deblocking process, and the deblocking process can be used to reduce any undesired and appearing blockiness artifacts in such cases. In this case, the boundary strengths and variables β and t _C used in the deblocking process are also determined by the SAO parameters.

From some perspectives, the band offset SAO can be considered substantially as a correction filter (e.g., a histogram correction filter in some embodiments). The pixels are classified based on the intensity values to produce a distribution of pixels. For example, for a histogram implementation, pixels (eg, pixels of one or more largest coding units (LCUs)) are classified as histogram bins or "bands" based on intensity values. The entire pixel range (0-255) is divided into 32 uniform bands, and a specific offset is added to all the pixels in each band. The encoder selects the offset to apply from the range [-7, 7].

Although the offset can be applied to all 32 bands, in order to simplify the band offset processing and reduce overhead, the reduced set (eg, only 4 consecutive bands) can be actually modified with the band offset SAO in any LCU. The encoder selects four consecutive bands for which the offset is transmitted. The remaining 28 bands (zero offset) are not modified. Since there may be 32 bands, the first band with a non-zero offset is represented by a bit stream. The band_position parameter carries this message. The remaining three active bands can be determined by (band_position+i)%32. Note the modulo operation here. If the first band is 29, 30 or 31, the remaining bands will wrap around 0.

FIG. 13 illustrates various embodiments 1300 of an indication (adaptive and/or explicit signaling) of a transmission band offset in a sample point adaptive offset (SAO) band offset mode. Such an operation can be accomplished in accordance with adaptively indicating the number of transmission band offsets in the SAO band offset mode. For example, the number of transmission band offsets in the SAO band offset mode may be related to the size of the LCU (eg, such that the number of transmission band offsets in the SAO band offset mode may be a function of the LCU size). For example, if the LCU size is reduced, the number of transmission bands is also reduced. As another example, four transmission band offsets can be used for a 64x64 LCU, three transmission band offsets can be used for a 32x32 LCU, and two transmission band offsets can be used for a 16x16 LCU. In general, depending on the respective sizes of the LCUs, the respective different numbers of transmission band offsets in the SAO band offset mode can be indicated.

The number of transmission band offsets per LCU size may also be in accordance with SPS (Sequence Parameter Set), PPS (Picture Parameter Size), APS (Adaptive Parameter Set), Macroblock Header, LCU Data, and/or other parts of the display. The signal is notified by the signal.

Figure 14 illustrates various embodiments 1400 of indication of frequency band granularity (adaptive and/or explicit signaling) in SAO band offset mode. Such an operation can be accomplished in accordance with adaptively indicating the granularity in the SAO band offset mode.

In some embodiments, the entire pixel range (0-255) is divided into 32 uniform frequency bands. The actual modification can be made to only 4 frequency bands using the band offset SAO in any LCU. An encoder (eg, a transmitter communication device) selects four consecutive frequency bands for which the offset is transmitted. The remaining 28 bands (eg, zero offset) are not modified. In each frequency band, a specific offset is added to all pixels.

Since the size of the LCU can be changed (for example, 64x64, 32x32, or 16x16), the granularity of the frequency band can be adaptive. For example, the smaller the size of the LCU, the coarser the granularity. As another example, if the LCU size is 32 x 32, then [0, 255] can be evenly divided into 16 bands, each band covering 16 consecutive intensity values. In general, different frequency band sizes in the SAO band offset mode can be indicated according to different sizes of the LCUs.

The bandwidth of each LCU size can also be clearly signaled according to SPS (Sequence Parameter Set), PPS (Picture Parameter Size), APS (Adaptive Parameter Set), Macroblock Header, LCU Data and/or other parts. .

FIG. 15 illustrates an implementation 1500 of implicit band index signaling. For example, this message can be inferred based on the pixel values of the current LCU (eg, LCU-based analysis determination, inferential determination, etc.) without explicitly signaling the band index. For example, by generating a histogram of the pixel values of the LCU, the band offset can be used for the frequency band in which the number of pixels is dominant. These band indices are not necessarily continuous (eg, the band index may be such that there is a discontinuous distribution such that at least two consecutive band indices may be separated by at least one band index value, in other words, the band indices are not mutually exclusive Must be continuous).

Figure 16 illustrates an alternative embodiment 1600 of implicit band index signaling. In an extremely simplified diagram showing a very simplified implementation, there is an LCU with only two gray levels. A histogram (eg, a possible way of describing the pixel distribution as understood by the reader) states that 50% of the pixels have a gray level of 25, and 50% of the pixels have a gray level 205. Therefore, two band offsets are sufficient instead of the original four.

FIG. 17 illustrates an embodiment 1700 of band offset coding. In the band offset mode, since sao_band_position represents the start of the band offset with a non-zero offset, the first offset value sao_offset[cldx][saoDepth][x0][y0][0] must be non-zero (eg In some cases, the smallest possible value may be a value of 1). Therefore, instead of directly encoding sao_offset[cldx][saoDepth][x0][y0][0],bs(sao_offset[cldx][saoDepth][x0][y0][0])1 and sao_offset[cldx][saoDepth The sign bits of [x0][y0][0] can be encoded separately, where abs is a function for calculating absolute values.

18 and 19 illustrate various embodiments of methods of operation of one or more devices (eg, communication devices, receivers and/or decoder devices, transmitters, and/or encoder devices, etc.).

Referring to method 1800 of FIG. 18, method 1800 first receives a video signal and a plurality of band offsets from at least one additional communication device via an input of the communication device, as indicated by block 1810.

Method 1800 continues by analyzing a plurality of pixels associated with at least one maximum coding unit (LCU) (which is associated with a video signal) to identify a pixel value distribution for identifying a plurality of frequency band indices, such as block 1820 Shown.

Method 1800 then applies a plurality of band offsets to the plurality of band indices based on the video signal or filtering process based on the signals, as indicated by block 1830.

Referring to method 1900 of FIG. 19, method 1900 first receives a video signal and a plurality of band offsets from at least one additional communication device via an input of the communication device, as indicated by block 1910.

The method 1900 continues by analyzing a plurality of pixels associated with at least one maximum coding unit (LCU) (which is associated with a video signal) to identify a pixel value distribution for identifying a plurality of frequency band indices, such as block 1920. Shown.

The method 1900 continues with performing a sample point adaptive offset (SAO) filtering process on the video signal or the signal based thereon to generate a first filtered signal, such that the SAO filtering process includes applying a plurality of band offsets to the plurality of band indices, such as Block 1930 is shown.

The method 1900 continues with performing a deblocking filtering process on the first filtered signal to generate a second filtered signal, as indicated by block 1940.

It should also be noted that the operations described herein for each method may be performed in any of a variety of communication devices, such as with the baseband processing module and/or processing module implemented therein and/or other components therein. and function. For example, the baseband processing module and/or processing module can generate such signals and perform such operations, processes, etc. as described herein, and can also perform various operations and analyses as described herein, or as herein Any other operations, functions, etc., or equivalents thereof.

In some embodiments, the baseband processing module and/or processing module (which may be implemented in the same device or in different devices) may perform such processing, operations, etc., in accordance with aspects of the present invention, and/or as Any other operations and functions, etc., or equivalents thereof, as described herein. In some embodiments, the processing is performed cooperatively by the first processing module in the first device and the second processing module in the second device. In other embodiments, such processing, operations, and the like are all performed by a baseband processing module and/or processing module in a given device. In even other embodiments, the processing, operations, etc. are performed using at least a first processing module and a second processing module of a single device.

Likewise, the terms "substantially" and "approximately" as used herein are used to provide industry-received tolerances and/or inter-item correlations for their corresponding terms. Industry-accepted tolerances range from less than 1% to 50% and correspond to, but are not limited to, component values, integrated circuit process variables, temperature variables, rise and fall times, and/or thermal noise. The difference in correlation between items is a few percentage points to the order of magnitude. The terms "operably coupled to", "coupled to", and/or "coupled" as used herein are intended to include the The couplings and/or items are indirectly coupled by intervening items (eg, items include, but are not limited to, components, components, circuits, and/or modules), wherein for indirect coupling, the intervening items are not modified Signal messages can be adjusted for their current level, voltage level and/or power level. Predictive coupling as used further herein (ie, when one element is inferred to be coupled to another element) includes direct and indirect coupling between two items in the same manner as "coupled to." The term "operable for" or "operably coupled to" as used further herein indicates that the item includes one or more power connections, inputs, outputs, etc. to perform one or more corresponding functions upon startup and may further Includes speculation coupling with one or more other items. The term "associated with", as used further herein, includes direct and/or indirect coupling of separate items and/or an item embedded in another item. The term "comparable to" as used herein means that a comparison between two or more items, signals, etc., provides the desired relationship. For example, when the relationship is that the signal 1 is greater than the magnitude of the signal 2, an advantageous comparison can be achieved when the magnitude of the signal 1 is greater than the magnitude of the signal 2 or when the magnitude of the signal 2 is less than the magnitude of the signal 1.

The terms "processing module," "module," "processing circuit," and/or "processing unit" as used herein (eg, include operations, implementations, and/or for encoding, decoding, and baseband processing). Various modules and/or circuits, etc.) may be a single processing device or multiple processing devices. Such processing devices may be microprocessors, microcontrollers, digital signal processors, microcomputers, central processing units, field programmable gate arrays, programmable logic devices, state machines, logic circuits, analog circuits, digital circuits, and/or Any device that operates on signals (analog and/or digits) based on hard-coded and/or operational instructions of the circuit. The processing module, module, processing circuit and/or processing unit may have associated storage and/or integrated storage elements, which may be a single storage device, multiple storage devices, and/or An embedded circuit, module, processing circuit, and/or processing unit of the processing module. Such storage devices may be read only memory (ROM), random access memory (RAM), volatile storage, nonvolatile storage, static storage, dynamic storage, flash memory, cache storage. And / or storage Any device that stores a digital message. It should be noted that if the processing module, module, processing circuit, and/or processing unit includes more than one processing device, the processing device can be centrally located (eg, directly coupled together by a wired and/or wireless bus structure) Or can be distributedly located (eg, indirectly coupled to cloud computing over a local area network and/or wide area network). It is further noted that if the processing module, module, processing circuit, and/or processing unit implements one or more functions through a state machine, analog circuit, digital circuit, and/or logic circuit, the storage storing the corresponding operational command may be stored. The memory and/or memory elements are embedded within or external to circuitry including state machines, analog circuits, digital circuits, and/or logic circuits. It is further noted that the storage elements can be stored, and the processing modules, modules, processing circuits, and/or processing units perform hard coding and/or corresponding to at least a portion of the steps and/or functions illustrated in one or more of the figures. Or operation instructions. Such a reservoir device or reservoir element can be included in the article.

The invention has been described above with the aid of method steps showing the performance of the specified functions and their relationships. For convenience of description, the boundaries and order of these functional building blocks and method steps are arbitrarily defined herein. Alternative boundaries and sequences can be defined as long as the specified functions and relationships are properly performed. Any alternative limits and sequences are within the scope and spirit of the invention as claimed. Moreover, the boundaries of these functional building blocks are arbitrarily defined for ease of description. As long as some important functions are properly performed, the alternative boundaries can be defined. Similarly, the flow block diagram is also arbitrarily defined herein to illustrate certain important functions. From the point of view of the use, the boundaries and sequence of the process block diagram are additionally specified, and some important functions are still performed. Alternative definitions of functional building blocks and flowchart blocks and sequences are within the scope and spirit of the claimed invention. Those of ordinary skill in the art will also appreciate that the functional building blocks and other illustrative blocks, modules, and components herein can be implemented as discrete components, application specific integrated circuits, processors executing appropriate software, etc., or any combination thereof. show.

The invention may have been described, at least in part, in one or more embodiments. Embodiments of the invention are used herein to describe the invention, its aspects, its features, its concepts, and/or examples thereof. Devices, articles, machines and/or embodying the invention Or physical implementations of the process may include one or more aspects, features, concepts, examples, etc. described with reference to one or more embodiments discussed herein. In addition, from the figures to the figures, embodiments may incorporate the same or similarly named functions, steps, modules, etc., which may use the same or different reference numbers, and as such, the functions, steps, modules, etc. may be the same or Similar functions, steps, modules, etc. may be different functions, steps, modules, and the like.

Unless specifically stated to the contrary, the signals transmitted to the components of any of the figures shown herein, signals from the components, and/or signals between the components may be analog or digital signals, continuous time signals, or discrete time signals. And single-ended signals or differential signals. For example, if the signal path is displayed as a single-ended path, it also represents a differential signal path. Similarly, if the signal path is displayed as a differential path, it also represents a single-ended signal path. Although one or more specific architectures are described herein, other architectures may be implemented that use one or more data buses (not explicitly shown) as recognized by one of ordinary skill in the art, directly between components. Indirect coupling between connections and/or other components.

The term "module" is used to describe various embodiments of the invention. The module includes functional blocks implemented via hardware to perform one or more module functions, such as processing one or more input signals to produce one or more output signals. The hardware that implements the module itself can operate in conjunction with software and/or firmware. A module as used herein may include one or more sub-modules, each of which is itself a module.

Although specific combinations of various functions and features of the present invention are explicitly described herein, other combinations of these features and functions are equally possible. The present invention is not limited by the specific examples disclosed herein and is explicitly combined with other combinations.

200‧‧‧Communication system

201‧‧‧Message Bits

202‧‧‧ encoded information bits

203‧‧‧Discrete value modulation symbol sequence

204‧‧‧Continuous time transmission signal

205‧‧‧Filtered continuous time transmission signal

206‧‧‧Continuous time to receive signals

207‧‧‧Filtered continuous time reception signal

208‧‧‧Discrete time receiving signal

209‧‧‧ metrics

210‧‧‧Best estimate of discrete-valued modulation symbols and the information bits encoded therein

220‧‧‧Encoder and symbol mapper

222‧‧‧Encoder

224‧‧‧symbol mapper

230‧‧‧Transmission driver

232‧‧‧Digital Analog Converter (DAC)

234‧‧‧Transmission filter

260‧‧‧ analog front end (AFE)

262‧‧‧ Receive Filter

264‧‧‧ Analog Digital Converter (ADC)

270‧‧‧Metric Generator

280‧‧‧Decoder

280a‧‧‧Processing Module

280b‧‧‧Processing module

297‧‧‧transmitter

298‧‧‧ Receiver

299‧‧‧Communication channel

Claims (9)

A communication device apparatus comprising: at least one input for: receiving a video signal from at least one additional device; and receiving a plurality of frequency band offsets from the at least one additional device via signaling; and a processor for: analyzing a plurality of pixels associated with at least one maximum coding unit (LCU) to identify a pixel value distribution, wherein the maximum coding unit is associated with the video signal; inferringly identifying a plurality of frequency band indices based on the pixel value distribution Applying the plurality of frequency band offsets to the plurality of frequency band indices according to the video signal or a filtering process based on the signal of the video signal; performing sampling points on the video signal or a signal based on the video signal An adaptive offset (SAO) filtering process to generate a first filtered signal, wherein the sample point adaptive offset filtering process applies the plurality of band offsets to the plurality of band indices; A filtered signal performs a deblocking filtering process to generate a second filtered signal. The communication device device of claim 1, wherein the processor is configured to: analyze a plurality of pixels associated with the at least one maximum coding unit to generate a pixel value histogram representing the pixel value distribution a picture, wherein the maximum coding unit is associated with the video signal; and based on the pixel value histogram, identifying the plurality of frequency band indices to which the plurality of frequency band offsets are to be applied. The communication device device of claim 1, wherein: the plurality of frequency band indices have a discontinuous distribution such that the plurality of frequency bands At least two consecutive band indices in the number are separated from each other by at least one band index value. The communication device device of claim 1, wherein: the pixel value distribution indicates a plurality of subsets of the plurality of pixels respectively associated with at least a portion of the plurality of band indices; The plurality of frequency band indices to be applied to the plurality of frequency band offsets correspond to at least one subset of the plurality of subsets of the plurality of pixels, wherein the at least one subset and the plurality of pixels Other subsets in multiple subsets have a relatively larger or largest number of pixels. The communication device device according to claim 1, wherein the communication device device is a communication operation in at least one of a satellite communication system, a wireless communication system, a wired communication system, a fiber-optic communication system, and a mobile communication system. device. A communication device device comprising: an input for receiving a video signal and a plurality of frequency band offsets from at least one additional device; and a processor for: analyzing a plurality of pixels associated with the at least one maximum coding unit (LCU) Identifying a pixel value distribution for identifying a plurality of frequency band indices, the maximum coding unit being associated with the video signal; and biasing the plurality of frequency bands according to the video signal or a filtering process based on the signal of the video signal Applying to the plurality of frequency band indices; performing sample point adaptive offset (SAO) filtering processing on the video signal or the signal based on the video signal to generate a first filtered signal, wherein the sampling point is adaptive An offset filtering process applies the plurality of band offsets to the plurality of band indices; and performs a deblocking filtering process on the first filtered signals to generate a second filtered signal. The communication device device of claim 6, wherein the processor is configured to: analyze a plurality of pixels associated with the at least one maximum coding unit to generate a pixel value histogram representing the pixel value distribution And wherein the maximum coding unit is associated with the video signal; and based on the pixel value histogram, identifying a plurality of frequency band indices to which the plurality of frequency band offsets are to be applied. The communication device device of claim 6, wherein: the plurality of band indices have a discontinuous distribution such that at least two consecutive band indices of the plurality of band indices are separated from each other by at least one band index value . A method of operating a communication device includes: receiving, via an input of the communication device, a video signal and a plurality of frequency band offsets from at least one additional communication device; analyzing a plurality of pixels associated with at least one maximum coding unit (LCU) Identifying a pixel value distribution for identifying a plurality of frequency band indices, wherein the maximum coding unit is related to the video signal; and the plurality of filtering processes according to the video signal or the signal based on the video signal Applying a frequency band offset to the plurality of frequency band indices; performing sample point adaptive offset (SAO) filtering processing on the video signal or a signal based on the video signal to generate a first filtered signal, wherein the sampling point An adaptive offset filtering process applies the plurality of band offsets to the plurality of band indices; and performs a deblocking filtering process on the first filtered signals to generate a second filtered signal.