CN108833975B - Video playing processing method and device - Google Patents
Video playing processing method and device Download PDFInfo
- Publication number
- CN108833975B CN108833975B CN201810668619.8A CN201810668619A CN108833975B CN 108833975 B CN108833975 B CN 108833975B CN 201810668619 A CN201810668619 A CN 201810668619A CN 108833975 B CN108833975 B CN 108833975B
- Authority
- CN
- China
- Prior art keywords
- resolution format
- video image
- resolution
- frame
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title description 14
- 238000012545 processing Methods 0.000 claims abstract description 124
- 238000006243 chemical reaction Methods 0.000 claims abstract description 96
- 230000008859 change Effects 0.000 claims abstract description 23
- 238000000034 method Methods 0.000 description 51
- 230000008569 process Effects 0.000 description 25
- 238000010586 diagram Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 6
- 238000012544 monitoring process Methods 0.000 description 6
- 230000003139 buffering effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Television Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a television, which belongs to the technical field of display, wherein a system on a chip SOC informs a frame frequency conversion module FRC of a third resolution format of a decoded 1 st frame video image, monitors the change of the third resolution format of each frame of the video image, and if the third resolution format of an M frame video image is different from the third resolution format of a previous frame video image, informs the frame frequency conversion module FRC of the third resolution format of the M frame video image; and the frame frequency conversion module FRC calls a resolution format conversion processing algorithm corresponding to the changed third resolution format according to the SOC notification, and performs resolution format conversion on the Mth frame of video image. The invention does not have the problem of black screen.
Description
The present application is a divisional application of chinese patent application 201610158743.0 entitled "processing method and apparatus for video playback" filed on 2016, 03, 18.
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for processing video playing.
Background
With the development of television technology, more and more users use televisions as terminal devices for watching videos. When a user uses a television to perform video on-demand broadcasting, the problems of blockage, black screen or delay and the like in the video broadcasting process are often caused by the change of the network speed.
Fig. 1 is a schematic diagram of a conventional video playing process flow. Because the network bandwidth has the problem of real-time change, in order to deal with the change of the network bandwidth, background servers of some video playing websites have signal sources with various resolutions such as 480P/720P/1080I/1080P/2160P and the like in the same video program, and the background servers push corresponding video formats according to the actual network bandwidth of a user in the video playing process, so that the problems of no data buffer, pause and delay in the watching process of the user are solved; as shown in fig. 1, a signal sent by a server is decoded by a Decoder module (Decoder) in an SOC chip to be a frame of image, and then the frame of image is sent to an image processing (VDP/DDP) module for Picture Quality (PQ) processing, and then sent to a display processing (Scaler) module for scaling (Upscaler or Downscaler processing), for example, a difference between pixels is calculated to obtain a new pixel point, and finally the new pixel point is sent to a display screen for processing, during the whole processing process, the signal is processed frame by frame (for example, F1 in fig. 1), when a resolution change occurs, the display processing module needs to perform corresponding algorithm processing, and the scaling algorithm in the display processing module needs time to process in the process of adjusting according to the resolution (usually, a black screen signal inserted with 2 to 3 frames or a static signal of a current frame is used for replacing), because the display processing module directly drives a Timer/Control counter (Timer Control register) of a rear-level display screen Register, TCON) instead of the black screen signal during the period of time when no signal is output.
In the actual resolution conversion process, in order to avoid that the SOC chip has a limited processing bandwidth, for example, only can process input signals with a Frame Rate or code Rate below 30Hz, and when it is time-consuming to perform algorithm switching when the resolution of the input signals changes, such as having to insert a black screen signal, a Frame Rate Converter (FRC) chip with a higher processing capability may be added to perform corresponding algorithm processing, but if the resolution of the video signals entering the SOC changes due to network bandwidth, etc., if the front-end SOC directly outputs decoded video images to the FRC, since a Pixel Clock of the video images that are finally provided to the display screen changes when the resolution of the video images output by the SOC is different, for example, a Clock period of 1920 × 108060 Hz is 148.5MHz, and a Clock period of 3840 × 216060 Hz is 597MHz, the FRC needs to resynchronize the clocks while processing the video signals and unifying the resolution of the display screen, which also requires a long time and inevitably causes a black screen phenomenon.
Therefore, the problem of the prior art is that, no matter whether the processing is carried out by the SOC chip alone or the processing is assisted by the FRC chip, when the resolution of the input signal is changed, the problem of black screen inevitably exists.
Disclosure of Invention
The invention provides a video playing processing method and a video playing processing device, which are used for solving the problem that a screen is blacked when the resolution ratio of a video signal is changed in the prior art.
In a first aspect, the present invention is a television comprising: the SOC informs the frame frequency conversion module FRC of the third resolution format of the decoded 1 st frame of video image, monitors the change of the third resolution format of each frame of video image, and informs the frame frequency conversion module FRC of the third resolution format of the M frame of video image if the third resolution format of the M frame of video image is different from the third resolution format of the previous frame of video image; the frame frequency conversion module FRC calls a resolution format conversion processing algorithm corresponding to the changed third resolution format according to the SOC notification to perform resolution format conversion on the Mth frame of video image;
compared with the prior art, the video image output after decoding is subjected to unified resolution format conversion and converted into the video image in the unified fourth resolution format, namely, the video image converted into the fourth resolution is uniformly converted into the fourth resolution through the filling of the ineffective Pixel points, namely, for the FRC, the video signal output of the SOC is stable, namely, a Pixel Clock needing to be output to a display screen cannot be changed, correspondingly, the FRC is not required to perform Clock synchronization processing, and meanwhile, the FRC knows the third resolution format of the video image in advance before performing corresponding resolution format conversion on the video image, so that the processing time is short, and the technical problem of black screen caused by the change of the resolution of the video to be played is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic view of a conventional video playing process flow;
FIG. 2 is a flowchart of a video playing processing method according to an embodiment of the present invention;
FIG. 3 is a schematic processing flow chart of a video playing processing method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating resolution format conversion of a video image according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of video resolution format conversion according to another embodiment of the present invention;
FIG. 6 is a schematic structural diagram of a video playback processing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a television according to an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The processing method for video playing of the embodiment of the invention can be applied to equipment such as televisions, mobile phones, Personal Computers (PCs), tablet computers and the like to solve the problems.
Fig. 2 is a flowchart of a video playing processing method according to an embodiment of the present invention. Fig. 3 is a schematic processing flow diagram illustrating a video playing processing method according to an embodiment of the present invention. Fig. 4 is a schematic diagram of video image resolution format conversion according to an embodiment of the present invention. As shown in fig. 2, the present embodiment is exemplified by applying the video playing processing method to a television, and the method includes:
the video image converted into the first resolution format comprises effective pixel points and pixel points copied by the effective pixel points; the effective pixel points are pixel points in the video image before conversion;
the video image converted into the fourth resolution format comprises effective pixel points and ineffective pixel points; the effective pixel points are pixel points in the video image before conversion.
In this embodiment, step 202 and step 203 may further include step 201 'before determining the bit rate or frame rate of the video to be played, where the step has no front-back order relationship with step 201, and for those skilled in the art, executing step 201' first and then executing step 201 may also solve the technical problem of the present invention, so as to achieve the corresponding technical effect.
Specifically, the same video content in the server may have different resolution formats (the frame rate is not changed, and only the resolution is different), including but not limited to the following, where each resolution corresponds to one mode:
3840 × 2160- - -mode 1
2880X 1440- - -mode 2
2560X 1440- - -mode 3
1920 x 1080- - -mode 4
1280 × 720- - -mode 5
720X 576-mode 6
640X 480- -mode 7
320 x 240-mode 8
When playing processing is carried out, firstly, a decoded video image corresponding to a video to be played requested by a user is obtained; the decoding module in fig. 3 decodes to obtain a video image;
the obtained video to be played can be a video signal which is actively pushed by the server according to the network bandwidth of the current user and has a resolution format matched with the network bandwidth of the current user, or a video signal which is requested by the SOC to the server according to the monitored network bandwidth of the current user and has a resolution format matched with the network bandwidth of the current user.
Determining the bitrate or frame rate of the video, assuming that the bandwidth of the format conversion module in fig. 3 can only support 300MHz, if the video to be played is a video in all resolution formats of 3840 × 2160 resolution, the frame rate is 30Hz, or the frame rate is 60Hz, and at this time, the bitrate or frame rate is less than or equal to a preset value, then processing is performed by using the method in step 202, where the processing procedure is as follows (using the processing procedure in path 1):
for the decoded video images, before the resolution format of each frame of video image is converted into the second resolution format matched with the display screen, when the resolution format of each frame of video image is not matched with the first resolution format, the resolution format conversion is sequentially performed on each frame of video image and unified into the first resolution format, fig. 3 only shows 3 frames of video images F1, F2 and F3, the converted video images are similar to the video images of the other frames shown in fig. 3, and all the decoded video images are sequentially subjected to the resolution format conversion.
The conversion rule can simply copy the effective pixel points in the original video image.
Since the video source may transform the resolution in real time according to the network bandwidth of the user, the resolution of the video image decoded by the decoder is not uniform at different times, and thus needs to be processed into a uniform first resolution format by the format conversion module.
For example, assuming that the first resolution format is 3840 × 2160, and the resolution format of the decoded video image is mode 4, the 1920 × 1080 resolution video image needs to be converted into the 3840 × 2160 resolution video image, specifically, 2160 lines of pixels are generated by copying 1 line of pixel points of each line in the original video image, and 3840 columns of pixels are generated by copying 3 lines of pixel points of each column in the processed video image, and finally the video image is 3840 × 2160; in other embodiments of the present invention, resolution format conversion may be performed in other manners, which is not limited in the present invention.
As shown in fig. 4, when the resolution format of the upper two frames of video images is 1920 × 1080, the first resolution format is 1920 × 1080, the resolution format of the 3 rd frame of video images is 1280 × 720, and the first resolution format is 1920 × 1080, the 3 rd frame of video images is subjected to resolution format conversion and then output for image quality processing.
Or, the first resolution format is 3840 × 2160, the resolution formats of the decoded video images are different, the resolution format of the first 3 frames of video images is mode 1, and the 4 th frame of video images starts to be mode 4, then the resolution format conversion is performed first, and the resolution format is unified with the resolution formats of the previous frames of video images, at this time, although a certain processing time is needed, because the conversion rule is simple and the processing speed is fast, the resolution of the video signal after passing through the image processing VDP/DDP module, the display processing module and the display screen is stable, and the problem of black screen caused by the change of the resolution in the playing process can not be caused.
Because the bandwidth of the display processing module in the front-end SOC is limited to 300MHz (SOC processing capability is limited), and only 4K × 2K @30Hz can be supported, so that the requirements of resolution and display screen adaptation of signals with higher Frame Rate of 60Hz cannot be met, for such video signals with high Frame Rate or code Rate, a Frame Rate Converter (Frame Rate Converter, abbreviated as FRC) with stronger processing capability can be added to perform corresponding algorithm processing before outputting to the display screen on the basis of the above-mentioned SOC scheme, but if the network bandwidth and other reasons cause the resolution of the video signals entering the SOC to change, if the front-end SOC directly outputs the decoded video images to the FRC, since the Pixel Clock (Pixel Clock) of the video images that are required to be finally provided to the display screen changes when the resolution of the video images output by the SOC is different, for example, the Clock period 1920 × 108060 Hz is 148.5MHz, the clock period of 3840 × 216060 Hz is 597MHz, and therefore, the FRC needs to resynchronize the clock while processing the video signal and unifying the resolution of the display screen, which also needs a long time and inevitably has a black screen phenomenon.
Therefore, in the embodiment of the present invention, when the video to be played has a resolution of 3840 × 2160 and the frame rate is 60Hz, and the bitrate or the frame rate is greater than the corresponding preset bitrate or the preset frame rate, the method in step 203 and step 204 is adopted to perform the processing, and the processing procedure is as follows (the processing procedure in path 2 is adopted):
for the decoded video image, the decoding module monitors the change of the third resolution format of the video image, the decoding module notifies the FRC of the third resolution format of the 1 st frame of video image, and if the subsequent decoding module monitors that the resolution is changed, the subsequent decoding module notifies the FRC of the third resolution format of the video image to perform resolution format conversion algorithm preparation; specifically, the identifier of the third resolution format may be sent to the FRC; and the SOC converts the third resolution format of the video image into the fourth resolution format when the third resolution format of the video image is not matched with the fourth resolution format. That is, before each frame of video image is sent to the FRC, resolution format conversion is sequentially performed on each frame of video image to unify the frames into a fourth resolution format, fig. 3 only shows 3 frames of video images F1, F2, and F3, the converted video images are similar to the video images of the other frames F1 ', F2 ', and F3 ' shown in fig. 3, and all the decoded video images are sequentially subjected to resolution format conversion.
The conversion rule may be to convert the pixels different from the fourth resolution format into the video image in the fourth resolution format by supplementing the pixels with black pixels or other non-effective pixels.
The fourth resolution may be a preset resolution of a certain format, for example, the fourth resolution may be preset to 1920 × 1080, the third resolution format of the video image obtained after subsequent decoding needs to be matched with the fourth resolution format, and if the third resolution format of the video image does not match with the fourth resolution format, the third resolution format of the video image needs to be converted into the fourth resolution format; certainly, the resolution format of the video image corresponding to the video source may be determined according to the resolution format corresponding to the acquired decoded video image, for example, when the video image is initially played, the resolution format of the video image corresponding to the video source may be 1920 × 1080, the resolution may be set to the fourth resolution, when the bandwidth changes, the resolution format of the video source may be adjusted to be 720 × 576 format, at this time, the format of the third resolution 720 × 576 corresponding to the video image is different from the format of the fourth resolution 1920 × 1080, so that the current format of the third resolution 720 × 576 needs to be converted into the format of the fourth resolution 1920 × 1080.
Because the video source can change the resolution in real time according to the network bandwidth of the user, the resolution of the video image decoded by the decoder is not uniform at different times, and in order to ensure the uniformity of the Pixel Clock of the video image output to the FRC, thereby avoiding the black screen phenomenon, the video image needs to be processed into a uniform fourth resolution format through the SOC.
Then, for each frame of video image sequentially output in the SOC, converting the fourth resolution format of the video image according to the pre-acquired third resolution format of the video image to acquire a second resolution format matched with the display screen. Here, the FRC may be notified in advance when the decoded video image is acquired.
Specifically, as shown in fig. 3, the display processing module may sequentially perform resolution format conversion processing on the decoded video images to obtain video images in a fourth resolution format; then outputting the video image after the conversion processing to an FRC for resolution format conversion processing again; calling a corresponding algorithm by the FRC according to a pre-known identifier (such as a Mode Index) of a resolution format to process the resolution format into a second resolution format matched with the display screen; wherein the fourth resolution format may be a resolution of the display screen; the FRC at the back end is uniformly processed; FRC may perform resolution format conversion according to an image scaling interpolation algorithm.
For example, assuming that the second resolution format matched with the display screen is 3840 × 2160, and the third resolution format of the decoded video image is mode 4, as shown in fig. 4, the video image with 1920 × 1080 resolution may be converted into the video image with 3840 × 2160 resolution, specifically, the original image with 1920 × 1080 resolution may be used as effective pixels, and then the other parts with 3840 × 2160 resolution are supplemented with black pixels to complete the image; in other embodiments of the present invention, the resolution format conversion process may be performed in other manners, which is not limited in the present invention.
When resolution format conversion processing is carried out in the FRC, the resolution format can be specifically converted in a mode that a new pixel point is filled between adjacent pixel points of an original video image through calculation of an interpolation algorithm; in other embodiments of the present invention, the resolution format conversion may be performed by other algorithms, which is not limited by the present invention.
And image scaling interpolation algorithms, including, for example, linear interpolation algorithms, nearest neighbor interpolation algorithms, bilinear interpolation algorithms, and the like.
Or, assuming that the second resolution format matched with the display screen is 3840 × 2160, and the third resolution format of the decoded video image is 320 × 240 or 1280 × 720, the third resolution format may be first converted into the fourth resolution format 1920 × 1080 in the display processing module, and then output to the FRC, and the FRC performs the final resolution format conversion processing to obtain the video image in the second resolution format matched with the display screen.
The following is illustrated by way of example:
when a video to be played is played at the beginning, after decoding, the FRC is informed of the third resolution format of the video image, and when the FRC receives the video image, the FRC already knows the third resolution format of the video image, so that the FRC can call a corresponding processing algorithm to convert the resolution format; the video image output by the cache module can be subjected to image quality effect processing such as Color Manager, noise reduction, definition, super-resolution, Gamma and the like of the image processing VDP/DDP module, and the display processing module can take the video image subjected to the image quality effect processing as an effective pixel, and simultaneously supplements the pixel different from the fourth resolution format into a black pixel or other non-effective pixels to convert the pixel into the video image in the fourth resolution format; then, obtaining a corresponding effective pixel point in a Frame Rate Converter (FRC) according to a third resolution format of the current frame, and sequentially performing corresponding resolution format conversion processing on the video image output from the display processing module according to a second resolution format matched with the display screen to obtain a second resolution format matched with the display screen; let us assume that the third resolution format of the 4 th frame is changed and not matched with the fourth resolution format, the decoding module may notify the FRC of the third resolution format of the 4 th frame through a high-speed Serial V-By-One Interface via, for example, an Inter-Integrated Circuit (I2C for short) or a Serial Peripheral Interface (SPI for short), and after the FRC acquires the third resolution format, when receiving the video image of the 4 th frame output By the display processing module, the FRC invokes an algorithm corresponding to the corresponding resolution format to perform resolution format conversion processing; in the whole process, the video image acquired by the FRC from the display processing module and the signal resolution from the FRC to the display screen are always stable, the pixel clocks are unified, and the FRC already knows the third resolution format of the video image in advance before the resolution format conversion is carried out on the video image, so that the processing time is short, and the problem of black screen caused by the change of the resolution of the video to be played can be avoided.
In this embodiment, if the FRC at the back end can only implement 2 times of Upscaler processing, the resolution format matched with the display screen is assumed to be 3840 × 2160, and the resolution format of the decoded video image is in modes 5, 6, 7, and 8, resolution format conversion needs to be performed before sending to the cache module, and the resolution format is uniformly converted and adjusted to a 1920 × 1080 resolution format, at this time, resolution format conversion can be implemented by copying effective pixels, and then the display processing module performs preprocessing after the output of the cache module, and the others are consistent with the above scheme; if FRC can realize 12 times of Uscaler processing, the method can be realized by directly using the scheme.
In the processing method for video playing provided by this embodiment, a decoded video image is obtained, and then, if the bit rate or the frame rate is less than or equal to a preset value, before the resolution format of each frame of the video image is converted into the second resolution format matched with the display screen, when the resolution format of each frame of the video image is not matched with the first resolution format, the resolution format of each frame of the video image is converted into the first resolution format, because the resolution formats of the video images are unified before the video images are converted into the second resolution format matched with the display screen, the conversion process is relatively simple, only effective pixel points are copied, and when the video images are converted into the second resolution format matched with the display screen, because a format conversion algorithm does not need to be switched, the processing time is short, and therefore, no black screen signal needs to be inserted, compared with the prior art, the problem of black screen caused by the change of the resolution ratio in the playing process can not be caused; if the code rate or the frame rate is larger than a preset value, converting the third resolution format of the video image into the fourth resolution format when the third resolution format of the video image is not matched with the fourth resolution format; converting the resolution format of the video image converted into the fourth resolution format into a second resolution format matched with the display screen according to a third resolution format of the video image acquired in advance; compared with the prior art, when the code rate or the frame rate is larger than the preset value, the video image output after decoding is subjected to unified resolution format conversion and converted into the video image in the unified fourth resolution format, that is, since the video image converted into the fourth resolution is filled with the ineffective pixels, the video image is unified into the fourth resolution before being converted into the second resolution matched with the display screen, that is, for FRC, the video signal output of the SOC is stable, that is, the Pixel Clock that needs to be output to the display screen will not change, and accordingly, the FRC is not needed to perform Clock synchronization, meanwhile, before FRC performs corresponding resolution format conversion on the video image, the third resolution format of the video image is known in advance, therefore, the processing time is short, and the technical problem of generating a black screen caused by the change of the resolution of the video to be played is further improved.
On the basis of the above embodiment, the resolution format of each frame of video image is converted into a second resolution format matched with the display screen, which can be specifically realized by the following steps:
and converting the first resolution format of each frame of the converted video image into a second resolution format matched with the display screen according to an image scaling interpolation algorithm.
For example, if the second resolution format matched with the display screen is 3840 × 2160, and the unified first resolution format is mode 4, a 1920 × 1080 resolution video image needs to be converted into a 3840 × 2160 resolution video image, specifically, the resolution format may be converted in a manner that a new pixel is filled between adjacent pixels of the original video image through calculation of an interpolation algorithm; in other embodiments of the present invention, the resolution format conversion may be performed by other algorithms, which is not limited by the present invention.
And image scaling interpolation algorithms, including, for example, linear interpolation algorithms, nearest neighbor interpolation algorithms, bilinear interpolation algorithms, and the like.
Or, assuming that the second resolution format matched with the display screen is 1920 × 1080 and the first resolution format is mode 1, the video image in the first resolution format is subjected to image resolution conversion downlocaler processing, and the resolution format is converted into mode 4.
In the embodiment of the invention, the resolution formats are unified before being converted into the second resolution format matched with the display screen, so that the resolution of the video signal after being processed by the image processing VDP/DDP module, the display processing module and the display screen is stable, and the problem of black screen caused by the change of the resolution in the playing process can be avoided.
On the basis of the above embodiment, after converting the resolution format of each frame of video image into the first resolution format, the method further includes:
for each frame of video image after conversion, converting P into first resolution format1Frame video images are sequentially stored in a first cache module; wherein, P1Is a positive integer;
converting the resolution format of each frame of video image to a second resolution format matched to the display screen, comprising:
acquiring each frame of video image output at constant speed from the first cache module, and converting a first resolution format of the video image into a second resolution format;
after converting the resolution format of each frame of video image into a second resolution format matched with the display screen, the method further comprises the following steps:
and outputting each frame of video image converted into the second resolution format to a display screen.
Specifically, for the converted video image, the 1 st frame to the P-th frame are first processed1Frame video images are sequentially stored in a first cache module; the function of the first cache module can be as follows, P1Is a positive integer, e.g. the value of FIG. 3 is P1=3。
Then, for the subsequent conversionIs the N + P th of the first resolution format1Frame video image, when the N frame video image stored in the buffer module is output, i.e. the frame number of the video image stored in the buffer module is less than P1Then, the N + P1The frame video image is stored in a cache module; for example, N is initially 1, P1=3, storing 3 frames of video images in the first cache module, and then storing a 4 th frame of video images in the first cache module after outputting the 1 st frame of video images stored in the first cache module; and adding 1 to N, and repeatedly executing the steps until all the video images are output.
Wherein, P1The method can be comprehensively determined according to the buffering time for starting playing the actual image and the capacity of the cache module, and the image of the first cache module is less than or equal to P due to different conversion times of different resolution formats1And (5) frame.
The purpose of storing in the first buffer module is to ensure that several frames of video images always exist in the first buffer module, because the time difference required for different resolution formats during the conversion of the first resolution format is small, but certain time difference still exists between different resolutions for image frames after a certain number of image frames are processed; thus from the N + P1The frames are processed frame by frame, and are stored in the first buffer module according to the output condition of the video image stored in the first buffer module later, namely the first buffer module only needs to be less than P1Frame video picture, the newly processed N + P1The frame is put into the first buffer module to ensure that 1 to P always exist in the first buffer module1A frame video image.
The first buffer module is mainly used for buffering the video images after the uniform resolution format conversion and storing P simultaneously1And (3) framing the video image, and outputting the video image to each subsequent functional processing module at a constant speed frame by frame at a certain speed in real time.
In this embodiment, since a certain number of converted video images are stored in the first buffer module, even if the subsequent format conversion processing is performed for a long time, the video images in the first buffer module can be output first without inserting a black screen signal.
Further, before converting the first resolution format of the video image into the second resolution format, the method further includes:
and carrying out image quality processing on each frame of video image output at constant speed from the first cache module.
Specifically, each frame of video image output at constant speed in the first cache module is sequentially subjected to image quality effect processing such as Color control (Color Manager), noise reduction, definition, super-resolution, Gamma and the like; as shown in fig. 3, the VDP/DDP is an image processing module, configured to perform Color Manager, noise reduction, sharpness, super-resolution, Gamma, and other image quality effect processing on the video image output by the cache module;
the display processing module is used for performing optional frame frequency conversion, motion compensation and electro-optical conversion processing on the video image output by the image processing module so that the video image is finally displayed at the screen end;
the display screen (Panel) may be a liquid crystal screen module, and includes a timer/counter control register (TCON), a Panel, and the like.
The method steps 201-203 of the above embodiments can be implemented in SOC, and the step 204 can be implemented in FRC.
On the basis of the above embodiment, further, after step 201, before step 203, the following operations may be performed:
for each frame of decoded video image, decoding P2The frame video images are sequentially stored in a second cache module; wherein, P2Is a positive integer;
correspondingly, step 203 may be implemented in the following manner:
and acquiring each frame of video image output at constant speed from the second cache module, and converting the third resolution format of the video image into the fourth resolution format by the SOC when the third resolution format of the video image is not matched with the fourth resolution format.
Specifically, for the decoded video images, the 1 st to pth frames are first decoded2The frame video images are sequentially stored in a second cache module; the function of the second cache module may be implemented by the function of the cache module in fig. 3; wherein, P2Is a positive integer, e.g. the value of FIG. 3 is P2=3。
Then, for each frame of video image output at constant speed in the second cache module, when the third resolution format of the video image is not matched with the fourth resolution format, the display processing module of the SOC converts the third resolution format of the video image into the fourth resolution format.
When the Nth frame of video image stored in the second buffer module is output, that is, the frame number of the video image stored in the second buffer module is less than P2Then, the N + P2The frame video image is stored in a second cache module; for example, N is initially 1, P2=3, storing 3 frames of video images in the second cache module, and then storing a 4 th frame of video images in the second cache module after outputting the 1 st frame of video images stored in the second cache module; and adding 1 to N, and repeatedly executing the steps until all the video images are output.
Wherein, P2The image processing method can be comprehensively determined according to the buffering time for starting playing the actual image and the capacity of the second cache module, and the image of the second cache module is less than or equal to P due to different conversion times of different resolution formats2And (5) frame.
The purpose of storing in the second buffer module is to ensure that several frames of video images always exist in the second buffer module, because the time difference required for different resolution formats during resolution format conversion is small, but certain time difference still exists for different resolutions after a certain number of image frames are processed; thus from the N + P2The frames are processed frame by frame, and are stored in the second buffer module according to the output condition of the video image stored in the second buffer module, namely the second buffer module only needs to be less than P2Frame video picture, the newly processed N + P2The frame is put into a second buffer module to ensure the firstTwo cache modules always have 1 to P2A frame video image.
The second buffer module is mainly used for buffering the video image decoded by the decoding module and storing P simultaneously2Frame video images (such as F1, F2 and F3) are output to each subsequent functional processing module at a constant speed of a certain speed frame by frame in real time;
specifically, as shown in fig. 3, the display processing module may sequentially perform resolution format conversion processing on the video images output from the second cache module to obtain a video image in a fourth resolution format; then outputting the video image after the conversion processing to an FRC for resolution format conversion processing again; by FRC according to at least P2The identifier of the resolution format (e.g., Mode Index) sent from the frame is processed by calling the corresponding algorithm into a second resolution format matching the display.
FIG. 5 is a schematic diagram of video resolution format conversion according to another embodiment of the present invention. On the basis of the foregoing embodiment, further, step 204 may specifically be implemented as follows:
and the FRC extracts effective pixel points from the video image converted into the fourth resolution format according to the pre-acquired third resolution format of the video image, and converts the fourth resolution format of the video image into a second resolution format matched with the display screen.
Specifically, the display processing module of the SOC sequentially performs conversion preprocessing on each decoded frame of video image, and when a third resolution format corresponding to an nth frame of video image is not matched with a fourth resolution format, the display processing module performs resolution conversion processing on the nth frame of video image to obtain an nth 'frame of video image after conversion processing, and outputs the nth' frame of video image to the FRC;
specifically, for example, the fourth resolution format is 3840 × 2160, a 1920 × 1080 decoded and output video image is used as an effective pixel, and then the other parts of the 3840 × 2160 resolution format are supplemented with black pixels.
The FRC calls a corresponding algorithm to perform resolution format conversion processing according to the resolution format notified in advance, and the specific method comprises the following steps: and according to the third resolution format corresponding to the acquired N ' frame video image, restoring the converted N ' frame video image to acquire effective pixel points in the N ' frame video image, and according to the effective pixel points and the second resolution format matched with the display screen, performing resolution format conversion on the effective pixel points to process the effective pixel points into a second resolution format consistent with the display screen.
In this embodiment, the nth frame and the nth' frame are the same frame in time series, but the image itself is changed.
For example, as shown in fig. 3, there are processing algorithms in FRC with different resolution formats, such as modes 1-8 of the previous embodiment. As shown in fig. 5, assuming that the third resolution format of the video image output by the buffer module is not matched with the fourth resolution format, the video image may be pre-processed by the display processing module and then sent to the FRC for processing, the FRC processes the video image pre-processed by the display processing module according to the third resolution format and processes the video image into the second resolution format matched with the display screen, the left image in fig. 5 corresponds to the video image processed by the display processing module, and the right image is the video image processed by the FRC.
As shown in fig. 5, the first resolution format of the upper frame video image is 2560 × 1440, the second resolution format is 3840 × 2160, the first resolution format of the 2 nd frame video image is 3840 × 2160, and the second resolution format is 3840 × 2160.
Further, in this embodiment, the following operations may be performed before step 205:
the SOC informs a frame frequency conversion module FRC of a first resolution format of the decoded 1 st frame video image;
for each subsequent frame of video image, the SOC monitors the change condition of the third resolution format of the video image, and if the third resolution format of the Mth frame of video image is different from the third resolution format of the M-1 frame of video image, the third resolution format of the Mth frame of video image is notified to a frame frequency conversion module FRC, so that the FRC can acquire the third resolution format of the Mth frame of video image in advance when receiving the Mth frame of video image;
wherein M is a positive integer greater than 1.
Specifically, when monitoring that the third resolution format of the video image at the source end is changed, the decoding module of the SOC notifies the FRC of the changed third resolution format through the I2C or the SPI via the V-By-One interface, that is, notifies the FRC of the third resolution format of the video image, so that the FRC can call a corresponding processing method to convert the resolution format of the video image after receiving the video image output By the display processing module. The FRC has the main function of restoring the received video image to the original effective resolution and converting the video image into a video image in accordance with the second resolution format of the display screen.
In this embodiment, before sending to the FRC, preprocessing is performed in the display processing module, which mainly aims to ensure that the resolution of the video image entering the FRC is fixed and does not change, and the pixel clocks are uniform; assuming that the fourth resolution format is 3840 × 2160 and the resolution format of the decoded nth frame video image is 1920 × 1080, the nth frame video image is processed into the fourth resolution format 3840 × 2160 in a unified manner, and this process does not perform resolution format conversion Upscaler processing on the video image itself, but uses the original video image as an effective pixel as a part of 3840 × 2160, and when the resolution of the original video image is lower than 3840 × 2160, the rest parts are replaced by black pixels or other non-effective pixels, as shown in the left half part in fig. 5.
Alternatively, assuming that the fourth resolution format is 3840 × 2160, the resolution format of the decoded video image is 3840 × 2160, and the second resolution format matching the display screen is 1920 × 1080, the decoded video image may be directly output to the FRC without processing in the display processing module, and the FRC performs resolution format conversion processing (Downscaler processing) to obtain the video image matching the display screen in the second resolution format.
Assuming that the third resolution format of the 4 th frame is changed and is not matched with the fourth resolution format, at this time, the system is actually processing F1, the decoding module may notify the FRC of the third resolution format of the 4 th frame through a V-By-One interface through, for example, I2C or SPI, and after the FRC acquires the third resolution format, when the video image of the 4 th frame output By the display processing module is received, the FRC invokes a corresponding processing algorithm to perform resolution format conversion processing; in the whole process, the signal resolution from the display processing module to the FRC and from the FRC to the display screen is stable all the time, the pixel clocks are unified, and the FRC obtains the third resolution format of the video image 3 frames in advance before the resolution format conversion is carried out on the video image, so that the processing time is short, and the problem of black screen caused by the change of the resolution of the video to be played can be avoided.
In the processing method for video playing provided by this embodiment, when the first resolution format of the 1 st frame of video image and the subsequent change of the third resolution format are monitored, the third resolution format of the video image is synchronously notified to the FRC for algorithm preparation; the decoded video images are sequentially stored in a second cache module, so that the number of the image frames stored in the second cache module is P2(ii) a Then the display processing module carries out resolution format conversion processing on the video images output from the second cache module in sequence to obtain the video images in the fourth resolution format, and outputs the video images after the conversion processing to the FRC for processing, and the FRC outputs the video images to the FRC according to at least P2The third resolution format sent by the frame calls a corresponding algorithm to process; compared with the prior art, the video image output after decoding is subjected to unified resolution format conversion and converted into the video image with the unified fourth resolution format, namely, the video image converted into the fourth resolution is filled by the ineffective Pixel points, so that the video image is unified into the fourth resolution before being converted into the second resolution matched with the display screen, namely, for the FRC, the video signal output of the SOC is stable, namely, the Pixel Clock needing to be output to the display screen cannot be changed, correspondingly, the FRC is not required to perform Clock synchronization processing, and simultaneously, before the FRC performs corresponding resolution format conversion on the video image, and the Clock synchronization processing is performed on the video imageThe third resolution format of the video image is known in advance, so that the processing time is short, and the technical problem of black screen caused by the change of the resolution of the video to be played is further improved.
In the above embodiment, the modules before FRC are all modules in SOC.
On the basis of the foregoing embodiment, further, before step 101 in this embodiment, the following operations may also be performed:
monitoring the network bandwidth of the current user;
then, obtaining a decoded video image corresponding to the video to be played may specifically be implemented by the following method:
acquiring a video to be played in a resolution format corresponding to the network bandwidth of a current user;
and decoding the video to be played to obtain a decoded video image.
Specifically, in this embodiment, assuming that the resolution format of the current video image is as in mode 1, and the network bandwidth of the user at this time is not enough to play the video in the resolution format, the SOC requests the server for the video to be played in the resolution format corresponding to the network bandwidth of the current user according to the monitored network bandwidth of the current user, so as to avoid a pause phenomenon in the video playing process.
Optionally, in this embodiment, step 101 may also be implemented by:
receiving a video to be played in a resolution format corresponding to the network bandwidth of the current user and pushed by a server;
and decoding the video to be played to obtain a decoded video image.
Specifically, the server side can push the video with the corresponding resolution format according to the network bandwidth of the user, so that the pause phenomenon in the video playing process is avoided.
The resolution format of the current video image is as in mode 1, and the network bandwidth of the user at this time is not enough to play the video in the resolution format, the server side will push the video in the corresponding resolution format according to the network bandwidth of the user.
Fig. 6 is a schematic structural diagram of a video playback processing apparatus according to an embodiment of the present invention. As shown in fig. 6, the processing apparatus for playing video according to this embodiment may include: the device comprises a decoding module, a format conversion module, a first display processing module and a frame frequency conversion module;
the decoding module is used for acquiring a decoded video image corresponding to a video to be played;
the format conversion module is used for converting the resolution format of each frame of video image into a first resolution format when the resolution format of each frame of video image is not matched with the first resolution format before converting the resolution format of each frame of video image into a second resolution format matched with a display screen if the code rate or the frame rate of the video to be played is less than or equal to a preset value;
the video image converted into the first resolution format comprises effective pixel points and pixel points copied by the effective pixel points; the effective pixel points are pixel points in the video image before conversion;
the first display processing module is used for converting a third resolution format of the video image into a fourth resolution format when the third resolution format of the video image is not matched with the fourth resolution format if the code rate or the frame rate of the video to be played is greater than a preset value; the frame frequency conversion module is used for converting the resolution format of the video image converted into the fourth resolution format into a second resolution format matched with the display screen according to the pre-acquired third resolution format of the video image;
the video image converted into the fourth resolution format comprises effective pixel points and ineffective pixel points; the effective pixel points are pixel points in the video image before conversion.
Optionally, as an implementable manner, the method further includes:
a first buffer module for sequentially storing the P converted into the first resolution format1Frame videoAn image; wherein, P1Is a positive integer;
a second display processing module to:
acquiring each frame of video image output at constant speed from the first cache module, and converting the first resolution format of the video image into the second resolution format;
and outputting each frame of video image converted into the second resolution format to the display screen.
Optionally, as an implementable manner, the apparatus of this embodiment, the second display processing module, is specifically configured to convert the first resolution format of each frame of the converted video image into a second resolution format matched with the display screen according to an image scaling interpolation algorithm.
Optionally, as an implementable manner, the second display processing module is further configured to perform image quality processing on each frame of the video image output at a constant speed from the first cache module.
Optionally, as an implementable manner, the method further includes:
a second buffer module for storing the decoded P in sequence2A frame video image; wherein, P2Is a positive integer;
the first display processing module is specifically configured to:
and acquiring each frame of video image output at constant speed from the second cache module, and converting the third resolution format of the video image into the fourth resolution format when the third resolution format of the video image is not matched with the fourth resolution format.
Optionally, as an implementable manner, the frame rate conversion module is specifically configured to:
and extracting effective pixel points from the video image converted into the fourth resolution format according to the pre-acquired third resolution format of the video image, and converting the fourth resolution format of the video image into a second resolution format matched with the display screen.
Optionally, as an implementable manner, the decoding module is specifically configured to:
informing a frame frequency conversion module of a third resolution format of the decoded 1 st frame video image;
for each subsequent frame of video image, monitoring a change condition of a third resolution format of the video image, and if the third resolution format of the mth frame of video image is different from the third resolution format of the M-1 frame of video image, notifying the third resolution format of the mth frame of video image to a frame frequency conversion module so that the frame frequency conversion module can acquire the third resolution format of the mth frame of video image in advance when receiving the mth frame of video image;
wherein M is a positive integer greater than 1.
Optionally, as an implementable manner, the apparatus of this embodiment further includes:
the monitoring module is used for monitoring the current network bandwidth of the user;
the decoding module is specifically configured to:
acquiring the video to be played in a resolution format corresponding to the network bandwidth of the current user;
and decoding the video to be played to obtain the decoded video image.
Optionally, as an implementable manner, the apparatus of this embodiment further includes:
the receiving module is used for receiving the video to be played in a resolution format corresponding to the network bandwidth of the current user and pushed by the server;
the decoding module is specifically configured to:
and decoding the video to be played to obtain the decoded video image.
It should be noted that, for the device embodiment, since it basically corresponds to the method embodiment, the relevant points may be referred to the partial description of the method embodiment.
Fig. 7 is a schematic structural diagram of a television according to an embodiment of the invention. As shown in fig. 7, the television of this embodiment may include: a processor 701, a memory 702, and a communication interface 703;
a memory 702 for storing programs; in particular, the program may include program code comprising computer operating instructions. The memory 702 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
A communication interface 703 for receiving signals or data;
the processor 701 is configured to execute the program stored in the memory, and is configured to execute the technical solution provided by the method embodiment of the present invention, which has similar implementation principles and technical effects, and reference may be made to the description of the method embodiment portion, and details are not described here again.
In the embodiment of the present invention, the processor may specifically include SOC and FRC.
The decoding module, the monitoring module, the format conversion module, the first display processing module, the second display module and the frame rate conversion module in the above embodiments may be implemented by a processor;
the first cache module and the second cache module may be implemented by a memory; the receiving module may be implemented by a communication interface.
It should be noted that, for the television embodiment, since it basically corresponds to the method embodiment, the relevant points may be referred to the partial description of the method embodiment.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (4)
1. A television, comprising:
the SOC informs the frame frequency conversion module FRC of the third resolution format of the decoded 1 st frame of video image, monitors the change of the third resolution format of each frame of video image, and if the third resolution format of the M frame of video image is different from the third resolution format of the previous frame of video image, informs the frame frequency conversion module FRC of the third resolution format of the M frame of video image, and converts the video image in the third resolution format into the fourth resolution format;
and the frame frequency conversion module FRC calls a resolution format conversion processing algorithm corresponding to the changed third resolution format according to the SOC notification, and performs resolution format conversion on the Mth frame of video image.
2. The television of claim 1, wherein the system on a chip SOC further comprises a second cache module;
the SOC is used for decoding P2And when the third resolution format of the video image is not matched with the fourth resolution format, converting the third resolution format of the video image into the fourth resolution format.
3. The television of claim 2, wherein P is2Is 3.
4. The television of claim 1, wherein when the third resolution format is lower than the fourth resolution format, the original video image is used as valid pixels, and the rest of the original video image is supplemented by black pixels or other non-valid pixels, wherein the valid pixels are pixels in the video image before conversion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810668619.8A CN108833975B (en) | 2016-03-18 | 2016-03-18 | Video playing processing method and device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810668619.8A CN108833975B (en) | 2016-03-18 | 2016-03-18 | Video playing processing method and device |
| CN201610158743.0A CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610158743.0A Division CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108833975A CN108833975A (en) | 2018-11-16 |
| CN108833975B true CN108833975B (en) | 2021-05-18 |
Family
ID=56250922
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610158743.0A Active CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
| CN201810668619.8A Active CN108833975B (en) | 2016-03-18 | 2016-03-18 | Video playing processing method and device |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610158743.0A Active CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN105744358B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534840B (en) * | 2016-10-31 | 2018-10-26 | 青岛海信电器股份有限公司 | The detection method and device of vision signal |
| CN106909533A (en) * | 2016-11-14 | 2017-06-30 | 上海仪电鑫森科技发展有限公司 | Suitable for multi-platform examination editing system |
| CN106970770B (en) * | 2017-03-31 | 2020-08-25 | 联想(北京)有限公司 | Display adjustment method, electronic equipment and device |
| TWI629661B (en) * | 2017-10-17 | 2018-07-11 | 冠捷投資有限公司 | Overclocking display method and display |
| CN108573477A (en) * | 2018-03-14 | 2018-09-25 | 深圳怡化电脑股份有限公司 | Eliminate method, system and the terminal device of image moire fringes |
| CN108874945B (en) * | 2018-06-04 | 2023-03-21 | 联想(北京)有限公司 | Data processing method and electronic equipment |
| CN109068172A (en) * | 2018-08-01 | 2018-12-21 | 威创集团股份有限公司 | Processor windowing method, device, equipment and readable storage medium storing program for executing |
| KR102521834B1 (en) * | 2018-08-21 | 2023-04-17 | 삼성전자주식회사 | Method of providing image to vehicle, and electronic device therefor |
| CN112449229B (en) * | 2019-09-04 | 2022-01-28 | 海信视像科技股份有限公司 | Sound and picture synchronous processing method and display equipment |
| CN110636372B (en) * | 2019-10-08 | 2022-02-25 | 未来电视有限公司 | Video decoding method, video playing device, electronic equipment and storage medium |
| CN111479154B (en) * | 2020-04-03 | 2022-03-22 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
| CN112637656B (en) * | 2020-12-15 | 2023-02-17 | 海宁奕斯伟集成电路设计有限公司 | Channel configuration method and device, electronic equipment and readable storage medium |
| CN112752152B (en) * | 2020-12-28 | 2022-11-25 | 海信视像科技股份有限公司 | Delivery video playing method and display equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1924931A (en) * | 2005-08-31 | 2007-03-07 | 株式会社东芝 | Video rendering apparatus and method |
| CN1925544A (en) * | 2005-08-31 | 2007-03-07 | 松下电器产业株式会社 | Image data processing device |
| CN101277365A (en) * | 2007-03-27 | 2008-10-01 | 佳能株式会社 | Image processing device and image processing method |
| CN101662606A (en) * | 2008-08-29 | 2010-03-03 | 株式会社东芝 | Video display apparatus and video display method |
| CN103489173A (en) * | 2013-09-23 | 2014-01-01 | 百年金海科技有限公司 | Video image super-resolution reconstruction method |
| CN103596015A (en) * | 2013-11-05 | 2014-02-19 | 广东威创视讯科技股份有限公司 | Method and system for processing image |
| US8681866B1 (en) * | 2011-04-28 | 2014-03-25 | Google Inc. | Method and apparatus for encoding video by downsampling frame resolution |
| CN104135637A (en) * | 2014-07-01 | 2014-11-05 | 宁波摩米创新工场电子科技有限公司 | Image processing method and image processing device of converting low resolution to high resolution |
| CN104981766A (en) * | 2014-04-28 | 2015-10-14 | 华为终端有限公司 | Method for displaying data on screen and display control device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7199837B2 (en) * | 2001-11-13 | 2007-04-03 | Ati Technologies, Inc. | System for improved ratiometric expansion and method thereof |
| US7420618B2 (en) * | 2003-12-23 | 2008-09-02 | Genesis Microchip Inc. | Single chip multi-function display controller and method of use thereof |
| CN101883277A (en) * | 2009-05-08 | 2010-11-10 | 尚福兵 | Low resolution video file playing method and device |
| CN104410904A (en) * | 2014-12-25 | 2015-03-11 | 安科智慧城市技术（中国）有限公司 | Video playing method and video playing device |
-
2016
- 2016-03-18 CN CN201610158743.0A patent/CN105744358B/en active Active
- 2016-03-18 CN CN201810668619.8A patent/CN108833975B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1924931A (en) * | 2005-08-31 | 2007-03-07 | 株式会社东芝 | Video rendering apparatus and method |
| CN1925544A (en) * | 2005-08-31 | 2007-03-07 | 松下电器产业株式会社 | Image data processing device |
| CN101277365A (en) * | 2007-03-27 | 2008-10-01 | 佳能株式会社 | Image processing device and image processing method |
| CN101662606A (en) * | 2008-08-29 | 2010-03-03 | 株式会社东芝 | Video display apparatus and video display method |
| US8681866B1 (en) * | 2011-04-28 | 2014-03-25 | Google Inc. | Method and apparatus for encoding video by downsampling frame resolution |
| CN103489173A (en) * | 2013-09-23 | 2014-01-01 | 百年金海科技有限公司 | Video image super-resolution reconstruction method |
| CN103596015A (en) * | 2013-11-05 | 2014-02-19 | 广东威创视讯科技股份有限公司 | Method and system for processing image |
| CN104981766A (en) * | 2014-04-28 | 2015-10-14 | 华为终端有限公司 | Method for displaying data on screen and display control device |
| CN104135637A (en) * | 2014-07-01 | 2014-11-05 | 宁波摩米创新工场电子科技有限公司 | Image processing method and image processing device of converting low resolution to high resolution |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105744358B (en) | 2018-09-14 |
| CN105744358A (en) | 2016-07-06 |
| CN108833975A (en) | 2018-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108833975B (en) | Video playing processing method and device | |
| US11985386B2 (en) | Remote user interface | |
| EP3232669B1 (en) | Video frame processing method, video processing chip, motion estimation and motion compensation chip | |
| CN110999275B (en) | Video signal non-black screen switching processing method and device | |
| CN105681720B (en) | The processing method and processing device of video playing | |
| US9832421B2 (en) | Apparatus and method for converting a frame rate | |
| US8111932B2 (en) | Digital image decoder with integrated concurrent image prescaler | |
| US20220264129A1 (en) | Video decoder chipset | |
| EP2779152A1 (en) | Display apparatus and control method thereof for applying motion compensation to remove artifacts from images | |
| CN113825020B (en) | Video definition switching method, device, equipment, storage medium and program product | |
| CN114285958B (en) | Image processing circuit, image processing method, and electronic apparatus | |
| US8593575B2 (en) | Video display apparatus for shortened-delay processing of a video signal and video processing method | |
| JP4691193B1 (en) | Video display device and video processing method | |
| EP1607934A2 (en) | Blur reduction in liquid crystal displays by frame rate control | |
| CN105812923B (en) | Play handling method and device based on video on demand | |
| US20230086916A1 (en) | Image processing apparatus and image processing method | |
| JP5259867B2 (en) | Video display device and video processing method | |
| CN114205646B (en) | Data processing method, device, electronic equipment and storage medium | |
| CN118264767A (en) | Super-resolution function control method, device, equipment and medium | |
| KR100759224B1 (en) | Method for displaying video of display apparatus | |
| CN116132737A (en) | Data processing method, live broadcast method and device, electronic equipment and storage medium | |
| CN117749961A (en) | Video switching method and video processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant after: Hisense Visual Technology Co., Ltd. Address before: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |