[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN110149554A - Method, apparatus, electronic equipment and the storage medium of video image processing - Google Patents

Method, apparatus, electronic equipment and the storage medium of video image processing Download PDF

Info

Publication number
CN110149554A
CN110149554A CN201910472833.0A CN201910472833A CN110149554A CN 110149554 A CN110149554 A CN 110149554A CN 201910472833 A CN201910472833 A CN 201910472833A CN 110149554 A CN110149554 A CN 110149554A
Authority
CN
China
Prior art keywords
video image
processed
pass filter
target
low
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910472833.0A
Other languages
Chinese (zh)
Other versions
CN110149554B (en
Inventor
胡小朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910472833.0A priority Critical patent/CN110149554B/en
Publication of CN110149554A publication Critical patent/CN110149554A/en
Application granted granted Critical
Publication of CN110149554B publication Critical patent/CN110149554B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/21Circuitry for suppressing or minimising disturbance, e.g. moiré or halo

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the present application discloses method, apparatus, electronic equipment and the storage medium of a kind of video image processing.The method includes obtaining the video image to be processed of image acquisition element acquisition;Fuzzy processing is carried out to the video image to be processed using target low-pass filter, the Fuzzy processing is used to reduce the high fdrequency component in the video image to be processed;Coding compression is carried out to the video image to be processed after progress Fuzzy processing, obtains target video image;Transmit the target video image.This method before inputing to encoder by passing through Fuzzy processing to video image data, reduce the high fdrequency component in video image, the video image after handling may be implemented and reduce the uneven problem of data volume distribution when being encoded by the encoder, so that after video binary encoding, mosaic, blocking artifact are reduced in playing process, improve broadcasting fluency.

Description

Method, apparatus, electronic equipment and the storage medium of video image processing
Technical field
This application involves technical field of video image processing, method, dress more particularly, to a kind of video image processing It sets, electronic equipment and storage medium.
Background technique
With the development of Internet technology and electronic device technology, more and more electronic equipments are higher equipped with pixel Camera, and the camera pixel of electronic equipment is higher and higher, the clarity for recording video out is also higher and higher.Although electronics The update frequency of equipment camera is very high, but the bandwidth renewal speed of the channel for carrying out transmission of video is very slow, because This transmission bandwidth has limitation, to limit the code rate of the transmitted video of electronic equipment, and when code rate is restricted the case where Under, the case where mosaic, blocking artifact are easy to appear under current video coding framework, broadcasting for video image of strong influence Put effect.
Summary of the invention
In view of the above problems, present applicant proposes a kind of method, apparatus of video image processing, electronic equipment and storages Medium, to improve the above problem.
In a first aspect, the embodiment of the present application provides a kind of method of video image processing, it is applied to electronic equipment, it is described Method includes: the video image to be processed for obtaining image acquisition element acquisition;Using target low-pass filter to described to be processed Video image carries out Fuzzy processing, and the Fuzzy processing is used to reduce the high fdrequency component in the video image to be processed; Coding compression is carried out to the video image to be processed after progress Fuzzy processing, obtains target video image;Described in transmission Target video image.
Second aspect, the embodiment of the present application provide a kind of device of video image processing, run on electronic equipment, described Device includes: that video image obtains module, for obtaining the video image to be processed of image acquisition element acquisition;At video image Module is managed, for carrying out Fuzzy processing to the video image to be processed using target low-pass filter, at the blurring Manage the high fdrequency component for reducing the video image to be processed;Encoding video pictures module, for progress Fuzzy processing The video image to be processed afterwards carries out coding compression, obtains target video image;Video image output module, is used for transmission The target video image.
The third aspect, the embodiment of the present application provide a kind of electronic equipment, including one or more processors and storage Device;One or more programs are stored in the memory and are configured as being executed by one or more of processors, institute It states one or more programs and is configured to carry out method described in above-mentioned first aspect.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, the computer-readable storage Program code is stored in medium, wherein execute method described in above-mentioned first aspect in said program code operation.
Method, apparatus, electronic equipment and the storage medium of a kind of video image processing provided by the present application, pass through acquisition The video image to be processed of image acquisition element acquisition uses then before carrying out coding compression to video image to be processed Target low-pass filter carries out Fuzzy processing to video image to be processed, to reduce the high fdrequency component of video image to be processed, Coding compression is carried out to the video image to be processed after progress Fuzzy processing again, target video image is obtained, then transmits mesh Mark video image.Before realizing through the above way video image inputing to encoder, by low-pass filter with Video image does High frequency filter to realize carry out Fuzzy processing, so that the video image encoded that carries out that encoder is got passes through Crossing filtering processing has reduced high fdrequency component, realizes video image and reduces data volume distribution unevenness when being encoded by the encoder The problem of, so that mosaic, blocking artifact are reduced in playing process after video binary encoding, so that result of broadcast connects It passes through unanimously, improves broadcasting fluency.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 shows the method flow diagram of the method for the video image processing of one embodiment of the application proposition.
Fig. 2 shows the method flow diagrams of the method for the video image processing of another embodiment proposition of the application.
Fig. 3 shows the method flow diagram of the step S230 in Fig. 2.
Fig. 4 shows the method flow diagram of the step S233 in Fig. 3.
Fig. 5 shows the process flow example block diagram of the method for the video image processing of the embodiment of the present application proposition.
Fig. 6 shows the structural block diagram of the device of the video image processing of the embodiment of the present application proposition.
The electronics that Fig. 7 shows the method for executing the video image processing according to the embodiment of the present application of the application is set Standby structural block diagram.
Fig. 8 is the embodiment of the present application for saving or carrying the video image processing realized according to the embodiment of the present application Method program code storage unit.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall in the protection scope of this application.
With the development of science and technology, the pixel of the camera of the electronic equipments such as mobile phone, tablet computer is higher and higher, recording is come out Video image clarity it is also higher and higher.As a kind of mode, two cameras can be arranged in usual electronic equipment, and present The electronic equipment of three camera even four cameras also starts to emerge one after another, furthermore, the update of the camera of electronic equipment Replacement frequency is very high, is more clear so that shooting the video image come, very big to meet user's use demands.
But inventor is found that while that the update frequency of the camera of electronic equipment is very high, but transmission channel Bandwidth renewal speed is but very slow, so transmission bandwidth has limitation within a certain period of time, limits electronic equipment video The code rate of image data, so as to cause video image broadcasting when be easy to appear mosaic, blocking artifact or Caton situations such as, influence User's viewing experience.
Therefore, inventors herein proposing improves video image in the application there is the video figure of situations such as mosaic and Caton As method, apparatus, electronic equipment and the storage medium of processing.
Present embodiments are specifically described below in conjunction with attached drawing.
Referring to Fig. 1, a kind of method of video image processing provided by the embodiments of the present application, is applied to electronic equipment, institute The method of stating includes:
Step S110: the video image to be processed of image acquisition element acquisition is obtained.
Wherein, image acquisition element refers to being configured in electronic equipment for acquiring the camera of video image data. In the embodiment of the present application, video image to be processed is the image for needing to carry out Video coding after image acquisition element acquires.Furthermore Processing video image, which can be to distribute after same frame video image interior coding is compressed there may be data volume, unevenly leads to one The fuzzy video image of clear another part is distinguished, or can also be may after coding compression between adjacent several frame video images It will appear data volume and distribute uneven, video image other image-mosaics more than clear so as to cause piece image, optionally, to Processing video image can make the result of broadcast of video image poor, play the problems such as not smooth.
As a kind of mode, video image can be acquired after camera starting in real time, and electronic equipment is detecting camera shooting After head starting, the video image that camera acquires in real time can be constantly cached.It should be noted that electronics in the embodiment of the present application The video image that the camera that equipment obtains acquires in real time may have the feelings such as Caton, mosaic because being limited by transmission code rate Condition, so that the fluency of video image broadcasting is influenced, then it is understood that can be by camera video collected in real time Image again shows video image to provide after the video image to be processed is processed as video image to be processed User's displaying live view is given, thus, electronic equipment can video image realization collected obtains in real time by constantly caching camera The video image to be processed for taking image acquisition element to acquire.
Step S120: Fuzzy processing, the mould are carried out to the video image to be processed using target low-pass filter Gelatinization processing is for reducing the high fdrequency component in the video image to be processed.
It is understood that having generally included high fdrequency component and low frequency component in image.Wherein, high fdrequency component (high frequency Signal) correspond to the violent part of image change, that is, the edge (profile) and detail section of image.And low frequency component (low frequency signal) represents brightness or the slow region of gray-value variation in image, that is, large stretch of flat area in image Domain describes the major part of image.
It can for the video image to be processed that camera is shot according to different image configuration parameters as a kind of mode To carry out Fuzzy processing to it using different target low-pass filters.In this case, electronic equipment is taken the photograph detecting As head starting after, available current image configuration parameter, so as to according to mesh corresponding to current image configuration parameter It marks low-pass filter and Fuzzy processing is carried out to video image to be processed, reduce the high fdrequency component in video image to be processed.
Step S130: coding compression is carried out to the video image to be processed after progress Fuzzy processing, obtains target Video image.
Video image to be processed after Fuzzy processing reduces the high fdrequency component in video image, to obscuring Change that treated that video image to be processed carries out coding compression, it is possible to reduce data volume distribution is not after encoding video pictures compression Equal problem is distributed more uniform target video image so as to obtain data volume.
Step S140: the target video image is transmitted.
Method, apparatus, electronic equipment and the storage medium of a kind of video image processing provided by the present application, pass through acquisition The video image to be processed of image acquisition element acquisition uses then before carrying out coding compression to video image to be processed Target low-pass filter carries out Fuzzy processing to video image to be processed, to reduce the high fdrequency component of video image to be processed, Coding compression is carried out to the video image to be processed after progress Fuzzy processing again, target video image is obtained, then transmits mesh Mark video image.Before realizing through the above way video image inputing to encoder, by low-pass filter with Video image does High frequency filter convolution to realize carry out Fuzzy processing, so that the video figure encode that encoder is got As having reduced high fdrequency component by filtering processing, realizes video image and reduce data volume distribution when being encoded by the encoder Uneven problem, so that mosaic, blocking artifact are reduced in playing process after video binary encoding, so that playing effect Fruit is coherent consistent, improves broadcasting fluency.
Referring to Fig. 2, a kind of method of video image processing provided by the embodiments of the present application, is applied to electronic equipment, institute The method of stating includes:
Step S210: the video image to be processed of image acquisition element acquisition is obtained.
Step S220: the image configuration parameter of the video image to be processed is obtained.
Wherein, image configuration parameter may include that the resolution ratio of video image to be processed and transmission code rate (also can wrap More or other parameters are included, are not limited thereto, for example, it is also possible to include frame per second).As a kind of mode, for the ease of right Result of broadcast and fluency during transmission of video images to be processed are adjusted, the electronic equipment in the embodiment of the present application The image configuration parameter of video image to be processed can be obtained when receiving related application and calling video record function.
As a kind of mode, electronic equipment can be pre-configured with various video image resolution ratio and select for user, and different Video image resolution ratio can be adapted to corresponding transmission code rate, for example, electronic equipment can be according to the text of captured video image Part size automatic adaptation transmission code rate.In this case, when electronic equipment detects camera starting, electronic equipment can be with The resolution ratio of the selected video image of active user is obtained, and then obtains the biography of video image according to the resolution ratio of video image Defeated code rate, to realize the resolution ratio and code rate for obtaining video image to be processed.
Alternatively, with the distance of camera shooting distance, the difference of shooting article or shooting angle Difference, the resolution ratio and code rate of video image can be with real-time changes, for example, user can shoot interface to captured in camera The resolution ratio of video image is adjusted in real time.So in this case, electronic equipment can start detecting camera Afterwards, the moving distance and mobile trend of real-time monitoring camera, while monitoring whether there is the image for acting on electronic equipment Configuration parameter adjustment instruction, in order to which the image configuration parameter of video image to be processed can be obtained in real time.Wherein, electronics is set The standby moving distance and mobile trend that detection camera can be realized by the detection of focusing.
For example, being shot at sunset when by electronic equipment, if it is desired to shoot sunset gradually in a specific application scenarios Evanescent scene can shoot the specific disappearance process of sunset by adjusting the resolution ratio of camera, optionally, Before sunset disappearance, shooting image can be amplified, before sunset will disappear, shooting image is reduced, it can be with The scene that sunset dies down is highlighted, then, as a kind of mode, electronic equipment can pass through the adjusting of real-time detection camera Situation obtains the image configuration parameter of video image to be processed.
Step S230: the target low-pass filter is obtained based on described image configuration parameter.
It is understood that with the difference of camera shooting article and the adjustment or shooting angle of shooting distance Deng different meeting so that video image to be processed image quality and picture fluency difference, then for video image to be processed Data volume distribution is more uniform, and then promotes the fluency that video image plays, and can obtain target based on image configuration parameter Low-pass filter, in order to targetedly adjust.Wherein, target low-pass filter is used to carry out low pass to video image to be processed Filtering reduces the high fdrequency component of video image to be processed, retains low-frequency information, target corresponding to different image configuration parameters Low-pass filter can be different, can also be identical (if target low-pass filter corresponding to different images configuration parameter is being set Threshold range in).
Referring to Fig. 3, as a kind of mode, step S230 may include:
Step S231: the initial code of the video image to be processed is calculated based on the resolution ratio and the transmission code rate Rate.
Wherein, initial bit rate indicates the number that real-time video image to be processed captured by camera transmits within the unit time According to digit.As a kind of mode, in the case where obtaining the resolution ratio and transmission code rate of video image to be processed, Ke Yigen According to the captured in real-time data of video image captured by camera, video image to be processed is calculated based on resolution ratio and transmission code rate Initial bit rate.
In one implementation, video image to be processed can use video image captured by camera from initial bit rate The product of the input format bit numbers (can be interpreted as the transmission code rate) of data, resolution ratio and frame per second is calculated. For example, resolution ratio is the video image of 720P, frame per second is 30 frames/second, and the data that camera provides are YUV420 format, a pixel 12 bits are accounted for, then initial bit rate can indicate are as follows: 12*720*1280*30 bit.
Step S232: the target bit rate of the video image to be processed is obtained.
As a kind of mode, the electronic equipment in the embodiment of the present application can control camera and be differentiated based on the video image of needs Rate is (for example, it may be the selected preset resolution ratio of user read, is also possible to the mistake in shooting obtained in real time Institute's resolution ratio adjusted in journey) carry out Image Acquisition.Wherein, target bit rate refers to electronic equipment according to told camera The video image resolution ratio needed is adapted to obtain, and optionally, is also possible to specify target bit rate according to actual needs, example Such as, it is possible to specify the target bit rate for the video image that the resolution ratio enumerated in step S231 is 720P is 2Mbps, is not made herein It limits.
Step S233: the target low-pass filter is obtained according to the ratio of the initial bit rate and the target bit rate.
Electronic equipment provided herein can be by the resolution ratio and announcement of the video image of the needs of told camera The coded format and code rate requirement for telling the needs of encoder are supplied to pre-set filter bank, are calculated automatically by filter bank Corresponding filter template (i.e. target low-pass filter) out.For example, as enumerated in abovementioned steps S231 and step S232 Video image initial bit rate and target bit rate ratio K are as follows: original code rate is divided by target bit rate, wherein original code rate is equal to Input format bit number does not have multiplied by resolution ratio multiplied by frame per second, to calculate K=2.
As a kind of mode, filter bank can obtain target low-pass filtering according to the ratio of initial bit rate and target bit rate Device is described in detail below:
Wherein, as a kind of mode, referring to Fig. 4, step S233 may include:
Step S2331: by the ratio and preset multiple threshold ranges of the initial bit rate and the target bit rate It is matched.
As a kind of mode, the more of the ratio of initial bit rate and target bit rate can be preset according to history calculating data A threshold range, target low-pass filter corresponding to different threshold ranges is different, in order to the difference in video image The image of quality carries out corresponding low-pass filtering treatment.For example, can set the ratio of initial bit rate and target bit rate as (0,2], (2,5] and (5 ,+it is infinite] etc. threshold ranges section, then when k belongs to (0,2] when, low-pass filter A can be corresponded to, when k belongs to (2,5] when, can correspond to low-pass filter B, and when k belongs to (5 ,+it is infinite] when, low-pass filter C can be corresponded to, wherein low Bandpass filter A, B, C are different target low-pass filter respectively.For example, with a biggish range side for threshold range The increase of dividing value, corresponding low-pass filter filter out the effect of high fdrequency component with regard to smaller.In this case, low-pass filter C, the effect of the filters high frequency content of low-pass filter B and low-pass filter A can be promoted successively.It should be noted that herein The digital section enumerated be not it is absolute, only as an example, do not constitute any restriction.
Wherein it is possible to understand, k value is bigger, and treated that video image is not obscure for corresponding low-pass filter (i.e. more clear), also, show that video image is more not easy to occur mosaic, blocking artifact in encoded when k is sufficiently large, can be with Low-pass filter is not needed.
Step S2332: using with low-pass filter corresponding to the matched threshold range of the ratio as target low pass filtered Wave device.
As a kind of mode, the video image to be processed in the embodiment of the present application may include multi-frame video image, at this It, can be by detecting current frame video image to be processed and previous frame video image in video image to be processed in the case of kind Between changed with the presence or absence of abnormal, wherein abnormal change refers to current frame video image and previous frame video figure to be processed The content change of picture is greater than goal condition, and optionally, the content includes but is not limited to the data volume distribution situation of video image In (for example, with the presence or absence of serious sharpening phenomenon etc. between current frame video image and previous frame video image), image are shown Hold etc..
In one implementation, abnormal if it does not exist to change, then can will be with the matched threshold range of the ratio The first corresponding low-pass filter is as target low-pass filter.In another implementation, abnormal if it exists to change, that Available second low-pass filter is as target low-pass filter, wherein it should be noted that in the embodiment of the present application The ability that second low-pass filter filters out high fdrequency component is higher than the first low-pass filter.
For example, can be respectively corresponded according in filter bank with multi-frame video image in a specific application scenarios Initial bit rate and the ratio of target bit rate will be set with the matched threshold range of the ratio according to stair-stepping mode, Optionally, staircase areas can be arranged and is divided into several grades, the grade that can filter more high fdrequency components can provide pumping The higher target low-pass filter of head number (optional, low-pass filter herein can be two-dimensional low-pass filter).
Specifically, becoming between current frame video image and previous frame video image to be processed there is no abnormal if detecting It is dynamic, then can directly using with the first low-pass filter corresponding to the matched threshold range of the ratio as target low pass filtered Wave device, for example, being preset from high to low (ability that can be understood as filtering out the high fdrequency component in video image) according to grade The threshold range of ratio are as follows: (0,2], (2,5] and (5 ,+infinite], ratio k=3 that are calculated, then in such cases, Can will with threshold range be (2,5] corresponding to the first low-pass filter as target low-pass filter.And if detect to Exist between the current frame video image and previous frame video image of processing it is abnormal change, then will then choose grade lower than (2, 5] low-pass filter corresponding to as the second low-pass filter, such as can with selected threshold range be (0,2] corresponding to it is low Bandpass filter is as the second low-pass filter, in such cases, using the second low-pass filter as target low-pass filter.
Alternatively, it when the ratio of initial bit rate and target bit rate is met certain condition, or is understood that When sufficiently large for the ratio, the comparison of video image to be processed clearly, can be directly inputted without low-pass filtering treatment It is exported after encoder coding compression, to save the duration of processing video image.So in such a case, it is possible to set initial The specified threshold of the ratio of code rate and target bit rate, so that being reached when detecting ratio described in the video image to be processed that camera is shot It, can be with direct coding, it should be noted that in this case not without low-pass filtering treatment direct coding when to specified threshold It will affect the image quality of video image to be processed.Wherein, the specific value of specified threshold is not construed as limiting, can according to the actual situation into Row setting.
In one implementation, electronic equipment can with the ratio of real-time detection initial bit rate and target bit rate whether with finger Determine threshold value matching, optionally, initial bit rate is matched with the ratio of target bit rate with specified threshold if detecting, then can cancel Target low-pass filter is obtained, Fuzzy processing is carried out before coding compression to cancel, the processing of video image can be shortened Process promotes user experience.
Step S240: convolution algorithm is done to the video image to be processed according to the target low-pass filter.
Wherein, the convolution algorithm in the embodiment of the present application is to carry out Fuzzy processing to video image to be processed.
It is worth noting that, retaining low-frequency information, to be promoted to reduce the high fdrequency component in video image to be processed The image quality of video image and whole result of broadcast (for example, the fluency etc. played), can use acquired target low pass Filter does convolution algorithm to video image to be processed, so that the video image that encoder is got is the view by filtering processing Frequency image, to realize that the data volume distribution of the video image after coding is more uniform.
As a kind of implementation, it is assumed that original video image to be processed is S, by convolution algorithm treated video figure As being S ', target low-pass filter LF is the two-dimensional low-pass filter of n tap, wherein n determined by filter bank, expression It is the tap number (it can be appreciated that coefficient of low-pass filter) of low-pass filter, then place can be treated by S*LF=S ' Reason video image does convolution algorithm, wherein * is convolution.
For example, in a specific application scenarios, it is assumed that target low-pass filter (LF) is the low pass of three taps Filter:
Pixel value in image S ' after so available progress Fuzzy processing on the position (m, n):
Wherein, (m, n) is the coordinate of the certain point on the image S ' after carrying out Fuzzy processing.
Step S250: coding compression is carried out to the video image to be processed after progress Fuzzy processing, obtains target Video image.
As a kind of mode, can based on transmission code rate to the video image to be processed after carrying out Fuzzy processing into Row coding compression, obtains target video image.It is understood that because the template of low-pass filter is that basis is transferred to camera Resolution ratio and be transferred to what the code rate of encoder was calculated, the video figure after Fuzzy processing can be allowed to carry out It, can also be to avoid image data distribution between video frame not as reducing the uneven problem of data volume distribution in input coding device coding Equal problem so that video image binary encoding compression after, play get up it is more smooth, realize reduce mosaic, Phenomena such as blocking artifact, promotes user experience.
Step S260: the target video image is transmitted.
It is introduced below in conjunction with content of the attached drawing 5 to the present embodiment.
As shown in figure 5, the process flow example block diagram of the method for video image processing provided by the embodiments of the present application.Its In, electronic equipment when receiving upper layer (for example, some needs to call the application program of video record function) call configuration option, The resolution ratio (the video image resolution ratio in such as Fig. 5) for the video image for needing camera to provide can be sent to camera, needs Code rate (the requirement code rate in such as Fig. 5) and the compressed format of video image be sent to encoder, while can also be video figure As resolution ratio and transmission code rate is required to be supplied to filter bank, so that filter bank provides Filtering Template (i.e. according to these data Low-pass filter).
As a kind of mode, after camera obtains video image, for the ease of reducing the high frequency division in video image Amount can pass through the low-pass filter of filter bank offer before video image to be sent to encoder and carries out coding compression Fuzzy processing is carried out to video image to be processed, i.e., it is unified to reduce the high fdrequency component even removed in video image, retain Video image to be processed after Fuzzy processing is sent to encoder by low-frequency information, and encoder receives basis It is required that code rate and compressed format carry out coding compression to the video image to be processed after Fuzzy processing, target view is obtained Frequency image, then target image can be transmitted into file by code stream output.Wherein, video image to be processed is carried out at blurring The detailed process of reason may refer to the description in previous embodiment, and details are not described herein.
By carrying out fuzzy filter processing to image to be processed, it can effectively reduce in video coding process and data point occur Probability with tactful mistake, keeps the video display effect after coding more smooth.
It should be noted that as a kind of mode, in order to which the video display effect after guaranteeing coding is more smooth Meanwhile video can still be made to have higher clarity when playing, Fuzzy processing can also be filtered out in the process The relevant parameter of high fdrequency component is stored, for example, the existing region of the high fdrequency component of every frame image.To be encoded in transmission When rear video image, the relevant parameter of the simultaneous transmission high fdrequency component above-mentioned filtered out, so as to when playing video Can the relevant parameter based on the high fdrequency component to video carry out display effect enhancing, for example, promoted video image in each frame High fdrequency component, and then promoted clarity.It also, because is the phase based on the high fdrequency component that each frame video image filters before It closes parameter to carry out carrying out video source modeling to each frame image, it is clear video image can be promoted while video image process plays It is clear while spend, and video can also be made more can restore actual displayed effect when shooting.
A kind of method of video image processing provided by the embodiments of the present application, realizes video image data inputing to volume Before code device, convolution is done by low-pass filter and video image, Fuzzy processing is carried out to video image, so that encoder obtains The inputted video image got is by filtering processing, wherein filter bank can be according to the content that camera is got to being provided The low cylinder filter of target do dynamic adaptation, improve flexibility, then encoded again, may be implemented processing after video Image reduces the uneven problem of data volume distribution when being encoded by the encoder, so that playing after video binary encoding There is no too big effect gap, reduction mosaic, blocking artifact, consistent, the raising broadcasting fluency so that result of broadcast links up.
Referring to Fig. 6, a kind of device 400 of video image processing provided by the embodiments of the present application, runs on electronic equipment, Described device 400 includes:
Video image obtains module 410, for obtaining the video image to be processed of image acquisition element acquisition.
Video image processing module 420, for carrying out mould to the video image to be processed using target low-pass filter Gelatinization processing, the Fuzzy processing are used to reduce the high fdrequency component of the video image to be processed.
As a kind of mode, video image processing module 420 can be used for obtaining the image of the video image to be processed Configuration parameter, then the target low-pass filter is obtained based on described image configuration parameter, then according to the target low pass filtered Wave device does convolution algorithm to the video image to be processed.
Optionally, the image configuration parameter in the embodiment of the present application may include video image to be processed resolution ratio and Transmission code rate, then, in this manner, video image processing module 420 specifically can be used for based on the resolution ratio and The transmission code rate calculates the initial bit rate of the video image to be processed, then obtains the object code of the video image to be processed Then rate can obtain the target low-pass filter according to the ratio of the initial bit rate and the target bit rate.
Wherein, as a kind of mode, can by the ratio of the initial bit rate and the target bit rate with it is preset Multiple threshold ranges are matched, then using with low-pass filter corresponding to the matched threshold range of the ratio as target Low-pass filter.
Optionally, the video image to be processed in the embodiment of the present application may include multi-frame video image, in a kind of realization It, can be by detecting current frame video image and previous frame video figure to be processed in the video image to be processed in mode It is changed as between with the presence or absence of abnormal, abnormal change is that the current frame video image to be processed and the previous frame regard The content change of frequency image is greater than goal condition.As a kind of mode, if it does not exist, then can will be matched with the ratio The first low-pass filter is as target low-pass filter corresponding to threshold range;And alternatively, and if it exists, so Available second low-pass filter is as target low-pass filter, wherein second low-pass filter filters out high fdrequency component Ability be higher than first low-pass filter.
In another implementation, if the initial bit rate is matched with the ratio of the target bit rate with specified threshold, It can so cancel and obtain the target low-pass filter, carry out Fuzzy processing before coding compression to cancel.
Encoding video pictures module 430, for being compiled to the video image to be processed after progress Fuzzy processing Code compression, obtains target video image.
As a kind of mode, encoding video pictures module 430 can be used for based on the transmission code rate to being blurred Treated, and the video image to be processed carries out coding compression, to obtain target video image.
Video image output module 440 is used for transmission the target video image.
It should be noted that Installation practice is mutual corresponding, device implementation with preceding method embodiment in the application Specific principle may refer to the content in preceding method embodiment in example, and details are not described herein again.
A kind of electronic equipment provided by the present application is illustrated below in conjunction with Fig. 7.
Referring to Fig. 7, the method, apparatus based on above-mentioned video image processing, the embodiment of the present application is also provided another Kind can execute the electronic equipment 100 of the method for aforementioned video image procossing.Electronic equipment 100 include intercouple one or Multiple (one is only shown in figure) processors 102, memory 104, network module 106 and image acquisition element 108.Wherein, It is stored with the program that can execute content in previous embodiment in the memory 104, and processor 102 can execute the memory The program stored in 104, memory 104 include device 400 described in previous embodiment.
Wherein, processor 102 may include one or more processing core.Processor 102 utilizes various interfaces and route The various pieces in entire electronic equipment 200 are connected, by running or executing the instruction being stored in memory 104, program, generation Code collection or instruction set, and the data being stored in memory 104 are called, execute the various functions and processing of electronic equipment 200 Data.Optionally, processor 102 can be using Digital Signal Processing (Digital Signal Processing, DSP), scene Programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA) at least one of example, in hardware realize.Processor 102 can integrating central processor (Central Processing Unit, CPU), video image processor (Graphics Processing Unit, GPU) and modem Deng one or more of combination.Wherein, the main processing operation system of CPU, user interface and application program etc.;GPU is used for It is responsible for the rendering and drafting of display content;Modem is for handling wireless communication.It is understood that above-mentioned modulation /demodulation Device can not also be integrated into processor 102, be realized separately through one piece of communication chip.
Memory 104 may include random access memory (Random Access Memory, RAM), also may include read-only Memory (Read-Only Memory).Memory 104 can be used for store instruction, program, code, code set or instruction set.It deposits Reservoir 104 may include storing program area and storage data area, wherein the finger that storing program area can store for realizing operating system Enable, for realizing at least one function instruction (such as touch function, sound-playing function, video image playing function etc.), For realizing the instruction etc. of above-mentioned each embodiment of the method.Storage data area can also store the institute in use of electronic equipment 100 Data (such as phone directory, audio, video data, chat record data) of creation etc..
The network module 106 is used to receive and transmit electromagnetic wave, realizes the mutual conversion of electromagnetic wave and electric signal, from And it is communicated with communication network or other equipment, such as communicated with audio-frequence player device.The network module 106 can Including various existing for executing the circuit elements of these functions, for example, antenna, RF transceiver, digital signal processor, Encryption/deciphering chip, subscriber identity module (SIM) card, memory etc..The network module 106 can be for example mutual with various networks Networking, intranet, wireless network communicate or communicated by wireless network and other equipment.Above-mentioned is wireless Network may include cellular telephone networks, WLAN or Metropolitan Area Network (MAN).For example, network module 106 can carry out letter with base station Breath interaction.
Image acquisition element 108 is for acquiring video image data captured by the camera of electronic equipment 100, including photograph Piece, video etc..Collected video image data is sent to processor 102 by image acquisition element 108, in order to processor 102 pairs of video image data are handled.
Referring to FIG. 8, it illustrates a kind of structural block diagrams of computer readable storage medium provided by the embodiments of the present application. Program code is stored in the computer-readable medium 500, said program code can be called by processor and execute above method reality Apply method described in example.
Computer readable storage medium 500 can be such as flash memory, EEPROM (electrically erasable programmable read-only memory), The electronic memory of EPROM, hard disk or ROM etc.Optionally, computer readable storage medium 500 includes non-volatile meter Calculation machine readable medium (non-transitory computer-readable storage medium).Computer-readable storage Medium 500 has the memory space for the program code 510 for executing any method and step in the above method.These program codes can With from reading or be written in one or more computer program product in this one or more computer program product. Program code 510 can for example be compressed in a suitable form.
Method, apparatus, electronic equipment and the storage medium of a kind of video image processing provided by the present application, pass through acquisition The video image to be processed of image acquisition element acquisition uses then before carrying out coding compression to video image to be processed Target low-pass filter carries out Fuzzy processing to video image to be processed, to reduce the high fdrequency component of video image to be processed, Coding compression is carried out to the video image to be processed after progress Fuzzy processing again, target video image is obtained, then transmits mesh Mark video image.Before realizing through the above way video image inputing to encoder, by low-pass filter with Video image does High frequency filter convolution to realize carry out Fuzzy processing, so that the video figure encode that encoder is got As having reduced high fdrequency component by filtering processing, realizes video image and reduce data volume distribution when being encoded by the encoder Uneven problem, so that mosaic, blocking artifact are reduced in playing process after video binary encoding, so that playing effect Fruit is coherent consistent, improves broadcasting fluency.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding: it still can be with It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features;And These are modified or replaceed, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and Range.

Claims (10)

1. a kind of method of video image processing, which is characterized in that be applied to electronic equipment, which comprises
Obtain the video image to be processed of image acquisition element acquisition;
Fuzzy processing is carried out to the video image to be processed using target low-pass filter, the Fuzzy processing is for subtracting High fdrequency component in few video image to be processed;
Coding compression is carried out to the video image to be processed after progress Fuzzy processing, obtains target video image;
Transmit the target video image.
2. the method according to claim 1, wherein described use target low-pass filter to the view to be processed Frequency image carry out Fuzzy processing the step of include:
Obtain the image configuration parameter of the video image to be processed;
The target low-pass filter is obtained based on described image configuration parameter;
Convolution algorithm is done to the video image to be processed according to the target low-pass filter.
3. according to the method described in claim 2, it is characterized in that, described image configuration parameter includes the video figure to be processed The resolution ratio and transmission code rate of picture, described the step of obtaining the target low-pass filter based on described image configuration parameter, wrap It includes:
The initial bit rate of the video image to be processed is calculated based on the resolution ratio and the transmission code rate;
Obtain the target bit rate of the video image to be processed;
The target low-pass filter is obtained according to the ratio of the initial bit rate and the target bit rate.
4. according to the method described in claim 3, it is characterized in that, described according to the initial bit rate and the target bit rate Ratio obtain the target low-pass filter the step of include:
The initial bit rate is matched with the ratio of the target bit rate with preset multiple threshold ranges;
Using with low-pass filter corresponding to the matched threshold range of the ratio as target low-pass filter.
5. according to the method described in claim 4, it is characterized in that, the video image to be processed includes multi-frame video image, It is described to include: as the step of target low-pass filter using with low-pass filter corresponding to the matched threshold range of the ratio
Detect the current frame video image to be processed in the video image to be processed and between previous frame video image whether It is described abnormal to change that be the current frame video image to be processed interior with the previous frame video image there are abnormal variation Hold variation and is greater than goal condition;
If it does not exist, using with the first low-pass filter corresponding to the matched threshold range of the ratio as target low-pass filtering Device;
If it exists, the second low-pass filter is obtained as target low-pass filter, wherein second low-pass filter filters out height The ability of frequency component is higher than first low-pass filter.
6. according to the method described in claim 4, it is characterized in that, it is described will with corresponding to the matched threshold range of the ratio Low-pass filter include: as the step of target low-pass filter
If the initial bit rate is matched with the ratio of the target bit rate with specified threshold, cancels and obtain the target low-pass filtering Device carries out Fuzzy processing before coding compression to cancel.
7. according to any method of claim 3-6, which is characterized in that described pair carry out after Fuzzy processing it is described to Processing video image carries out the step of coding compresses
Coding compression is carried out to the video image to be processed after carrying out Fuzzy processing based on the transmission code rate.
8. a kind of device of video image processing, which is characterized in that run on electronic equipment, described device includes:
Video image obtains module, for obtaining the video image to be processed of image acquisition element acquisition;
Video image processing module, for being carried out at blurring using target low-pass filter to the video image to be processed Reason, the Fuzzy processing are used to reduce the high fdrequency component of the video image to be processed;
Encoding video pictures module, for carrying out coding compression to the video image to be processed after progress Fuzzy processing, Obtain target video image;
Video image output module is used for transmission the target video image.
9. a kind of electronic equipment, which is characterized in that including image acquisition element, one or more processors and memory;
One or more programs are stored in the memory and are configured as being executed by one or more of processors, institute It states one or more programs and is configured to carry out method as claimed in claim 1 to 7.
10. a kind of computer readable storage medium, which is characterized in that be stored with program generation in the computer readable storage medium Code, wherein perform claim requires any method of 1-7 when said program code is run by processor.
CN201910472833.0A 2019-05-31 2019-05-31 Video image processing method and device, electronic equipment and storage medium Active CN110149554B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910472833.0A CN110149554B (en) 2019-05-31 2019-05-31 Video image processing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910472833.0A CN110149554B (en) 2019-05-31 2019-05-31 Video image processing method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110149554A true CN110149554A (en) 2019-08-20
CN110149554B CN110149554B (en) 2021-06-15

Family

ID=67590192

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910472833.0A Active CN110149554B (en) 2019-05-31 2019-05-31 Video image processing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110149554B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110996131A (en) * 2020-03-02 2020-04-10 腾讯科技(深圳)有限公司 Video encoding method, video encoding device, computer equipment and storage medium
CN111402165A (en) * 2020-03-18 2020-07-10 展讯通信(上海)有限公司 Image processing method, device, equipment and storage medium
CN112087636A (en) * 2020-08-07 2020-12-15 北京博雅慧视智能技术研究院有限公司 Image coding processing method and device, storage medium and terminal
CN112565660A (en) * 2020-12-08 2021-03-26 维沃移动通信有限公司 Image processing method and device
CN112633198A (en) * 2020-12-28 2021-04-09 浙江大华技术股份有限公司 Picture processing method and device, storage medium and electronic device
CN112631524A (en) * 2020-12-29 2021-04-09 杭州海康汽车软件有限公司 Storage medium distribution method and device and electronic equipment
CN114363693A (en) * 2020-10-13 2022-04-15 华为技术有限公司 Image quality adjusting method and device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06233266A (en) * 1993-02-02 1994-08-19 Matsushita Electric Ind Co Ltd Video signal encoder and video signal decoder
WO2000025312A1 (en) * 1998-10-27 2000-05-04 Hitachi Maxell, Ltd. Information recording method and system, image compression/decompression system, system control method, and monitoring system including part or all of them
CN1607809A (en) * 2003-10-15 2005-04-20 株式会社Ntt都科摩 Image signal processing method and apparatus and program
CN1799492A (en) * 2005-12-02 2006-07-12 清华大学 Quasi-lossless image compression and decompression method of wireless endoscope system
US20080152244A1 (en) * 2001-12-28 2008-06-26 Tooru Suino Image-processing apparatus, image-processing method, program and computer readable information recording medium
CN101668196A (en) * 2009-09-25 2010-03-10 西安电子科技大学 Low code rate image compression method based on down sampling and interpolation
CN104661023A (en) * 2015-02-04 2015-05-27 天津大学 Image or video coding method based on predistortion and training filter
JP2015226260A (en) * 2014-05-29 2015-12-14 パナソニックIpマネジメント株式会社 Image processor and image processing method
CN107592535A (en) * 2017-08-18 2018-01-16 西安邮电大学 H.265/HEVC image layer bit rate control method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06233266A (en) * 1993-02-02 1994-08-19 Matsushita Electric Ind Co Ltd Video signal encoder and video signal decoder
WO2000025312A1 (en) * 1998-10-27 2000-05-04 Hitachi Maxell, Ltd. Information recording method and system, image compression/decompression system, system control method, and monitoring system including part or all of them
US20080152244A1 (en) * 2001-12-28 2008-06-26 Tooru Suino Image-processing apparatus, image-processing method, program and computer readable information recording medium
CN1607809A (en) * 2003-10-15 2005-04-20 株式会社Ntt都科摩 Image signal processing method and apparatus and program
CN1799492A (en) * 2005-12-02 2006-07-12 清华大学 Quasi-lossless image compression and decompression method of wireless endoscope system
CN101668196A (en) * 2009-09-25 2010-03-10 西安电子科技大学 Low code rate image compression method based on down sampling and interpolation
JP2015226260A (en) * 2014-05-29 2015-12-14 パナソニックIpマネジメント株式会社 Image processor and image processing method
CN104661023A (en) * 2015-02-04 2015-05-27 天津大学 Image or video coding method based on predistortion and training filter
CN107592535A (en) * 2017-08-18 2018-01-16 西安邮电大学 H.265/HEVC image layer bit rate control method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李栋: "《基于拉普拉斯下采样和方向波插值的低码率图像压缩》", 《中国优秀硕士学位论文全文数据库》 *
谢松昭: "《基于全相位双正交变换和全相位内插的图像压缩算法研究》", 《中国优秀硕士学位论文全文数据库》 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110996131A (en) * 2020-03-02 2020-04-10 腾讯科技(深圳)有限公司 Video encoding method, video encoding device, computer equipment and storage medium
CN111402165A (en) * 2020-03-18 2020-07-10 展讯通信(上海)有限公司 Image processing method, device, equipment and storage medium
CN112087636A (en) * 2020-08-07 2020-12-15 北京博雅慧视智能技术研究院有限公司 Image coding processing method and device, storage medium and terminal
CN114363693A (en) * 2020-10-13 2022-04-15 华为技术有限公司 Image quality adjusting method and device
CN112565660A (en) * 2020-12-08 2021-03-26 维沃移动通信有限公司 Image processing method and device
CN112633198A (en) * 2020-12-28 2021-04-09 浙江大华技术股份有限公司 Picture processing method and device, storage medium and electronic device
CN112631524A (en) * 2020-12-29 2021-04-09 杭州海康汽车软件有限公司 Storage medium distribution method and device and electronic equipment

Also Published As

Publication number Publication date
CN110149554B (en) 2021-06-15

Similar Documents

Publication Publication Date Title
CN110149554A (en) Method, apparatus, electronic equipment and the storage medium of video image processing
US11006046B2 (en) Image processing method and mobile terminal
EP3171596B1 (en) Image compression with adaptive quantization of regions of interest (roi)
CN109729405B (en) Video processing method and device, electronic equipment and storage medium
CN105472205B (en) Real-time video noise reduction method and device in encoding process
US11490157B2 (en) Method for controlling video enhancement, device, electronic device and storage medium
JP7169449B2 (en) Video enhancement control method, device, electronic device and storage medium
CN109618228B (en) Video enhancement control method and device and electronic equipment
CN109168065B (en) Video enhancement method and device, electronic equipment and storage medium
WO2008075256A2 (en) Method and system for encoding an image signal, encoded image signal, method and system for decoding an image signal
CN110766637B (en) Video processing method, processing device, electronic equipment and storage medium
CN105898565A (en) Video processing method and device
CN110378860A (en) Method, apparatus, computer equipment and the storage medium of restored video
JP2007334457A (en) Image processor and image processing method
CN108307101B (en) Image processing method, electronic equipment and server
CN106921840B (en) Face beautifying method, device and system in instant video
CN117830077A (en) Image processing method and device and electronic equipment
CN116847087A (en) Video processing method and device, storage medium and electronic equipment
JP2020028111A (en) Image processing method, image processing apparatus, image processing system, and program
CN111382772B (en) Image processing method and device and terminal equipment
CN107547895B (en) Image processing method and device
CN103929654B (en) A kind of image processing method and device
CN117615146B (en) Video processing method and device, electronic equipment and computer readable storage medium
JP2015115901A (en) Encoding apparatus, encoding apparatus control method, and computer program
CN112422967B (en) Video encoding method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant