CN105430429B - A kind of optimization method and device of media data - Google Patents
A kind of optimization method and device of media data Download PDFInfo
- Publication number
- CN105430429B CN105430429B CN201410476696.5A CN201410476696A CN105430429B CN 105430429 B CN105430429 B CN 105430429B CN 201410476696 A CN201410476696 A CN 201410476696A CN 105430429 B CN105430429 B CN 105430429B
- Authority
- CN
- China
- Prior art keywords
- media stream
- scene
- template file
- mode
- optimization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A kind of optimization method of media data, comprising: identify current media stream data to determine the mode of current broadcasting pictures after the first Media Stream；The template file of the mode is corresponded to from network side or local acquisition for first Media Stream；According to the template file, processing is optimized to first Media Stream and obtains the second Media Stream；Wherein, the resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream.In addition, a kind of optimization device of media data is also provided herein.Using this programme, following effect can reach: solving the problems, such as that the screen of low resolution can not play the Media Stream for high-resolution screen；Processing according to the current display condition intelligent of the hobby or display screen of user can be optimized to video, promote user experience；In optimization process, the optimization processing for being suitble to the imaging results of the scene can be carried out to corresponding scene frame according to the type of scene in vision signal.
Description
Technical field
The invention belongs to multimedia technology field more particularly to the optimization methods and device of a kind of media data.
Background technique
Ultra high-definition (Ultra High-Definition) comes from International Telecommunication Union (International
Telecommunication U nion) formal name by " 4K resolution ratio (3840 × 2160 pixel) " of approval is set to
" ultra high-definition Ultra HD (Ultra High-Definition) ".Simultaneously this title be also applied for " 8K resolution ratio (7680 ×
4320 pixels) ".And currently on the market and the display screen (TV) of most user purchase is not support ultra high-definition video
, such as the physical resolution that full HD (FHD, Full High Definition) TV resolution is 1920 × 1080, FHD
TV does not support the audio/video media of broadcasting ultra high-definition, causes the screen of low resolution that can not play the matchmaker for high-resolution screen
Body stream；Although the method for scaling resolution ratio has been disclosed in the prior art, method in the prior art is in scaling video
Resolution ratio when, it is not smart enough using unified Optimizing Flow；Specifically, following two aspects are embodied in: firstly,
Can not according to the current display state of the hobby or display screen of user (such as user it is expected play the video when mode or
The current display pattern of display screen) corresponding optimization processing is carried out to video；Secondly, frequently including several scenes in video, no
Requirement of the same scene to imaging results is different, is optimized with unified method to different scenes, it may appear that after optimization
The bad problem of imaging results.
Summary of the invention
In view of this, when in order to solve that the resolution ratio of scaling video exists in the prior art, using unified optimization
Process, problem not smart enough, the purpose of the present invention is to propose to a kind of optimization methods of media data.For the implementation to disclosure
The some aspects of example have a basic understanding, and simple summary is shown below.The summarized section is not extensive overview, also not
It is key/critical component to be determined or the protection scope for describing these embodiments.Its sole purpose is with simple form
Some concepts are presented, in this, as the preamble of following detailed description.
In some alternative embodiments, the method, comprising:
Current media stream data is identified to determine the mode of current broadcasting pictures after the first Media Stream；
The template file of the mode is corresponded to from network side or local acquisition for first Media Stream；
According to the template file, processing is optimized to first Media Stream and obtains the second Media Stream；Wherein, described
The resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream.
Another object of the present invention is the optimization device for proposing a kind of media data.
In some alternative embodiments, described device, comprising:
Determination unit determines current broadcasting pictures after current media stream data is the first Media Stream for identification
Mode；
Acquiring unit, it is literary for the template for first Media Stream from network side or the corresponding mode of local acquisition
Part；
Optimize unit, for processing being optimized to first Media Stream and obtaining the second matchmaker according to the template file
Body stream；Wherein, the resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream.
Using above-described embodiment, following effect can reach:
Solve the problems, such as that the screen of low resolution can not play the Media Stream for high-resolution screen；
Processing can be optimized to video according to the hobby or display screen of user current display condition intelligent, mentioned
Rise user experience；
In optimization process, corresponding scene frame can be carried out being suitble to this according to the type of scene in vision signal
The optimization processing of the imaging results of scape；
Reduce because update causes a large amount of electronic waste pollution environment.
For the above and related purposes, one or more embodiments include being particularly described below and in claim
In the feature that particularly points out.Certain illustrative aspects are described in detail in the following description and the annexed drawings, and its instruction is only
Some modes in the utilizable various modes of the principle of each embodiment.Other benefits and novel features will be under
The detailed description in face is considered in conjunction with the accompanying and becomes obvious, the disclosed embodiments be all such aspects to be included and they
Be equal.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair
Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:
Fig. 1 shows a kind of flow diagram of the optimization method of media data of the embodiment of the present invention；
Fig. 2 shows a kind of structural schematic diagrams of the optimization device of media data of the embodiment of the present invention.
Specific embodiment
The following description and drawings fully show specific embodiments of the present invention, to enable those skilled in the art to
Practice them.Other embodiments may include structure, logic, it is electrical, process and other change.Embodiment
Only represent possible variation.Unless explicitly requested, otherwise individual components and functionality is optional, and the sequence operated can be with
Variation.The part of some embodiments and feature can be included in or replace part and the feature of other embodiments.This hair
The range of bright embodiment includes equivalent obtained by the entire scope of claims and all of claims
Object.Herein, these embodiments of the invention can individually or generally be indicated that this is only with term " invention "
For convenience, and if in fact disclosing the invention more than one, the range for being not meant to automatically limit the application is to appoint
What single invention or inventive concept.
Fig. 1 shows a kind of flow diagram of the optimization method of media data of the embodiment of the present invention；
As shown in Figure 1, in some illustrative embodiments, the method, including the following steps:
Step S101 identifies current media stream data to determine the mode of current broadcasting pictures after the first Media Stream；
Step S102 is the template file that first Media Stream corresponds to the mode from network side or local acquisition；
Step S103 optimizes processing to first Media Stream and obtains the second Media Stream according to the template file；
Wherein, the resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream；
In the above-described embodiments, first Media Stream can be vision signal or include vision signal and audio letter
Number video-audio signal；Since the resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream, it can be seen that
In the above process, by template file, the resolution ratio of first Media Stream can be reduced, obtain resolution ratio lesser second
Media Stream；In addition, before obtaining template file, it is thus necessary to determine that the mode of current broadcasting pictures, then according to the mode, from net
Network side (such as cloud platform, server etc.) locally obtains corresponding template file, wherein the mode of the broadcasting pictures
It can be the play mode that display device has currently been set, be also possible to setting or hobby according to user, that determines broadcasts
Mode needed for putting the first Media Stream；It, can be more intelligently current according to the hobby of user or display screen by this process
Display state selection accordingly be used for subsequent optimization processing template file, the user experience is improved；The present embodiment can answer
For the equipment with display device (such as display screen), such as smart television；Or it can be applied to that there is display dress with above-mentioned
Other devices that the equipment set is connected, such as set-top box；Or it can be applied to partial devices in above equipment, such as core
Piece etc., here without limiting；
In some illustrative embodiments, the resolution ratio of first Media Stream is not less than 3840 × 2160, at optimization
The resolution ratio of second Media Stream obtained after reason is 1920 × 1080；Both it is to be understood that when identifying current media
Flow data is acquisition template file corresponding with the mode of the media stream data is played after ultra high-definition vision signal, then root
According to the template file, processing is optimized to ultra high-definition vision signal, it is final to obtain the full HD video letter for meeting play mode
Number；
Firstly, above-described embodiment solves the problems, such as to lead to not broadcast since display device itself configures in the prior art
Amplify in the vision signal of its resolution ratio the problem of, such as FHD TV (resolution ratio is 1920 × 1080) can not play " 4K " view
Frequency signal (resolution ratio is 3840 × 2160)；Secondly, the above process is according to the mode of current broadcasting pictures, such as FHD electricity
It is set when depending on the mode of current broadcasting pictures or user using FHD screen viewing vision signal (such as film), meet user
The mode of the broadcasting pictures of hobby selects corresponding template file, so that can be intelligent in subsequent optimization process
" 4K " vision signal is optimized accordingly, effectively improve the experience of user；
The mode can be preset mode when dispatching from the factory in FHD TV, such as: mode standard, eyeshield mode, power saving mould
Formula, soft mode, high brightness mode, film mode etc.；Existed alternatively, the mode is also possible to user according to the hobby of oneself
Preset mode on FHD TV, such as user A have carried out screen display state on FHD TV customized, define several
That oneself likes watches the mode of TV, has corresponding display parameters (brightness, saturation degree, coloration and comparison in each mode
Degree)；Alternatively, the mode can be FHD TV according to the usage record of user, such as nearly 3 months usage records, from using
The user is analyzed in record plays the mode being inclined to use when vision signal；
In some illustrative embodiments, the process of the above-mentioned determination mode may include:
Using the present mode of display device as the mode；Or,
By the mark of user, the mode of user preset corresponding with the mark of the user is searched, and will be found
Mode as the mode；If not finding, according to the usage record of the user, what is analyzed meets the mould of user preferences
Formula, and using the mode as the mode；
In some illustrative embodiments, the process of the above-mentioned acquisition template file, specifically includes:
The mark of first Media Stream got according to the mode and by the process of the identification, inquiry are local
Whether the template file is stored with；
If so, executing the optimization processing according to the template file；If it is not, then:
The inquiry request for carrying the mark of the mode and first Media Stream is sent to network side；
Receive network side reply for mutually should inquiry request feedback message；
It, should from network side downloading if knowing that the network side has inquired the template file by the feedback message
Template file；Conversely, then using local preset standard form as the template file；
Optionally, if in above process after locally finding corresponding template file, further includes:
Send network side for the version number of the template file, request network side judge the template file version number whether
It is newest；If the version number of the template file be it is newest, carry out subsequent optimization processing using the template file；Conversely, then
Newest template file is downloaded to local from network side, then carries out subsequent optimization processing using the template file after downloading；
The mark of first Media Stream can be film name or film code, and above-mentioned standard form is local preparatory
Mark can be used when can not find corresponding template file in local or network side in the optimization template that one kind of storage is general
Quasi-mode plate optimizes the first Media Stream；In above process, if template text can only be found according to the mark of the first Media Stream
Part, but the template file cannot be corresponding with the model, then prompts to user, asks the user whether to select this template,
If user, which confirms, selects this template, subsequent optimization process flow is carried out according to the template file, conversely, then using master die
Plate carries out subsequent optimization process flow；
In some illustrative embodiments, first Media Stream is vision signal, and the template file includes at least
The optimisation strategy of one scene, the optimisation strategy include: the method for adjustment and brightness, saturation degree, coloration and comparison of resolution ratio
The parameter of degree；The process of the optimization processing, specifically includes:
The scene played in first Media Stream is identified, according to described in being recorded in the template file at least
The optimisation strategy of one scene optimizes scene frame corresponding in first Media Stream；If the scene identified is in institute
It states and does not find corresponding optimisation strategy in template file, then optimized according to local preset criteria optimization strategy；
In above process it is to be understood that having recorded the optimisation strategy of all or part of scene in template file；Example
Such as: for a film, it will include multiple scenes, it can be according to the playback progress of film, i.e. film according to template file
Time shaft, successively each scene frame in each scene is successively optimized, and optimize strategy according to scene not
It is same and different；Alternatively, template file only has recorded the optimisation strategy of branch scape in the middle part of the film, and such as: personage's scene, Larger Dynamic
Scene, indoor scene, outdoor scene, then when optimizing processing according to the template file, first in identification film currently
Whether scene is the scene for needing to optimize in template file, then (is divided according to the optimisation strategy in template file if necessary to optimization
The method of adjustment of resolution and brightness, saturation degree, the parameter of coloration and contrast) it is optimized for corresponding scene frame, if
Current scene (such as landscape scene) does not record corresponding optimisation strategy in template file, then can be according to local preset
Criteria optimization strategy (method of adjustment of the resolution ratio including preset standard and brightness, saturation degree, the ginseng of coloration and contrast
Number) processing is optimized to corresponding picture frame；It by the above process, can be according to the type of scene in vision signal, to phase
The scene frame answered carries out the optimization processing for being suitble to the imaging results of the scene；
The setting of certain above-mentioned scene can also be divided according to the motion state of scenery in picture, such as will movement
Relatively frequently the scene of more picture (i.e. sharp movement picture) composition is known as that sharp movement scene, will to move less picture (i.e. weak
Motion picture) composition scene be known as weak moving scene, tableaux be known as static scene etc.；For specifically setting for scene
It sets and classifies, here without limiting；
In some illustrative embodiments, the process of the optimization processing, further includes:
It is described optimized according to the template file before, first Media Stream is pre-processed, by described
One Media Stream is decoded and format is converted to YUV or rgb format；And/or
The frequency conversion of first Media Stream after optimizing according to the template file is at meeting display device
It is required that frequency；If such as the frequency of " 4K " vision signal received is 120HZ, and the video playing of current FHD TV
Frequency is up to 30HZ, then needs to convert the frequency of vision signal；
For FHD TV, when receiving media stream data, can identify first the data why signal, and know
Not Chu the Media Stream mark (film name or film code etc. are used to mark the mark of the Media Stream), if for the first Media Stream
For vision signal, then can be identified by the following method:
At least piece image is acquired from the first Media Stream；Such as according to fixed time interval, phase is extracted from film
The picture frame answered；
At least piece image that will be acquired in first Media Stream, in local or described network side (server or Yun Ping
Platform etc.) video information library in matched, obtain the mark of first Media Stream；Know for storing in the video information library
The information of other video；
Or,
If first Media Stream is video-audio signal, the above process may include:
The audio signal and/or vision signal in first Media Stream are extracted, according to the corresponding audio signal
At least piece image acquired in vocal print and/or the vision signal, in the audio and video information library of the local or described network side into
Row matching, obtains the mark of first Media Stream；The audio and video information library is used to store the letter of identification audio and/or video
Breath；
It in above process, further include audio signal generally in addition to vision signal for a film；Therefore it removes
Outside being identified to the image in vision signal, the vocal print in audio signal can also be identified, to know
The film name of the film；
In some illustrative embodiments, if the resolution ratio of first Media Stream is 3840 × 2160, optimization processing
The resolution ratio of second Media Stream obtained afterwards is 1920 × 1080；Assuming that the template file includes personage's scene and landscape
The optimisation strategy of scene；Landscape so in the entire picture of landscape scene is that the scene needs content outstanding, then phase
The emphasis point for the optimisation strategy answered is after reducing resolution ratio, and the display parameters of entire picture are adjusted；And for personage
For scene, the movement and behavior of the personage in picture is main object outstanding, therefore in addition to needing in optimization process
Outside the resolution ratio of the scene frame of personage's scene is reduced, it is also necessary in the imaging compensation of subsequent picture, emphatically to people
The display parameters of object, especially its facial characteristics are adjusted；
It illustrates below and the personage's scene and corresponding optimization method that identify in first Media Stream is illustrated:
Firstly, recognition of face is carried out to the scene in first Media Stream by edge detection and thresholding-techniques,
And confirm proprietary facial contour in scene；
Then, pixel shared by the proprietary facial contour identified is calculated, and is compared with preset value, if identification
Out at least one facial contour is greater than the preset value, then the scene is people's object field scape；For some Larger Dynamic scenes,
Such as war scene, it often will appear many people in picture, but outstanding in this scenario is not people in picture, but it is whole
The war scene of body, it is therefore desirable to recognized by the ratio for accounting for overall picture to facial contour, determine the scene whether be
Personage's scene；
After identifying the scene is people's object field scape, according to the template file, to the personage in first Media Stream
The process that the scene frame of scene optimizes may include:
Firstly, in order to ensure the brightness and contrast of face after pixel adjustment the preset value will be greater than in scene frame
Facial contour in the value of brightness of pixel improve 30%, the value of contrast improves 30%；
Secondly, carrying out interlacing to the scene frame of personage's scene takes out frame every column, the video that resolution ratio is 1920 × 1080 is formed
Signal；The process of frame is taken out in interlacing described here every column, it is possible to understand that extracts even number (or odd number) row and column in the scene
Pixel, the pixel of remaining odd number (or even number) row and column constitute the vision signal that resolution ratio is 1920 × 1080；Alternatively, can
To extract even number line and odd column, remaining pixel can also form 1920 × 1080 vision signal etc. and extract mode；
Finally, the value of the coloration of the pixel of even number line in vision signal is adjusted to the coloration of upper and lower two adjacent pixels
The value of the saturation degree of even column in vision signal is adjusted to the average value of the saturation degree of two adjacent pixels in left and right by average value；
Because during pixel reduces, image quality will receive influences, for example, coloration and saturation degree it is uneven, therefore after pixel diminution, and also
Need by vision signal coloration and saturation degree be adjusted correspondingly so that the imaging of picture is more uniform soft；
Certainly, above-mentioned optimization process is a kind of embodiment, is first to have adjusted in facial contour in the above process
The brightness and contrast of pixel, then pixel reduces again, finally adjusts the display parameters (coloration and full of the scene frame after reducing again
And degree)；
Optionally, pixel diminution can also be first carried out, then again for the back in facial contour and picture in addition to face
Scape carries out the adjustment of corresponding display parameters, to protrude imaging of the face in the scene frame；
It is to be carried out in such a way that column take out frame unified interlacing (such as unified extracting idol during pixel reduces
Number row and column), it can also carry out by another way, such as can carry out different pixels according to the difference of scene and reduce
Process falls even number line by extraction such as in personage's scene and odd column realizes the diminution of pixel, and in landscape scene, pass through
Extract the diminution that even number row and column realizes pixel；
In some illustrative embodiments, the process for obtaining template file is from local acquisition, further includes more new template
The process of file；Such as the template file in network side (server or cloud platform) can be examined in real time or periodically
It surveys, checks whether new template file, download corresponding template file from network side if having.
Fig. 2 shows a kind of structural schematic diagrams of the optimization device of media data of the embodiment of the present invention；
In some illustrative embodiments, described device 200, comprising:
Determination unit 201, unit 202 identifies current media stream data to determine after the first Media Stream for identification
The mode of current broadcasting pictures；
Acquiring unit 203, for corresponding to the template of the mode from network side or local acquisition for first Media Stream
File；
Optimize unit 204, for processing being optimized to first Media Stream and obtaining second according to the template file
Media Stream；Wherein, the resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream；
In some illustrative embodiments, the determination unit 201, comprising:
First determines subelement 2011, for using the present mode of display device as the mode；Or,
Second determines subelement 2012, for the mark by user, searches use corresponding with the mark of the user
The preset mode in family, and using the mode found as the mode；If not finding, according to the usage record of the user, divide
The mode for meeting user preferences being precipitated, and using the mode as the mode；
In some illustrative embodiments, the acquiring unit 203, comprising:
First obtains subelement 2031, described for getting according to the mode and by the process of the identification
The mark of one Media Stream, whether inquiry is local is stored with the template file；
If so, executing the optimization processing according to the template file；If it is not, then:
Second obtains subelement 2032, for sending the mark for carrying the mode and first Media Stream to network side
Inquiry request；
Third obtain subelement 2033, for receive network side reply for mutually should inquiry request feedback message；
It, should from network side downloading if knowing that the network side has inquired the template file by the feedback message
Template file；Conversely, then using local preset standard form as the template file；
In some illustrative embodiments, first Media Stream is vision signal, and the template file includes at least
The optimisation strategy of one scene, the optimisation strategy include: adjustment device and brightness, saturation degree, coloration and the comparison of resolution ratio
The parameter of degree；The optimization unit 204, specifically includes:
First optimization subelement 2041, for being identified to the scene played in first Media Stream, according to described
The optimisation strategy of at least one scene recorded in template file, to the scene of scene corresponding in first Media Stream
Frame optimizes；If the scene identified does not find corresponding optimisation strategy in the template file, according to local preset
Criteria optimization strategy optimize；
In some illustrative embodiments, the resolution ratio of first Media Stream is not less than 3840 × 2160, at optimization
The resolution ratio of second Media Stream obtained after reason is 1920 × 1080.
In some illustrative embodiments, the optimization unit 204, further includes:
Second optimization subelement 2042 is optimized for the first optimization subelement 2041 according to the template file
Before, first Media Stream is pre-processed, first Media Stream is decoded and format is converted into YUV or RGB
Format；And/or
Third optimizes subelement 2043, excellent for carrying out the first optimization subelement 2041 according to the template file
The frequency conversion of first Media Stream after change is at the frequency for meeting display device requirement；
In some illustrative embodiments, if first Media Stream is vision signal, the recognition unit 202,
Include:
First identification subelement 2021, at least piece image for will be acquired in first Media Stream, local or
It is matched in the video information library of the network side, obtains the mark of first Media Stream；
Or, if first Media Stream is video-audio signal, the recognition unit 202, comprising:
Second identification subelement 2022, for extracting audio signal and/or vision signal in first Media Stream, root
According at least piece image acquired in the vocal print of the corresponding audio signal and/or the vision signal, local or described
It is matched in the audio and video information library of network side, obtains the mark of first Media Stream.
In some illustrative embodiments, the resolution ratio of first Media Stream is 3840 × 2160, after optimization processing
The resolution ratio of obtained second Media Stream is 1920 × 1080；The template file includes the optimisation strategy of personage's scene；
The first optimization subelement 2041, comprising:
Scene Recognition unit 20411, for passing through edge detection and threshold process to the scene in first Media Stream
Recognition of face is carried out, and confirms proprietary facial contour in scene；
Computing unit 20412, for calculating pixel shared by the proprietary facial contour identified, and and preset value into
Row compares, if at least one identified facial contour is greater than the preset value, which is people's object field scape；
Face unit 20413, for the calculation unit identification go out current scene be people's object field scape after, will be in the scene frame
The facial contour greater than the preset value in the value of brightness of pixel improve 30%, the value of contrast improves 30%；
Resolution elements 20414 carry out interlacing for the scene frame to personage's scene and take out frame every column, and forming resolution ratio is
1920 × 1080 vision signal；
Compensating unit 20415, for the value of the coloration of the pixel of even number line in vision signal to be adjusted to two phases up and down
The value of the saturation degree of even column in vision signal is adjusted to the full of the adjacent pixel of left and right two by the average value of the coloration of adjacent pixel
With the average value of degree.
Using above-described embodiment, following effect can reach:
Solve the problems, such as that the screen of low resolution can not play the Media Stream for high-resolution screen；
Processing can be optimized to video according to the hobby or display screen of user current display condition intelligent, mentioned
Rise user experience；
In optimization process, corresponding scene frame can be carried out being suitble to this according to the type of scene in vision signal
The optimization processing of the imaging results of scape；
Reduce because update causes a large amount of electronic waste pollution environment.
It should also be appreciated by one skilled in the art that various illustrative logical boxs, mould in conjunction with the embodiments herein description
Electronic hardware, computer software or combinations thereof may be implemented into block, circuit and algorithm steps.In order to clearly demonstrate hardware and
Interchangeability between software surrounds its function to various illustrative components, frame, module, circuit and step above and carries out
It is generally described.Hardware is implemented as this function and is also implemented as software, depends on specific application and to entire
The design constraint that system is applied.Those skilled in the art can be directed to each specific application, be realized in a manner of flexible
Described function, still, this realization decision should not be construed as a departure from the scope of protection of this disclosure.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (16)
1. a kind of optimization method of media data characterized by comprising
Current media stream data is identified to determine the mode of current broadcasting pictures after the first Media Stream；
The template file of the mode is corresponded to from network side or local acquisition for first Media Stream；
According to the template file, processing is optimized to first Media Stream and obtains the second Media Stream；Wherein, described first
The resolution ratio of Media Stream is greater than the resolution ratio of second Media Stream；
The template file includes the optimisation strategy of personage's scene；
Identify the process of personage's scene in first Media Stream, comprising: by edge detection and threshold process to described
Scene in one Media Stream carries out recognition of face, and confirms proprietary facial contour in scene；Calculate the owner identified
Facial contour shared by pixel, and be compared with preset value, if at least one identified facial contour is greater than institute
Preset value is stated, then the scene is people's object field scape；
Wherein, according to the template file, the scene frame of personage's scene in first Media Stream is optimized, comprising:
The value of the brightness of pixel and contrast in the facial contour greater than the preset value in the scene frame is improved；
Interlacing is carried out to the scene frame of personage's scene and takes out frame every column, forms the vision signal with specified resolution；
The value of the coloration of the pixel of even number line in the vision signal is adjusted to being averaged for the coloration of upper and lower two adjacent pixels
The value of the saturation degree of even column in the vision signal is adjusted to the average value of the saturation degree of two adjacent pixels in left and right by value.
2. the method as described in claim 1, which is characterized in that determine the mode, comprising:
Using the present mode of display device as the mode；Or,
By the mark of user, the mode of user preset corresponding with the mark of the user, and the mould that will be found are searched
Formula is as the mode；If not finding, according to the usage record of the user, what is analyzed meets the mode of user preferences, and
Using the mode as the mode.
3. the method as described in claim 1, which is characterized in that obtain the template file, comprising:
The mark of first Media Stream got according to the mode and by the process of the identification, whether inquiry local
It is stored with the template file；
If so, executing the optimization processing according to the template file；If it is not, then:
The inquiry request for carrying the mark of the mode and first Media Stream is sent to network side；
Receive network side reply for mutually should inquiry request feedback message；
If knowing that the network side has inquired the template file by the feedback message, the template is downloaded from network side
File；Conversely, then using local preset standard form as the template file.
4. the method as described in claim 1, which is characterized in that first Media Stream is vision signal, the template file
Optimisation strategy including at least one scene, the optimisation strategy include: the method for adjustment and brightness, saturation degree, color of resolution ratio
The parameter of degree and contrast；The process of the optimization processing, specifically includes:
The scene played in first Media Stream is identified, according to described in being recorded in the template file at least one
The optimisation strategy of scene optimizes the scene frame of scene corresponding in first Media Stream；If the scene identified exists
Corresponding optimisation strategy is not found in the template file, then is optimized according to local preset criteria optimization strategy.
5. method as claimed in claim 4, which is characterized in that the resolution ratio of first Media Stream not less than 3840 ×
2160, the resolution ratio of second Media Stream obtained after optimization processing is 1920 × 1080.
6. method as claimed in claim 4, which is characterized in that the process of the optimization processing, further includes:
It is described optimized according to the template file before, first Media Stream is pre-processed, by first matchmaker
Body stream is decoded and format is converted to YUV or rgb format；And/or
The frequency conversion of first Media Stream after optimizing according to the template file is required at display device is met
Frequency.
7. method as claimed in claim 3, which is characterized in that if first Media Stream is vision signal, by described
Identification obtains the process of the mark of first Media Stream, comprising:
At least piece image that will be acquired in first Media Stream carries out in the video information library of the local or described network side
Matching obtains the mark of first Media Stream；
Or, obtaining the mistake of the mark of first Media Stream by the identification if first Media Stream is video-audio signal
Journey, comprising:
The audio signal and/or vision signal in first Media Stream are extracted, according to the vocal print of the corresponding audio signal
And/or at least piece image acquired in the vision signal, the progress in the audio and video information library of the local or described network side
Match, obtains the mark of first Media Stream.
8. method as claimed in claim 4, which is characterized in that the resolution ratio of first Media Stream is 3840 × 2160, excellent
The resolution ratio of second Media Stream obtained after change processing is 1920 × 1080；According to the template file, to described first
The scene frame of personage's scene in Media Stream optimizes, comprising:
The value of the brightness of pixel in the facial contour greater than the preset value in the scene frame is improved 30%, the value of contrast
Improve 30%；
Interlacing is carried out to the scene frame of personage's scene and takes out frame every column, forms the vision signal that resolution ratio is 1920 × 1080.
9. a kind of optimization device of media data characterized by comprising
Determination unit, unit identifies current media stream data to determine current broadcasting after the first Media Stream for identification
The mode of picture；
Acquiring unit, for corresponding to the template file of the mode from network side or local acquisition for first Media Stream；
Optimize unit, for processing being optimized to first Media Stream and obtaining the second Media Stream according to the template file；
Wherein, the resolution ratio of first Media Stream is greater than the resolution ratio of second Media Stream；
The template file includes the optimisation strategy of personage's scene；
The optimization unit, comprising: scene Recognition unit, for passing through edge detection and threshold process to first Media Stream
In scene carry out recognition of face, and confirm proprietary facial contour in scene；Computing unit, for calculating the institute identified
Pixel shared by the facial contour of someone, and be compared with preset value, if at least one identified facial contour is big
In the preset value, then the scene is people's object field scape；
The optimization unit includes the first optimization subelement, and the first optimization subelement includes:
Face unit goes out current scene for the calculation unit identification for that will be greater than institute in the scene frame after people's object field scape
The value of the brightness of pixel and contrast in the facial contour of preset value is stated to improve；
Resolution elements carry out interlacing for the scene frame to personage's scene and take out frame every column, form the video letter of specified resolution
Number；
Compensating unit, for the value of the coloration of the pixel of even number line in the vision signal to be adjusted to two adjacent pixels up and down
Coloration average value, by the value of the saturation degree of even column in the vision signal be adjusted to left and right two adjacent pixels saturation
The average value of degree.
10. device as claimed in claim 9, which is characterized in that the determination unit, comprising:
First determines subelement, for using the present mode of display device as the mode；Or,
Second determines subelement, for the mark by user, searches user preset corresponding with the mark of the user
Mode, and using the mode found as the mode；If not finding, according to the usage record of the user, the symbol that analyzes
The mode of user preferences is closed, and using the mode as the mode.
11. device as claimed in claim 9, which is characterized in that the acquiring unit, comprising:
First obtains subelement, first Media Stream for getting according to the mode and by the process of the identification
Mark, whether inquiry is local is stored with the template file；
If so, executing the optimization processing according to the template file；If it is not, then:
Second obtains subelement, and the inquiry for sending the mark for carrying the mode and first Media Stream to network side is asked
It asks；
Third obtain subelement, for receive network side reply for mutually should inquiry request feedback message；
If knowing that the network side has inquired the template file by the feedback message, the template is downloaded from network side
File；Conversely, then using local preset standard form as the template file.
12. device as claimed in claim 9, which is characterized in that first Media Stream is vision signal, the template file
Optimisation strategy including at least one scene, the optimisation strategy include: the adjustment device and brightness, saturation degree, color of resolution ratio
The parameter of degree and contrast；The first optimization subelement, for being identified to the scene played in first Media Stream,
According to the optimisation strategy of at least one scene described in being recorded in the template file, to corresponding field in first Media Stream
The scene frame of scape optimizes；If the scene identified does not find corresponding optimisation strategy in the template file, according to
Local preset criteria optimization strategy optimizes.
13. device as claimed in claim 12, which is characterized in that the resolution ratio of first Media Stream not less than 3840 ×
2160, the resolution ratio of second Media Stream obtained after optimization processing is 1920 × 1080.
14. device as claimed in claim 12, which is characterized in that the optimization unit, further includes:
Second optimization subelement, before being optimized for the first optimization subelement according to the template file, to described the
One Media Stream is pre-processed, and first Media Stream is decoded and format is converted to YUV or rgb format；And/or
Second optimization subelement, for described the after optimizing the first optimization subelement according to the template file
The frequency conversion of one Media Stream is at the frequency for meeting display device requirement.
15. device as claimed in claim 11, which is characterized in that if first Media Stream is vision signal, the knowledge
Other unit, comprising:
First identification subelement, at least piece image for will be acquired in first Media Stream, in the local or described network
It is matched in the video information library of side, obtains the mark of first Media Stream；
Or, if first Media Stream is video-audio signal, the recognition unit, comprising:
Second identification subelement, for extracting audio signal and/or vision signal in first Media Stream, according to corresponding
At least piece image acquired in the vocal print of the audio signal and/or the vision signal, in the local or described network side
Audio and video information is matched in library, obtains the mark of first Media Stream.
16. device as claimed in claim 12, which is characterized in that the resolution ratio of first Media Stream is 3840 × 2160,
The resolution ratio of second Media Stream obtained after optimization processing is 1920 × 1080；The face unit is used for the calculating
Unit identify current scene be people's object field scape after, by pixel in the facial contour greater than the preset value in the scene frame
The value of brightness improves 30%, and the value of contrast improves 30%；
The resolution elements carry out interlacing for the scene frame to personage's scene and take out frame every column, is formed resolution ratio for 1920 ×
1080 vision signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410476696.5A CN105430429B (en) | 2014-09-18 | 2014-09-18 | A kind of optimization method and device of media data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410476696.5A CN105430429B (en) | 2014-09-18 | 2014-09-18 | A kind of optimization method and device of media data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105430429A CN105430429A (en) | 2016-03-23 |
| CN105430429B true CN105430429B (en) | 2019-09-13 |
Family
ID=55508313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410476696.5A Active CN105430429B (en) | 2014-09-18 | 2014-09-18 | A kind of optimization method and device of media data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430429B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11778167B1 (en) | 2022-07-26 | 2023-10-03 | Insight Direct Usa, Inc. | Method and system for preprocessing optimization of streaming video data |
| US11849241B2 (en) | 2021-12-29 | 2023-12-19 | Insight Direct Usa, Inc. | Dynamically configured processing of a region of interest dependent upon published video data selected by a runtime configuration file |
| US12148192B2 (en) | 2023-07-17 | 2024-11-19 | Insight Direct Usa, Inc. | Dynamically configured extraction, preprocessing, and publishing of a region of interest that is a subset of streaming video data |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105828149A (en) * | 2016-04-28 | 2016-08-03 | 合智能科技（深圳）有限公司 | Method and apparatus for optimizing playing |
| CN105898364A (en) * | 2016-05-26 | 2016-08-24 | 北京小米移动软件有限公司 | Video playing processing method, device, terminal and system |
| CN108366284A (en) * | 2017-01-25 | 2018-08-03 | 晨星半导体股份有限公司 | Image processor and image treatment method |
| CN108470362A (en) * | 2018-01-29 | 2018-08-31 | 北京奇虎科技有限公司 | A kind of method and apparatus for realizing video toning |
| CN112286479A (en) * | 2019-07-25 | 2021-01-29 | 陕西坤同半导体科技有限公司 | Video reproduction method with lower resolution than supported by display |
| CN110933489B (en) * | 2019-11-01 | 2024-04-02 | 青岛海尔多媒体有限公司 | Video playing control method and device and video playing equipment |
| CN111415614B (en) * | 2020-03-20 | 2021-08-24 | 杭州德亚照明工程有限公司 | Display screen debugging processing method and device |
| CN112015950A (en) * | 2020-10-27 | 2020-12-01 | 成都极米科技股份有限公司 | Movie and television image quality adjusting method and device, terminal equipment, server and storage medium |
| US11704891B1 (en) | 2021-12-29 | 2023-07-18 | Insight Direct Usa, Inc. | Dynamically configured extraction, preprocessing, and publishing of a region of interest that is a subset of streaming video data |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101325054A (en) * | 2007-06-13 | 2008-12-17 | 三星电子株式会社 | Display system and method for displaying video signals |
| CN101998048A (en) * | 2009-08-05 | 2011-03-30 | 三星电子株式会社 | Digital image signal processing method, medium for recording the method, digital image signal pocessing apparatus |
| US7990404B2 (en) * | 2008-03-07 | 2011-08-02 | Hannspree, Inc. | Method for automatically detecting and switching video signals on a monitor |
| CN102547301A (en) * | 2010-09-30 | 2012-07-04 | 苹果公司 | System and method for processing image data using an image signal processor |
| CN102984588A (en) * | 2011-09-02 | 2013-03-20 | 索尼公司 | Personalized television viewing mode adjustments responsive to facial recognition |
| CN103067661A (en) * | 2013-01-07 | 2013-04-24 | 华为终端有限公司 | Image processing method, image processing device and shooting terminal |
| CN103220577A (en) * | 2012-01-18 | 2013-07-24 | 腾讯科技（深圳）有限公司 | Method, device and system for video displaying |
| CN103838578A (en) * | 2014-03-10 | 2014-06-04 | 联想(北京)有限公司 | Data processing method, data processing device and electronic equipment |
-
2014
- 2014-09-18 CN CN201410476696.5A patent/CN105430429B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101325054A (en) * | 2007-06-13 | 2008-12-17 | 三星电子株式会社 | Display system and method for displaying video signals |
| US7990404B2 (en) * | 2008-03-07 | 2011-08-02 | Hannspree, Inc. | Method for automatically detecting and switching video signals on a monitor |
| CN101998048A (en) * | 2009-08-05 | 2011-03-30 | 三星电子株式会社 | Digital image signal processing method, medium for recording the method, digital image signal pocessing apparatus |
| CN102547301A (en) * | 2010-09-30 | 2012-07-04 | 苹果公司 | System and method for processing image data using an image signal processor |
| CN102984588A (en) * | 2011-09-02 | 2013-03-20 | 索尼公司 | Personalized television viewing mode adjustments responsive to facial recognition |
| CN103220577A (en) * | 2012-01-18 | 2013-07-24 | 腾讯科技（深圳）有限公司 | Method, device and system for video displaying |
| CN103067661A (en) * | 2013-01-07 | 2013-04-24 | 华为终端有限公司 | Image processing method, image processing device and shooting terminal |
| CN103838578A (en) * | 2014-03-10 | 2014-06-04 | 联想(北京)有限公司 | Data processing method, data processing device and electronic equipment |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11849241B2 (en) | 2021-12-29 | 2023-12-19 | Insight Direct Usa, Inc. | Dynamically configured processing of a region of interest dependent upon published video data selected by a runtime configuration file |
| US11849242B2 (en) | 2021-12-29 | 2023-12-19 | Insight Direct Usa, Inc. | Dynamically configured processing of a region of interest dependent upon published video data selected by a runtime configuration file |
| US11849240B2 (en) | 2021-12-29 | 2023-12-19 | Insight Direct Usa, Inc. | Dynamically configured processing of a region of interest dependent upon published video data selected by a runtime configuration file |
| US11778167B1 (en) | 2022-07-26 | 2023-10-03 | Insight Direct Usa, Inc. | Method and system for preprocessing optimization of streaming video data |
| US12148192B2 (en) | 2023-07-17 | 2024-11-19 | Insight Direct Usa, Inc. | Dynamically configured extraction, preprocessing, and publishing of a region of interest that is a subset of streaming video data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105430429A (en) | 2016-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430429B (en) | A kind of optimization method and device of media data | |
| US20240314389A1 (en) | Dynamic content serving using automated content recognition (acr) and digital media watermarks | |
| CN101809590B (en) | Content based adjustment of an image | |
| EP2876891B1 (en) | Method and apparatus for matching of corresponding frames in multimedia streams | |
| JP5466125B2 (en) | System and method for enriching media content | |
| CN110300316B (en) | Method and device for implanting push information into video, electronic equipment and storage medium | |
| US9621844B1 (en) | Systems and methods for identifying a video aspect-ratio frame attribute | |
| CN108810649A (en) | Picture quality regulation method, intelligent TV set and storage medium | |
| CN105592322B (en) | A kind of optimization method and device of media data | |
| US20150007218A1 (en) | Method and apparatus for frame accurate advertisement insertion | |
| CN108985229A (en) | A kind of intelligent advertisement replacement method and system based on deep neural network | |
| AU2016293601B2 (en) | Detection of common media segments | |
| CN108712674A (en) | Video playing control method, playback equipment and storage medium | |
| CN106028078A (en) | Personalized content creating method, personalized content creating device, personalized content play method and personalized content play device | |
| CN104717525A (en) | Intelligent television operation method based on camera | |
| JP2013535889A (en) | Method and apparatus for providing auxiliary content in a three-dimensional communication system | |
| EP3361745A1 (en) | Display apparatus for playing substitutional advertisement and control method thereof | |
| CN106686405B (en) | Video rebroadcasting method and system | |
| KR102295776B1 (en) | Apparatus for Providing Advertisement Service and Driving Method Thereof | |
| CN101385027A (en) | Metadata generating method and device | |
| JP2000023062A (en) | Digest production system | |
| CN104735520A (en) | Television program play control method and device and television set | |
| KR100768074B1 (en) | System for offering advertisement moving picture and service method thereof | |
| CN106804008A (en) | A kind of information displaying method and device | |
| CN105898175A (en) | Preparing method and device of template file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160715 Address after: 266101 Haier Industrial Park, Haier Road, Laoshan District, Shandong, Qingdao, China Applicant after: Qingdao Haier Electric Appliance Co., Ltd. Applicant after: QINGDAO HAIER MULTI-MEDIA CO., LTD. Address before: 266101 Haier Industrial Park, Haier Road, Laoshan District, Shandong, Qingdao, China Applicant before: Qingdao Haier Electric Appliance Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |