Summary of the invention
The application is to overcome above-mentioned technical problem or at least be partially solved above-mentioned technical problem, and spy proposes following technology
Scheme:
In a first aspect, this application provides a kind of image presentation methods, this method comprises:
Obtain sub-video code stream and the corresponding target object detection block information of main video code flow;
The predetermined image frame of the main video code flow is obtained, and determines the corresponding first time stamp of the predetermined image frame;
Determine the picture frame of the sub-video code stream and the diversity factor of the predetermined image frame, and the determining and predetermined figure
As frame diversity factor be less than preset threshold picture frame, obtain corresponding second timestamp;
It is according to the time difference of second timestamp and first time stamp, the target object detection block information is corresponding
Image displaying is carried out in the sub-video code stream.
In an optional implementation manner, the picture frame of the determination sub-video code stream and the predetermined image frame
Diversity factor, comprising:
The picture frame of the sub-video code stream and the predetermined image frame are zoomed into same resolution ratio;
Determine the sum of two picture frames of same resolution ratio difference of two squares of each pixel accordingly;
The sum of the difference of two squares is determined as to the picture frame of the sub-video code stream and the diversity factor of the predetermined image frame.
In an optional implementation manner, the picture frame of the determination sub-video code stream and the predetermined image frame
Diversity factor before, further includes:
The sub-video code stream of acquisition is decoded, the picture frame of the sub-video code stream is obtained.
In an optional implementation manner, the predetermined image frame for obtaining the main video code flow, and described in determination
The corresponding first time stamp of predetermined image frame, comprising:
According to the scheduled time cycle, the predetermined image frame of the main video code flow is obtained, and determines the predetermined image
The corresponding first time stamp of frame.
In an optional implementation manner, the predetermined image frame of the main video code flow is obtained, comprising:
Obtain the decoded predetermined image frame of the main video code flow.
In an optional implementation manner, the time difference according to second timestamp and first time stamp,
The target object detection block information is corresponded into the sub-video code stream and carries out image displaying, comprising:
For the target object detection block information of any time stamp, stabbed according to second timestamp and the first time
The time difference, extract the picture frame of the sub-video code stream of corresponding timestamp;
The picture frame of the sub-video code stream of target object detection block information and corresponding timestamp that any time is stabbed
It is merged, and fusion results is subjected to image displaying.
Second aspect, this application provides a kind of image demonstration apparatus, which includes:
First obtains module, for obtaining sub-video code stream and the corresponding target object detection block letter of main video code flow
Breath;
Second acquisition and determining module for obtaining the predetermined image frame of the main video code flow, and determine described predetermined
The corresponding first time stamp of picture frame;
Third determining module, for determining the picture frame of the sub-video code stream and the diversity factor of the predetermined image frame,
And the determining picture frame for being less than preset threshold with the diversity factor of the predetermined image frame, obtain corresponding second timestamp;
Image display module, for the time difference according to second timestamp and first time stamp, by the target
Object detection frame information corresponds to the sub-video code stream and carries out image displaying.
In an optional implementation manner, the third determining module is specifically used for the image of the sub-video code stream
Frame and the predetermined image frame zoom to same resolution ratio;Determine two picture frames of same resolution ratio each pixel accordingly
The sum of the difference of two squares;The sum of the difference of two squares is determined as to the picture frame of the sub-video code stream and the difference of the predetermined image frame
Degree.
In an optional implementation manner, the third determining module is also used to solve the sub-video code stream of acquisition
Code, obtains the picture frame of the sub-video code stream.
In an optional implementation manner, the acquisition of winning the second place is specifically used for determining module according to the scheduled time
Period obtains the predetermined image frame of the main video code flow, and determines the corresponding first time stamp of the predetermined image frame.
In an optional implementation manner, the acquisition of winning the second place is specifically used for obtaining the main view frequency with determining module
Predetermined image frame after code stream decoding.
In an optional implementation manner, described image display module is specifically used for the target pair for any time stamp
As detection block information extracts the sub-video of corresponding timestamp according to the time difference of second timestamp and first time stamp
The picture frame of code stream;The figure of the sub-video code stream of target object detection block information and corresponding timestamp that any time is stabbed
Image displaying is carried out as frame is merged, and by fusion results.
The third aspect, this application provides a kind of electronic equipment, which includes:
Processor and memory, memory are stored at least one instruction, at least a Duan Chengxu, code set or instruction set,
At least one instruction, an at least Duan Chengxu, code set or instruction set loads by processor and are executed the to realize such as the application
Method shown in one side.
Fourth aspect, this application provides a kind of computer readable storage mediums, and computer storage medium is based on storing
The instruction of calculation machine, program, code set or instruction set, when run on a computer, so that computer executes the such as the application
Method shown in one side.
Image presentation method, device, electronic equipment and computer readable storage medium provided by the present application obtain sub-video
Code stream and the corresponding target object detection block information of main video code flow;The predetermined image frame of main video code flow is obtained, and is determined
The corresponding first time stamp of predetermined image frame;It determines the picture frame of sub-video code stream and the diversity factor of predetermined image frame, and determines
It is less than the picture frame of preset threshold with the diversity factor of predetermined image frame, obtains corresponding second timestamp;According to the second timestamp
With the time difference of first time stamp, target object detection block information is corresponded into sub-video code stream and carries out image displaying.The application is logical
The timestamp of similar picture frame between main video code flow and sub-video code stream is crossed to determine main video code flow and sub-video code stream
Sub-video code stream and the corresponding target object detection block information of main video code flow are rendered displaying together, it is same to obtain the time by the time difference
The bandwagon effect of step effectively improves the accuracy of video flow processing.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, and is only used for explaining the application, and cannot be construed to the limitation to the application.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in the description of the present application
Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition
Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member
Part is " connected " or when " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be
Intermediary element.In addition, " connection " used herein or " coupling " may include being wirelessly connected or wirelessly coupling.It is used herein to arrange
Diction "and/or" includes one or more associated wholes for listing item or any cell and all combinations.
To keep the purposes, technical schemes and advantages of the application clearer, the application embodiment will be made into one below
Step ground detailed description.
Be firstly the need of explanation, the invention relates to video code flow (Data Rate), refer to video file in list
The data traffic used in the time of position, also referred to as code rate.Under normal conditions, image capture device (such as camera, nobody
Machine etc.) it can produce the different multiple video code flows of resolution ratio, each video code flow carries the information such as timestamp.In view of existing
In technology, the problems such as included timestamp of video code flow is mismatched there are timestamp, frame per second, the time between video code flow will cause
Error, the embodiment of the present application provide a kind of information synchronization method of more video code flows, can be realized between accurate video code flow
Time synchronization.
It asks with reference to the accompanying drawing how the technical solution of the technical solution of the application and the application solves above-mentioned technology
Topic is described in detail.
The embodiment of the present application provides a kind of information synchronization method of more video code flows, as shown in Figure 1, this method comprises:
Step S101: the video code flow Dr1 of pending synchronizing information is obtained to video code flow DrN, N >=2;
Step S102: corresponding 1st timestamp of the predetermined image frame of video code flow Dr1 is determined;
Step S103: each picture frame of video code flow Dr2 to video code flow DrN and the difference of predetermined image frame are determined
Degree, and determine the 2nd time corresponding less than the picture frame of preset threshold with the diversity factor of predetermined image frame in video code flow Dr2
Stamp, until N timestamp corresponding less than the picture frame of preset threshold with the diversity factor of predetermined image frame in video code flow DrN;
Step S104: according to the 2nd timestamp to N timestamp time difference with the 1st timestamp respectively, by video code flow Dr2
Video code flow Dr1 is compareed respectively to video code flow DrN carries out synchronizing information processing.
For the embodiment of the present application, the executing subject of this method can be smart machine, wherein smart machine may include
Information exchange module can also include processing module and/or display module.The general workflow of the smart machine is to pass through
Information exchange module acquires equipment or network insertion video code flow from multiple images, then, by processing module to video code flow
It performs corresponding processing, and/or is shown every frame image of video code flow by display module.In the embodiment of the present application,
It, can be in processing module to view for the multiple video code flows accessed by information exchange module from any one image capture device
Before or after frequency code stream performs corresponding processing, and/or in display module every frame image of video code flow is shown it
Before, it is handled using above-mentioned steps S101~step S104.
That is, the video code flow Dr1 to video code flow DrN of pending synchronizing information is needle in the embodiment of the present application
To the multiple video code flows for the different coding format that same video content generates.Those skilled in the art will be understood that video codes
Flowing Dr1 is to distinguish to different video code flows, rather than be defined to the sequence of video code flow to video code flow DrN.
As illustratively, as N=2, video code flow Dr1 to video code flow DrN can be main video code flow all the way and right
The sub-video code stream all the way answered;As N > 2, video code flow Dr1 to video code flow DrN can be main video code flow all the way and right
The multichannel sub-video code stream answered;Or, or the case where other more video code flows, the embodiment of the present application does not limit herein
It is fixed.
In practical application, the video code flow Dr1 to video code flow DrN of pending synchronizing information is got in step s101
Afterwards, first video code flow Dr1 to video code flow DrN is decoded respectively, then to decoded video code flow Dr1 to video codes
It flows DrN and executes step S102~step S104.
Specifically, in step S102, it is thus necessary to determine that corresponding 1st timestamp of the predetermined image frame of video code flow Dr1.Its
In, the control video code flow that video code flow Dr1 is handled as synchronizing information can be from image capture device or network insertion
Any video code flow in multi-channel video code stream.In practical application, particular video frequency code stream can be set as video code flow Dr1, such as
Main video code flow;A video code flow can also be selected as video code flow from multi-channel video code stream according to preset algorithm
Dr1, also can be randomly selected in multi-channel video code stream that a video code flow is as video code flow Dr1, and the embodiment of the present application is herein
Without limitation.
In step S102, the predetermined image frame of video code flow Dr1 is any one image intercepted from video code flow Dr1
Frame.In practical application, particular image frame can be set as the predetermined image frame of video code flow Dr1, such as first frame;It can also be with
Machine selects a picture frame as predetermined image frame from video code flow Dr1;It can also be regular from video codes according to preset interception
One picture frame of selection in all images frame of Dr1 is flowed to be intercepted.For example, before step S102, according to the scheduled time
Period determines the predetermined image frame of video code flow Dr1.
In the program, step successively just can be executed for truncated picture frame in video code flow Dr1 at regular intervals
S102~step S104, to realize the multiple synchronizing information to more video code flows.This is because can also between multiple video code flows
There are code rate, frame per second not parity problems, so that the generation time error again of the video code flow after synchronizing.And pass through the scheduled time
Period carries out multiple time synchronization, and reliable synchronizing information between video code flow may be implemented, further increase video flow processing
Accuracy.
In practical application, those skilled in the art can be according to the actual situation configured the length of time cycle, this
Apply for embodiment it is not limited here.
Further, the timestamp that the embodiment of the present application uses the video code flow accessed from image capture device included,
After the predetermined image frame for determining video code flow Dr1, the predetermined image frame pair of video code flow Dr1 can be determined in step s 102
The timestamp answered, for hereinafter convenient for description, hereon referred to as the 1st timestamp.
It is appreciated that since video code flow Dr1 to video code flow DrN is the different coding generated for same video content
The video code flow of format, then any image frame in any video code flow can be found accordingly in other video code flows
Picture frame, only these corresponding picture frames have many characteristics, such as different resolution ratio.Based on this, in the embodiment of the present application, giving
It after the 1st timestamp for determining predetermined image frame, needs to find the corresponding timestamp of respective image frame in other video code flows, uses
Video code flow Dr1 is compareed respectively in other video code flows to synchronize.
Specifically, in step s 103, determining each picture frame of video code flow Dr2 to video code flow DrN and making a reservation for
The diversity factor of picture frame, and determine the picture frame pair for being less than preset threshold in video code flow Dr2 with the diversity factor of predetermined image frame
The 2nd timestamp answered, until corresponding less than the picture frame of preset threshold with the diversity factor of predetermined image frame in video code flow DrN
N timestamp.
That is, each picture frame in the video code flow Dr2 decoded, requires predetermined with video code flow Dr1
Picture frame is compared, when sufficiently small with the diversity factor of predetermined image frame, it is believed that is figure corresponding with predetermined image frame
As frame.Those skilled in the art can according to the actual situation be configured the preset threshold of diversity factor, so as in video code flow
A certain number of picture frames are determined in Dr2, such as by appropriate threshold, determine the smallest picture frame of difference angle value,
In another example several lesser picture frames of difference angle value are determined, then screened by certain algorithm by appropriate threshold,
Determine the highest picture frame of possibility.Similarly, the time included using the video code flow of image capture device access
Stamp, can be obtained the corresponding timestamp of the picture frame determined in video code flow Dr2, for hereinafter convenient for description, hereon referred to as
2nd timestamp.And video code flow Dr3 to video code flow DrN can refer to video code flow Dr2 and be handled, it is no longer superfluous herein
It states.
In the embodiment of the present application, the 1st timestamp to the N timestamp time that only indicator determines different video code stream
Stamp makes differentiation, and cannot understand the restriction to the value of timestamp, and in practical application, the value of the 1st timestamp to N timestamp can
It can also be different with identical, it is not limited here.
Further, the calculating of diversity factor of the embodiment of the present application between two picture frames provides a kind of possible reality
Existing mode, that is, determine the mode of any image frame of any video code flow and the diversity factor of predetermined image frame, comprising: by any figure
As frame and predetermined image frame zoom to same resolution ratio;Determine the flat of two picture frames of same resolution ratio each pixel accordingly
The sum of variance;The sum of the difference of two squares is determined as to the diversity factor of any image frame Yu predetermined image frame, in this way, diversity factor is smaller, then
Indicate that two picture frames are more close.
Alternatively, in step s 103, can determine each picture frame of video code flow Dr2 to video code flow DrN with
The similarity of predetermined image frame, and determine the image for being greater than preset threshold in video code flow Dr2 with the similarity of predetermined image frame
Corresponding 2nd timestamp of frame, until being greater than the picture frame pair of preset threshold in video code flow DrN with the similarity of predetermined image frame
The N timestamp answered, concrete implementation mode can be found in the process above handled by diversity factor, no longer superfluous herein
It states.
In the embodiment of the present application, by the way that corresponding picture frame in step S102 and step S103, can be obtained in video codes
Dr1 corresponding timestamp into video code flow DrN is flowed, and then step S104 can be executed.
Specifically, it in step S104, according to the 2nd timestamp to N timestamp time difference with the 1st timestamp respectively, will regard
Frequency code stream Dr2 to video code flow DrN compares video code flow Dr1 respectively and carries out synchronizing information processing.Wherein, the 2nd timestamp and the 1st
The difference of the time difference of timestamp, the i.e. value of the value and the 1st timestamp of the 2nd timestamp can determine that video codes according to the difference
Flow the time error of Dr1 and video code flow Dr2, it is subsequent can be according to the time error by video code flow Dr1 and video code flow Dr2
Carry out synchronizing information processing.And video code flow Dr3 to video code flow DrN can refer to video code flow Dr2 and be handled,
This is repeated no more.
The information synchronization method of more video code flows provided by the embodiments of the present application passes through image between determining different video code stream
The diversity factor or similarity of frame, to search the different similar image frame of different video code stream intermediate-resolution, so as to according to these phases
As the timestamp of picture frame determine the time difference between video code flow, and then realize the synchronizing information between multiple video code flows, have
Effect improves the accuracy of video flow processing.
In the embodiment of the present application, a kind of video access the answering in artificial intelligence scene of multi-channel video code stream is provided
With.Specifically, in the case where the video data volume is excessively huge, pressure is calculated in order to mitigate server or terminal device, is existed
A kind of intelligence computation unit can carry out real time parsing to the video data that image capture device accesses, such as operation face is known
Other algorithm, vehicle monitoring algorithm etc., to simplify the data volume for being transferred to server or terminal device.
By taking face recognition algorithms as an example, intelligence computation unit accesses the main video code flow of multichannel IPC, obtains by algorithm process
To face frame.Server or terminal device are (hereinafter for ease of description, unified such as by browser, Administrator Client etc.
It is introduced with browser) interface is rendered into after obtaining main video code flow and face frame using network access intelligence computation unit
On.It, may be since (resolution ratio, coding mode, code rate etc. are all for decoding capability deficiency after browser gets the main video code flow of multichannel
Will affect decoding capability), cause rendering to fail.If what browser obtained is sub-video code stream and face frame, although decoding energy
Power is enough, but because of main video code flow existing in the prior art and the nonsynchronous problem of sub-video code stream, may result in people
Face frame and displaying image mismatch, and bandwagon effect is bad.
Based on this, in order to obtain the bandwagon effect of time synchronization, the embodiment of the present application provides a kind of image presentation method,
As shown in Fig. 2, this method comprises:
Step S201: sub-video code stream and the corresponding target object detection block information of main video code flow are obtained;
Step S202: the picture frame of sub-video code stream and the diversity factor of predetermined image frame, and determining and predetermined image are determined
The diversity factor of frame is less than the picture frame of preset threshold, obtains corresponding second timestamp;
Step S203: the picture frame of sub-video code stream and the diversity factor of predetermined image frame, and determining and predetermined image are determined
The diversity factor of frame is less than the picture frame of preset threshold, obtains corresponding second timestamp;
Step S204: according to the time difference of the second timestamp and first time stamp, target object detection block information is corresponded to
Sub-video code stream carries out image displaying.
For the embodiment of the present application, the executing subject of this method can be server or terminal device, wherein server or
Terminal device may include information exchange module and display module.Video is accessed from intelligence computation unit by information exchange module
Code stream and target object detection block information are then shown by display module.
In practical application, for the different usage scenarios of intelligence computation unit, target object can be face, vehicle, people
As etc., i.e., target object detection block information can be face frame information etc., and the embodiment of the present application is not construed as limiting this.
In the embodiment of the present application, main video code flow is decoded by intelligence computation unit, and generate the corresponding mesh of main video code flow
Mark object detection frame information.That is, in step s 201, server or terminal device are adopted from intelligence computation unit or image
Collect equipment and access sub-video code stream, obtains the corresponding target object detection block information of main video code flow from intelligence computation unit.?
In step S202, server or terminal device obtain the decoded predetermined image frame of main video code flow from intelligence computation unit and carry out
The target object detection block information of main video code flow and the synchronizing information of sub-video code stream subtract while promoting bandwagon effect
The small requirement to server or terminal device decoding capability.So, before step S203, it is also necessary to the sub-video code of acquisition
Stream is decoded, and obtains the picture frame of sub-video code stream.
In the step S202 of the embodiment of the present application, it is thus necessary to determine that the corresponding first time stamp of predetermined image frame.Wherein, make a reservation for
Picture frame is any one picture frame intercepted from main video code flow.In practical application, particular image frame can be set as main view
The predetermined image frame of frequency code stream, such as first frame;A picture frame can also be selected as predetermined from main video code flow kind at random
Picture frame;It is predetermined for a picture frame can also being selected from all images frame of main video code flow according to preset interception rule
Picture frame.For example, according to the scheduled time cycle, obtaining the predetermined image frame of main video code flow, and really before step S202
Determine the corresponding first time stamp of predetermined image frame.
In the program, step S202~step successively periodically can be executed for truncated picture frame in main video code flow
S204, to realize the multiple synchronizing information to main video code flow and sub-video code stream.This is because between two video code flows also
Can there are code rate, frame per second not parity problem, so that the generation time error again of the video code flow after synchronizing.And when passing through scheduled
Between the period carry out multiple time synchronization, reliable synchronizing information between video code flow may be implemented, further increase video flow processing
Accuracy.In practical application, those skilled in the art can be according to the actual situation configured the length of time cycle, this
Apply for embodiment it is not limited here.
Further, the timestamp that the embodiment of the present application uses main video code flow to carry, is determining main video code flow
After predetermined image frame, the corresponding timestamp of predetermined image frame can be determined in step S202, to be hereinafter convenient for description, herein
Referred to as stab at the first time.
In conjunction with above it will be appreciated that, any image frame in main video code flow can find corresponding figure in sub-video code stream
As frame.Based on this, in the embodiment of the present application, after the first time stamp of given predetermined image frame, need to find sub-video code stream
The corresponding timestamp of middle respective image frame, synchronizes for compareing main view frequency code stream.
Specifically, determining the picture frame of sub-video code stream and the diversity factor of predetermined image frame, and really in step S203
Fixed and predetermined image frame diversity factor is less than the picture frame of preset threshold, obtains corresponding second timestamp.
In practical application, each picture frame of sub-video code stream and the diversity factor of predetermined image frame can be determined.Namely
It says, each picture frame in sub-video code stream decoded requires to be compared with the predetermined image frame of main video code flow, protects
Demonstrate,prove the precision of identification.Alternatively, certain extracting rule can be taken in view of there may be multiframes to change lesser video frame,
Such as according to scheduled extraction frequency, multiple images frame is extracted from sub-video code stream, to reduce the calculation amount of equipment, in turn
In step S203, the multiple images frame of sub-video code stream and the diversity factor of predetermined image frame are determined.
When sufficiently small with the diversity factor of predetermined image frame, it is believed that be corresponding with predetermined image frame in sub-video code stream
Picture frame.Those skilled in the art can according to the actual situation be configured the preset threshold of diversity factor, so as in sub- view
A certain number of picture frames are determined in frequency code stream, such as by appropriate threshold, determine the smallest image of difference angle value
Frame.In another example determining several lesser picture frames of difference angle value, then sieved by certain algorithm by appropriate threshold
Choosing, determines the highest picture frame of possibility.Alternatively, in view of the setting by threshold value, however, it is determined that go out multiple diversity factoies
It is worth lesser picture frame, the diversity factor between these picture frames is also smaller at this time, the target pair of optional Zhang Yuzhu video code flow
As detection block information can also realize matched bandwagon effect, therefore can also be selected at random in multiple lesser picture frames of difference angle value
Take one.Further, the timestamp carried using sub-video code stream, can be obtained the picture frame determined in sub-video code stream
Corresponding timestamp, for hereinafter convenient for description, hereon referred to as the second timestamp.
In the embodiment of the present application, at the first time stamp and the second timestamp be only to different video code stream determine when
Between stamp make differentiations, and cannot understand the restriction to the value of timestamp, in practical application, stamp and the second timestamp at the first time
Value can be the same or different, it is not limited here.
The calculating of diversity factor of the embodiment of the present application between two picture frames provides a kind of possible implementation, i.e.,
Determine the mode of the picture frame of sub-video code stream and the diversity factor of predetermined image frame, comprising: by the picture frame of sub-video code stream with
Predetermined image frame zooms to same resolution ratio;Determine two picture frames of same resolution ratio difference of two squares of each pixel accordingly
With;The sum of the difference of two squares is determined as to the picture frame of sub-video code stream and the diversity factor of predetermined image frame, in this way, diversity factor is smaller,
Then indicate that two picture frames are more close.It is appreciated that the party can be respectively adopted in each picture frame chosen in sub-video code stream
Formula is handled, with determining and predetermined image frame similarity.
Alternatively, in step S203, each picture frame of sub-video code stream and the similarity of predetermined image frame are determined,
And determining the second timestamp corresponding greater than the picture frame of preset threshold with the similarity of predetermined image frame.Concrete implementation side
Formula can be decomposed by Histogram Matching, image array, calculate based on modes such as the similarity calculations of characteristic point the phase of image
Like degree, also reference can be made to the process above handled by diversity factor, details are not described herein.
In the embodiment of the present application, by the way that corresponding picture frame in step S202 and step S303, can be obtained in main view frequency
Corresponding timestamp in code stream and sub-video code stream, and then step S204 can be executed.
Specifically, in step S204, according to the time difference of the second timestamp and first time stamp, target object detection block is believed
Breath corresponds to sub-video code stream and carries out image displaying.Wherein, the second timestamp and the at the first time time difference of stamp, i.e. the second timestamp
Value and at the first time the difference of value of stamp can determine that the time of main view frequency code stream and sub-video code stream according to the difference
Error, it is subsequent main video code flow and sub-video code stream to be subjected to synchronizing information processing according to the time error.Due to target
Object detection frame information is synchronous with main video code flow, when browser-presented sub-video code stream image, can use the corresponding time difference
Target object detection block information merges displaying with sub-video code stream picture frame.
Specifically, can be for the target object detection block information of any time stamp, according to the second timestamp and first
The time difference of timestamp extracts the picture frame of the sub-video code stream of corresponding timestamp;The target object detection block that any time is stabbed
Information is merged with the picture frame of the sub-video code stream of corresponding timestamp, and fusion results are carried out image displaying.
As illustratively, however, it is determined that the first time stamp of predetermined image frame A1 is T1 out, is schemed in sub-video code stream with predetermined
As the second timestamp of the corresponding picture frame A2 of frame is T2, then the second timestamp and the time difference △ T=T2- stabbed at the first time
T1.So, the sub-video code for needing to extract is determined according to △ T for the target object detection block information of any time stamp t1
The timestamp t2=t1+ △ T of the picture frame of stream, the target object detection block information and sub-video code stream for being then t1 by timestamp
Middle timestamp is that the picture frame of t2 is merged, and fusion results are carried out image displaying, and the displaying of time synchronization can be obtained
Effect.In practical application, it can be synchronized according to the process for the target object detection block information of different time stamp, herein
It repeats no more.
Image presentation method provided by the embodiments of the present application passes through picture frame between the main video code flow of determination and sub-video code stream
Diversity factor or similarity, to search the main video code flow similar image frame different with sub-video code stream intermediate-resolution, so as to root
The time difference that main video code flow and sub-video code stream are determined according to the timestamp of these similar picture frames, by sub-video code stream and master
The corresponding target object detection block information of video code flow renders displaying together, obtains the bandwagon effect of time synchronization, reduces simultaneously
Requirement to server or terminal device computing capability.
The embodiment of the present application also provides a kind of synchronizing information devices of more video code flows, as shown in figure 3, the synchronizing information
Device 30 may include: to obtain module 301, the first determining module 302, the second determining module 303 and synchronizing information module 304,
Wherein,
It obtains module 301 and is used to obtain the video code flow Dr1 of pending synchronizing information to video code flow DrN, N >=2;
First determining module 302 is for determining corresponding 1st timestamp of the predetermined image frame of video code flow Dr1;
Second determining module 303 is used to determine each picture frame and predetermined image of video code flow Dr2 to video code flow DrN
The diversity factor of frame, and determine corresponding less than the picture frame of preset threshold with the diversity factor of predetermined image frame in video code flow Dr2
2nd timestamp, until N corresponding less than the picture frame of preset threshold with the diversity factor of predetermined image frame in video code flow DrN
Timestamp;
Synchronizing information module 304 is used to be regarded according to the 2nd timestamp to N timestamp time difference with the 1st timestamp respectively
Frequency code stream Dr2 to video code flow DrN compares video code flow Dr1 respectively and carries out synchronizing information processing.
In an optional implementation manner, the second determining module 303 is specifically used for any image frame and predetermined image
Frame zooms to same resolution ratio;Determine the sum of two picture frames of same resolution ratio difference of two squares of each pixel accordingly;It will put down
The sum of variance is determined as the diversity factor of any image frame Yu predetermined image frame.
In an optional implementation manner, the first determining module 302 is also used to determine view according to the scheduled time cycle
The predetermined image frame of frequency code stream Dr1.
The synchronizing information device of more video code flows provided by the embodiments of the present application passes through image between determining different video code stream
The diversity factor or similarity of frame, to search the different similar image frame of different video code stream intermediate-resolution, so as to according to these phases
As the timestamp of picture frame determine the time difference between video code flow, and then realize the synchronizing information between multiple video code flows, have
Effect improves the accuracy of video flow processing.
It is apparent to those skilled in the art that the information of more video code flows provided by the embodiments of the present application
The technical effect of synchronizing device, realization principle and generation is identical with preceding method embodiment, for convenience and simplicity of description, dress
It sets embodiment part and does not refer to place, can refer to corresponding contents in preceding method embodiment, details are not described herein.
The embodiment of the present application also provides a kind of image demonstration apparatus, as shown in figure 4, the image demonstration apparatus 40 can wrap
Include: first obtains the acquisition of module 401, second and determining module 402, third determining module 403 and image display module 404,
In,
First acquisition module 401 is for obtaining sub-video code stream and the corresponding target object detection block of main video code flow
Information;
Second obtains the predetermined image frame for being used to obtain main video code flow with determining module 402, and determines predetermined image frame
Corresponding first time stamp;
Third determining module 403 is used to determine the picture frame of sub-video code stream and the diversity factor of predetermined image frame, and determines
It is less than the picture frame of preset threshold with the diversity factor of predetermined image frame, obtains corresponding second timestamp;
Image display module 404 is used for the time difference stabbed according to the second timestamp and at the first time, by target object detection block
Information corresponds to sub-video code stream and carries out image displaying.
In an optional implementation manner, third determining module 403 be specifically used for by the picture frame of sub-video code stream with
Predetermined image frame zooms to same resolution ratio;Determine two picture frames of same resolution ratio difference of two squares of each pixel accordingly
With;The sum of the difference of two squares is determined as to the picture frame of sub-video code stream and the diversity factor of predetermined image frame.
In an optional implementation manner, third determining module 403 is also used to solve the sub-video code stream of acquisition
Code, obtains the picture frame of sub-video code stream.
In an optional implementation manner, acquisition of winning the second place is specifically used for determining module 402 according to the scheduled time
Period obtains the predetermined image frame of main video code flow, and determines the corresponding first time stamp of predetermined image frame.
In an optional implementation manner, acquisition of winning the second place is specifically used for obtaining main video code flow with determining module 402
Decoded predetermined image frame.
In an optional implementation manner, image display module 404 is specifically used for the target pair for any time stamp
As detection block information extracts the figure of the sub-video code stream of corresponding timestamp according to the time difference of the second timestamp and first time stamp
As frame;The picture frame of the target object detection block information of any time stamp and the sub-video code stream of corresponding timestamp is melted
It closes, and fusion results is subjected to image displaying.
Image demonstration apparatus provided by the embodiments of the present application passes through picture frame between the main video code flow of determination and sub-video code stream
Diversity factor or similarity, to search the main video code flow similar image frame different with sub-video code stream intermediate-resolution, so as to root
The time difference that main video code flow and sub-video code stream are determined according to the timestamp of these similar picture frames, by sub-video code stream and master
The corresponding target object detection block information of video code flow, rendering is shown together, is obtained the bandwagon effect of time synchronization, is reduced simultaneously
Requirement to server or terminal device computing capability.
It is apparent to those skilled in the art that image demonstration apparatus provided by the embodiments of the present application,
Realization principle and the technical effect of generation are identical with preceding method embodiment, for convenience and simplicity of description, Installation practice portion
Divide and do not refer to place, can refer to corresponding contents in preceding method embodiment, details are not described herein.
The embodiment of the present application also provides a kind of electronic equipment (calculating equipment), as shown in figure 5, electronics shown in fig. 5 is set
50 include: processor 501 and memory 502, memory 502 be stored at least one instruction, an at least Duan Chengxu, code set or
Instruction set, at least one instruction, an at least Duan Chengxu, code set or instruction set are loaded by processor 501 and are executed to realize
Corresponding contents in aforementioned either method embodiment.
Optionally, electronic equipment 50 can also include transceiver 503.Processor 501 is connected with transceiver 503, such as passes through
Bus 504 is connected.It should be noted that transceiver 503 is not limited to one in practical application, the structure of the electronic equipment 50 is not
Constitute the restriction to the embodiment of the present application.
Wherein, processor 501 can be CPU, general processor, DSP, ASIC, FPGA or other programmable logic devices
Part, transistor logic, hardware component or any combination thereof.It, which may be implemented or executes, combines present disclosure institute
The various illustrative logic blocks of description, module and circuit.Processor 501 is also possible to realize the combination of computing function, example
It is such as combined comprising one or more microprocessors, DSP and the combination of microprocessor etc..
Bus 504 may include an access, and information is transmitted between said modules.Bus 504 can be pci bus or EISA
Bus etc..Bus 504 can be divided into address bus, data/address bus, control bus etc..For convenient for indicating, in Fig. 5 only with one slightly
Line indicates, it is not intended that an only bus or a type of bus.
Memory 502 can be ROM or can store the other kinds of static storage device of static information and instruction, RAM
Or the other kinds of dynamic memory of information and instruction can be stored, it is also possible to EEPROM, CD-ROM or other CDs
Storage, optical disc storage (including compression optical disc, laser disc, optical disc, Digital Versatile Disc, Blu-ray Disc etc.), magnetic disk storage medium
Or other magnetic storage apparatus or can be used in carry or store have instruction or data structure form desired program generation
Code and can by any other medium of computer access, but not limited to this.
The embodiment of the present application also provides a kind of computer readable storage mediums, and the computer storage medium is based on storing
The instruction of calculation machine, when run on a computer, allows computer to execute corresponding contents in preceding method embodiment.
It should be understood that although each step in the flow chart of attached drawing is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, can execute in the other order.Moreover, at least one in the flow chart of attached drawing
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, execution sequence, which is also not necessarily, successively to be carried out, but can be with other
At least part of the sub-step or stage of step or other steps executes in turn or alternately.
The above is only some embodiments of the application, it is noted that for the ordinary skill people of the art
For member, under the premise of not departing from the application principle, several improvements and modifications can also be made, these improvements and modifications are also answered
It is considered as the protection scope of the application.