CN1349351A - Method of generating data stream index file and using said file accessing frame and shearing lens - Google Patents
Method of generating data stream index file and using said file accessing frame and shearing lens Download PDFInfo
- Publication number
- CN1349351A CN1349351A CN 00129698 CN00129698A CN1349351A CN 1349351 A CN1349351 A CN 1349351A CN 00129698 CN00129698 CN 00129698 CN 00129698 A CN00129698 A CN 00129698A CN 1349351 A CN1349351 A CN 1349351A
- Authority
- CN
- China
- Prior art keywords
- frame
- index
- file
- stream
- slice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
A greating method of MPEG-2 code flow index file is to find starting point of video basic flow head and heginning of picture corresponding to starting of one frame by scanning video data content in MPEG-2 flwo, and build index, complete the transfer from MPEG-2 flow encoding sequence to play order, at same time, to provide method for random visiting arbitrary frame in MPEG-2 code flow by utilizing primitive character to reduce the complexity of character extracting, to provide a searching method for lens edge on compress area, to proceed block searching for lens by multistage resolution ratio detecting method utilizing MPEG-2 code flow index file. The analysed result for other video frames is used to reduce processed data quatity.
Description
The present invention relates to the method that a kind of stream index file generated and visited with this document frame and shearing lens, especially refer to a kind of based on the program stream of MPEG-2 code stream, flow substantially and set up index file, and use the method for this document random access arbitrary frame and the searching method of high speed shearing lens, belong to the multimedia messages process field.
At present, digital information has developed into the multimedia messages of information types such as containing video, audio frequency, picture, text from the plain text in past.In multimedia database, effective managerial demand of video media makes things convenient for the user to the video data fast access to the support of video data structureization.Along with the raising of desktop computer performance, the continuous reduction of storage medium expense, the expansion of broadband network, the application of digital of digital video data becomes more and more widely.Each digital video material all is made of a series of frames continuous in time, and the application of many relevant multimedia videos is all wished to navigate to a certain particular frame in the video sequence fast.Though the VCD software player in present all multi-microcomputer environment all provides the function of corresponding F.F., rewind down, this random access ability all has certain limitation on rapidity, accuracy, can't satisfy the needs of many more senior multimedia application.For example: a large-scale video database system wishes to provide the content-based retrieval mode for the user, video stream file in the storehouse is through after the structurized analyzing and processing, camera lens collection in the video flowing has all been added index, the user is browsing when retrieval if need forward another camera lens to from a camera lens, will wish that system can be with the F.F. or fall back on initial first frame of target mirror head soon exactly of the fastest response speed; Such system generally all responds a plurality of users' request concomitantly with client/service mode, at this moment realize that by video flowing being set up suitable index rapidity, accuracy to the visit of particular frame video content are a kind of effective solutions.
It is the basic function of video information management system to video data structureization that camera lens is cut apart.Manual completely mark is a uninteresting manpower work consuming time, provide various supermatic structural analysis instruments that initial data is handled, the content structure of setting up and describe video information with automation or semi-automatic mode is a kind of important system requirements.
Frame in the MPEG code stream is carried out decompress(ion) contract to show it is many basic operations that relate to the multimedia application of video.Because MPEG code stream coding, having only type of coding is that the content of the figure of I can independent decoding and displaying, and the figure of other type need be correctly decoded at relative some frame, after this figure can be correctly decoded.The F.F. of the mpeg program stream studio equipments that this is also general just, the resolution cell of rewind down are generally the reason of a set of pictures (GOP), its essence is carried out be to the search of the most approaching I figure in target location, rather than any one accurate frame searched for.
But, in order to satisfy specific application demand, need search for the location sometimes to a concrete frame.For example: shearing lens is a kind of the most general camera lens switching mode, and camera lens in two adjacent interframe sudden change takes place.It all is basic key technology that camera lens is segmented in many Video Applications, as automated cataloging system of news etc.; Shot transition in some news category record programs nearly all adopts this mode to give prominence to the serious formal property of content.By the news hookup of Chinese Central Television (CCTV) every day being made the manual mark statistics of camera lens, find that the shot transition more than 95% is the shear type.To the editor of this class camera lens, often need a concrete frame is searched for the location accurately.
Seeking a camera lens in the fragment of a video, need search out the transition frames between the camera lens usually, is that the method for resolution cell obviously is coarse and utilize above-mentioned with a GOP (GOP).In addition,, adopt multistage resolution detection mode to come content characteristic amount between the comparison consecutive frame usually, the MPEG-2 code stream is set up the basis that suitable index file is multistage resolution detection mode in order to improve the speed of analyzing search.
Main purpose of the present invention is to provide a kind of generation method of MPEG-2 code stream index file, MPEG-2 program stream, basic stream are set up index, scan the position of the figure head that the original position of finding video packing elementary stream packet header and a corresponding frame begin by content to the video data in the MPEG-2 stream, finish MPEG-2 stream encryption order to the conversion of playing order, make frame in the index put in order with to play order consistent.
Another object of the present invention is to provide the method for the arbitrary frame in a kind of random access MPEG2 code stream, utilize the different characteristics of the contained information of different coding type frame in the MPEG-2 code stream, by utilizing primitive character information to reduce the time complexity of feature extraction, thereby realize the arbitrary frame in the random access MPEG2 code stream.
The present invention's purpose again is to provide on a kind of compression domain shot boundary searching method more fast, compare with camera lens partitioning algorithm on the existing compression domain, it utilizes MPEG-2 code stream index file, adopts multistage resolution detection method that camera lens is cut search; Utilization is skipped the frame of video of some to the analysis result of other frame of video, thereby the data volume that whole search procedure is handled significantly reduces.
The present invention is achieved through the following technical solutions:
A kind of generation method of MPEG2 code stream index file, it comprises: the program stream of MPEG-2 or MPEG-1, transport stream, packetized datastream or master data stream file, and may further comprise the steps:
1, opens a basic stream file and set up the temporary file of a sky;
2, the totalframes counter that contains in the program stream being set is 0, and end mark is FALSE;
If 3 screen buffers are empty, then search for, resolve basic stream file, basic stream is read in screen buffer;
4, the various mpeg header information datas in search, the parsing screen buffer if run into the end mark of EOS sign indicating number or basic stream file, are then changeed step 15; If run into a video PES packet header, write down the original position in this packet header; If run into figure head, write down the original position of these figure head, and change step 5;
5, resolve this figure head;
6, if the coding of graphics type is the category-B type, the present frame of then decoding is the frame type of coding of B frame, changes step 9; Otherwise change step 7;
7, if end mark is FALSE, then forward reference frame is exchanged to the content of reference frame with the back;
8, the decoding present frame is that the back is to reference frame;
If 9 end marks are FALSE, then the start position information with coding of graphics type, figure head is deposited into the object that the decoding present frame points to; If stream type is a program stream, also the start position information in this packet header is deposited into the object of decoding present frame sensing simultaneously, whether the gop structure of checking MPEG2 code stream non-regular situation occurs, if then failure is withdrawed from;
If the totalframes counter that contains in 10 program streams is not 0, and the figure chip architecture is frame type, and perhaps end mark is FALSE, if then the coding of graphics type is the category-B type, then playing present frame is the frame type of coding of B frame, otherwise the broadcast present frame is a forward reference frame; Change step 13;
If 11 photo current structures are not frame type, then end mark negate;
If 12 end marks are FALSE, then will play the information of present frame point at objects and put in the output buffer, value+1 of the totalframes counter that contains in the program stream;
If 13 output buffers surpass certain full scale, then take out a certain amount of data, construct some index, and be written in the temporary file by predetermined file format;
14, change step 3;
15, if output buffer is not empty, then take out wherein all data, construct some index, and be written in the temporary file by predetermined file format;
16, set up the index file of a sky, by the index file form data of description is written in the file, the content of temporary file is appended to index file, and closes index file, temporary file is closed and deleted to basic stream file.
Two tuples＜the G of above-mentioned MPEG code stream, D〉the element D of index I is the set of index of arranging by DISPLAY ORDER; The structure that element G is is＜FrameRate, Frames, tagRegular, Gop_NP, Gop_NB, BL_GopIndex, BaseFrmNum, TypeStream 〉, wherein: FrameRate is the frame per second of mpeg stream, the totalframes of Frames for containing in this program stream, whether the gop structure of the mpeg stream of tagRegular sign index is regular, Gop_NP, Gop_NB is respectively the P frame contained among each GOP of indexed mpeg stream and the number of B frame, and BL_GopIndex is the byte number of all frames costs among GOP of index in index I, BaseFrmNum be in the mpeg program stream by the frame number of first I frame of playing sequence, TypeStream is the type of index stream.Described index is I index or P index; I index is for containing the index form of the I type figure slice, thin piece group of I figure to reference frame in the figure slice, thin piece group that constitutes GOP, it is a four-tuple＜tag, numB, ipPos, dif_Bs 〉; Described P index is for containing the index form of the P type figure slice, thin piece group of P figure to reference frame in the figure slice, thin piece group that constitutes GOP, it is a four-tuple＜tag, numB, ipPos, dif_Bs 〉; In the described four-tuple, tag is the type of index, the number of the B frame that comprises in the figure slice, thin piece group of numB for this index correspondence, ipPos is the associated description information of the position in stream of I frame or P frame in the corresponding figure slice, thin piece group of this index, dif_Bs is an in order positive manifold of being made up of numB element, and each element wherein is the associated description information of the position of each B frame in the figure slice, thin piece group with respect to the alternate position spike of ipPos.The index file form is for being the storage format of Data Structures with element G among the index I.
The method of arbitrary frame in a kind of random access MPEG2 code stream, it comprises: the program stream of MPEG-2 or MPEG-1, transport stream, packetized datastream or master data stream file, and may further comprise the steps:
1, opens basic stream file, adopt the index file of the corresponding code stream that the generation method of above-mentioned MPEG2 code stream index file set up;
2, from the index file of corresponding code stream, extract relevant parameter, obtain frame number and be index position in the D element in index I of I type figure slice, thin piece group correspondence of the frame place GOP of required frame number;
3, mobile phase answer code stream the file pointer of index file to the corresponding position of the position that step 2 is obtained, and read the content of an index size;
4, the file pointer that moves basic stream file respective frame corresponding position in code stream in the corresponding figure slice, thin piece group of index that is read utilizes the decode data of this frame of mpeg decode engine;
If step 14 is then changeed in numbering=0 of 5 searched frames in set of pictures;
6, establish previous index and be current index;
7, if the numbering of searched frame in set of pictures less than the frame number value that each index comprises, then changeed step 11;
8, from the index file of corresponding code stream, read the content of an index size;
9, the file pointer that moves basic stream file respective frame corresponding position in code stream in the corresponding figure slice, thin piece group of index that is read utilizes the decode data of this frame of mpeg decode engine;
10, the frame number value that numbering-each index comprise of the numbering=searched frame of searched frame in set of pictures in set of pictures changeed step 6;
11, if step 14 is then changeed in numbering=0 of searched frame in set of pictures;
12, from the index file of corresponding code stream, read the content of an index size, the file pointer that moves basic stream file respective frame corresponding position in code stream in the corresponding figure slice, thin piece group of index that reads utilizes the decode data of this frame of mpeg decode engine;
13, the position of the file pointer that moves basic stream file corresponding B frame in the corresponding position of respective frame in code stream in the corresponding figure slice, thin piece group of index that reads utilizes the decode data of this frame of mpeg decode engine;
14, find out the frame of last decoding; Finish.
A kind of high speed shearing lens border search method, it comprises: the program stream of MPEG-2 or MPEG-1, transport stream, packetized datastream or master data stream file, and may further comprise the steps:
1, opens basic stream file, adopt the index file of the corresponding code stream that the generation method of above-mentioned MPEG2 code stream index file set up;
If 2 have detected all GOP, forward step 5 to; Otherwise, carry out the GOP level and detect, if satisfy the similitude requirement of setting, then continue to detect I
K+1, I
K+2Between the content similarity degree; Otherwise I is described
k, I
K+1Between may have the switching of camera lens, carry out step 3;
3, carry out figure slice, thin piece group level and detect, establish SP
l, SP
L+1Be two adjacent figure slice, thin piece groups, and SP
L+1Be P type figure slice, thin piece group, detect SP
l, SP
L+1Reference frame R in the figure slice, thin piece group
m, R
M+1Between the content similarity degree, if the similitude requirement of satisfy setting, then continue to detect the reference frame R of next figure slice, thin piece group
M+2With R
M+1Between the content similarity, otherwise the explanation R
m, R
M+1Between may have the switching of camera lens, when finding SP
L+1Be I type figure slice, thin piece group, SP
lThen be last figure slice, thin piece group of a GOP, carry out step 4;
4, carry out the frame level and detect,, turn back to step 2 after then analyzing, otherwise turn back to step 3 if this B frame sequence belongs to last figure slice, thin piece group of a GOP;
5, write down the position that all camera lenses switch, finish.
Above-mentioned GOP level detects: to two I frame I at a distance of a GOP length
k, I
K+1Between the detection of content similarity degree; Figure slice, thin piece group level detects: to being in two I frame I
k, I
K+1Between the detection undertaken by the resolution of figure slice, thin piece group of frame; The frame level detects: to all the B frame sequence B between two reference frames
1B
2... B
nAnalyze, determine the generation and the accurate position thereof of shearing lens.
The frame level detects according to the following step:
1, the correlation function Relevance between reference frame of definition (df, db):
Wherein df, db are the frame number of two adjacent reference frames, and NFwdBack (d) and NFwdBackSkip (d) are respectively the function that calculates bi-directional predicted macroblock number and two-way skip macroblock number among the frame d;
R
i, R
jDui Ying broadcast frame number is f, b respectively;
2, if: Relevance (f, b) 〉=K
2SumofMacroBlocks, wherein K
2, K
2 ∈(0,1) is the threshold parameter of system,
Then: frame R
i, R
jBetween do not have the switching of camera lens;
3 otherwise, for B
k(k=1,2 ... n), if:
NBackSkip(d)+NBackward(d)＞K
3·(NFwdSkip(d)+NForward(d))
And: Relevance (f, b)≤K
4SumofMacroBlocks
Then at frame B
k(k=1,2 ..n) and the switching of camera lens taken place between its former frame;
Wherein: K
4, K
4 ∈(0,1) is the threshold parameter of system, NBackSkip (d), and NBackward (d) NFwdSkip (d) and NForward (d) are respectively: back among the frame d to the skip macroblock number, backward prediction macroblock number, forward direction skip macroblock number and forward prediction macroblock number; K wherein
3, (K
3＞1) is the threshold parameter of system;
4, for B
n, if: Relevance (f, b)≤K
4SumofMacroBlocks and: K
3(NBackSkip (d)+NBackward (d))＜NFwdSkip (d)+NForward (d) then judges at B
nWith a frame R thereafter
jBetween the switching of camera lens has taken place.
The present invention has finished MPEG2 code stream coding order to the conversion of playing order by to setting up index based on the program stream of MPEG2 code stream, basic stream, makes frame in the index put in order with to play order consistent; And, utilize the different characteristics of the contained information of frame of different coding type in the MPEG2 code stream, realized random access to any frame in the MPEG2 code stream; In addition, the present invention utilizes MPEG2 code stream index file, adopts the detection method of multistage resolution that camera lens is cut detection; Utilization is skipped the frame of video of some to the analysis result of other frame of video, thereby the deal with data amount of whole detection process is significantly reduced, and compares with camera lens partitioning algorithm on the existing compression domain, and it has improved the speed to the search of MPEG2 code stream analysis.
Below, the present invention is described in further detail in conjunction with the accompanying drawings:
Fig. 1 is one of the flow chart of the generation method of MPEG2 code stream index file.
Fig. 2 be MPEG2 code stream index file the generation method flow chart two.
Fig. 3 is the schematic flow sheet of the method for the arbitrary frame in the random access MPEG2 code stream.
Fig. 4 is the schematic flow sheet of high speed shearing lens border search method.
Referring to Fig. 1 and Fig. 2, be the flow chart of the generation method of MPEG-2 code stream index file of the present invention.This method is based on the program stream of MPEG-2 or MPEG-1, or basic stream file sets up index, according to flow chart:
At first open a basic stream file and the temporary file of setting up a sky, at this moment, basic stream file is one and is used to deposit the file of sky of index stream that its gop structure is the MPEG2 code stream of rule, the gop structure that is meant of so-called rule is constant at whole program stream, and the number of the B frame that comprises between the reference frame by the DISPLAY ORDER arrangement is identical.
Secondly, the totalframes counter of program stream is set to 0, and end mark is set to FALSE.
If screen buffer is empty, then search for, resolve basic stream file, basic stream is read in screen buffer.
Then, various mpeg header information datas in search, the parsing screen buffer, if run into the end mark of EOS sign indicating number or basic stream file, finish operations such as all search, parsing, take out all data in the output buffer, construct some index, and be written in the temporary file by predetermined file format, set up the index file of a sky again, by the index file form data of description is written in the file, the content of temporary file is appended to index file, and closes index file and basic stream file, close and delete temporary file.
If run into a video PES packet header, write down the original position in this packet header.If run into figure head, write down the original position of these figure head, otherwise continue the various mpeg header information datas in search, the parsing screen buffer.
Resolve this figure head; If the coding of graphics type is the category-B type, the present frame of then decoding is the frame type of coding of B frame, otherwise if end mark is FALSE, then forward reference frame is exchanged to the content of reference frame with the back, and the decoding present frame is that the back is to reference frame.
If end mark is FALSE, then the start position information with coding of graphics type, figure head is deposited into the object that the decoding present frame points to; If the type of stream is a program stream, also the start position information in this packet header is deposited into the object of decoding present frame sensing simultaneously.
Whether the gop structure of checking MPEG2 code stream non-regular situation occurs, if then failure is withdrawed from.
If the totalframes counter that contains in the program stream is not 0, and the figure chip architecture is frame type, and perhaps end mark is FALSE, if then the coding of graphics type is the category-B type, then playing present frame is the frame type of coding of B frame, otherwise the broadcast present frame is a forward reference frame.
If the totalframes counter is not 0, and the photo current structure is not frame type, and perhaps end mark is FALSE, then end mark negate; If end mark is FALSE, then will play the information of present frame point at objects and put in the output buffer, make the value of the totalframes counter that contains in the program stream increase progressively 1.
If output buffer surpasses certain full scale, then take out a certain amount of data, construct some index, and be written in the temporary file by predetermined file format.
Each steps such as various mpeg header information datas in repeat search, the parsing screen buffer withdraw from up to whole search end or failure.
Above-mentioned MPEG code stream has index I, and it is one two tuple,＜G, D 〉; Element G is the architectural feature of code stream and all description entrys of feature of index I, and element D is all index of arranging by DISPLAY ORDER.The structure that element G is is＜FrameRate, Frames, tagRegular, Gop_NP, Gop_NB, BL_GopIndex, BaseFrmNum, TypeStream 〉, wherein: FrameRate is the frame per second of mpeg stream, the totalframes of Frames for containing in this program stream, whether the gop structure of the mpeg stream of tagRegular sign index is regular, Gop_NP, Gop_NB is respectively the P frame contained among each GOP of indexed mpeg stream and the number of B frame, and BL_GopIndex is the byte number of all frames costs among GOP of index in index I, BaseFrmNum be in the mpeg program stream by the frame number of first I frame of playing sequence, TypeStream is the type of index stream.
Index in the MPEG code stream is I index or P index, and I index is for containing the index form of the I type figure slice, thin piece group of I figure to reference frame in the figure slice, thin piece group that constitutes GOP; P index is for containing the index form of the P type figure slice, thin piece group of P figure to reference frame in the figure slice, thin piece group that constitutes GOP; Two kinds of above-mentioned index are four-tuple＜tag all, numB, ipPos, dif_Bs 〉, in this four-tuple, tag is the type of index, the number of the B frame that comprises in the figure slice, thin piece group of numB for this index correspondence, ipPos is the associated description information of the position in stream of I frame or P frame in the corresponding figure slice, thin piece group of this index, dif_Bs is an in order positive manifold of being made up of numB element, and each element wherein is the associated description information of the position of each B frame in the figure slice, thin piece group with respect to the alternate position spike of ipPos.
The index file form then is to be the storage format of Data Structures with element G among the index I.
Referring to Fig. 3, be the flow chart of the method for arbitrary frame in the random access MPEG2 code stream of the present invention.This method is based on the program stream of MPEG-2 or MPEG-1 or basic stream file and associated index file, according to flow chart:
At first, open the index file of the corresponding code stream that the generation method of basic stream file and employing MPEG2 code stream index file correspondingly set up.
Secondly, from the index file of corresponding code stream, extract relevant parameter, obtain index position in the D element in index I of frame number, and read the content of an index size for the I type figure slice, thin piece group correspondence of the frame place GOP of the frame number that needs.
Then, the file pointer that moves basic stream file respective frame corresponding position in code stream in the corresponding figure slice, thin piece group of index that is read utilizes the decode data of this frame of mpeg decode engine.
If numbering=0 of searched frame in set of pictures then finds out the frame of last decoding, finish; Otherwise, establish previous index and be current index.
If the frame number that the numbering of searched frame in set of pictures comprises less than each index, and, then find out the frame of last decoding as if numbering=0 of searched frame in set of pictures, finish;
Otherwise, from the index file of corresponding code stream, read a big or small content of index; The file pointer that moves basic stream file respective frame corresponding position in code stream in the corresponding figure slice, thin piece group of index that is read utilizes the decode data of this frame of mpeg decode engine.
Make the frame number that numbering-each index comprise of the numbering=searched frame of searched frame in set of pictures in set of pictures, establish previous index and be current index; As if numbering=0 of searched frame in set of pictures, then find out the frame of last decoding, finish.
From the index file of corresponding code stream, read the content of an index size, the file pointer that moves basic stream file respective frame corresponding position in code stream in the corresponding figure slice, thin piece group of index that reads utilizes the decode data of this frame of mpeg decode engine.
The position of the file pointer that moves basic stream file corresponding B frame in the corresponding position of respective frame in code stream in the corresponding figure slice, thin piece group of index that reads utilizes the decode data of this frame of mpeg decode engine.
Find out the frame of last decoding, finish.
Referring to Fig. 4, be the flow chart of high speed shearing lens border search method of the present invention.This method is based on the program stream of MPEG-2 or MPEG-1, or basic stream file and associated index file, according to flow chart:
At first, open basic stream file, adopt the index file of the corresponding code stream that the generation method of above-mentioned a kind of MPEG2 code stream index file set up; If detected all GOP, write down the position that all camera lenses switch, finish; Otherwise, carry out the GOP level and detect, if satisfy the similitude requirement of setting, then continue to detect I
K+1, I
K+2Between the content similarity degree; Otherwise I is described
k, I
K+1Between may have the switching of camera lens, carry out figure slice, thin piece group level and detect.
Carry out figure slice, thin piece group level and detect, establish SP
l, SP
L+1Be two adjacent figure slice, thin piece groups, and SP
L+1Be P type figure slice, thin piece group, detect SP
l, SP
L+1Reference frame R in the figure slice, thin piece group
m, R
M+1Between the content similarity degree, if the similitude requirement of satisfy setting, then continue to detect the reference frame R of next figure slice, thin piece group
M+2With R
M+1Between the content similarity, otherwise the explanation R
m, R
M+1Between may have the switching of camera lens, when finding SP
L+1Be I type figure slice, thin piece group, SP
lThen be last figure slice, thin piece group of a GOP, carry out the frame level and detect.
Carry out the frame level and detect,, forward to after then analyzing and carry out the detection of GOP level, detect otherwise turn back to figure slice, thin piece group level if this B frame sequence belongs to last figure slice, thin piece group of a GOP.
Above-mentioned GOP level detects: to two I frame I at a distance of a GOP length
k, I
K+1Between the detection of content similarity degree; Figure slice, thin piece group level detects: to being in two I frame I
k, I
K+1Between the detection undertaken by the resolution of figure slice, thin piece group of frame; The frame level detects: to all the B frame sequence B between two reference frames
1B
2... B
nAnalyze, determine the generation and the accurate position thereof of shearing lens.
The frame level detects according to following method:
The detection of frame level confirms to provide the scope that detects for the frame level in a figure slice, thin piece group.The frame level confirms to utilize the information in the original compression territory of the B frame in the figure slice, thin piece group, judges the accurate position whether shearing lens takes place extremely to take place.
B frame in the mpeg stream is made of dissimilar macro blocks, includes intra-frame macro block (Intra), forward prediction macroblock (Forward), backward prediction macroblock (Backward), bi-directional predicted macro block (FwdBack), forward direction skip macroblock (FwdSkip), back to skip macroblock (BackSkip), two-way skip macroblock (FwdBackSkip).
Press the frame sequence R that playing sequence is arranged for one
iB
1B
2... B
nR
j, if exist k (k=1,2 ... n), contain a lot of bi-directional predicted macro blocks among the frame Bk, according to the encryption algorithm of MPEG, if B
kTwo reference frame R
i, R
jBetween content have very big correlation.For this reason, define correlation function Relevance between a reference frame (df, db).
Wherein df, db are the frame number of two adjacent reference frames, and NFwdBack (d), NFwdBackSkip (d) obtain bi-directional predicted macroblock number and two-way skip macroblock number among the frame d respectively.
If R
i, R
jDui Ying broadcast frame number is f, b respectively,
If:
Relevance(f，b)≥K
2·SumofMacroBlocks
Then: frame R
i, R
jBetween do not have the switching of camera lens.
Wherein: K
2, K
2 ∈(0,1) is the threshold parameter of system.
Otherwise:
For B
k(k=1,2 ... n), if:
NBackSkip(d)+NBackward(d)＞K
3·(NFwdSkip(d)+NForward(d))
Relevance(f，b)≤K
4·SumofMacroBlocks
Wherein: K
4, K
4 ∈(0,1) is the threshold parameter of system
Then: at B
k(k=1,2 ... n) and the switching of camera lens taken place between its former frame.
Wherein: NBackSkip (d), NBackward (d), NFwdSkip (d), NForward (d) are respectively back to the skip macroblock number among the frame d, backward prediction macroblock number, forward direction skip macroblock number and forward prediction macroblock number, wherein K
3, (K
3＞1) is the threshold parameter of system.
In addition, for B
n,
If:
Relevance(f，b)≤K
4·SumofMacroBlocks
K
3·(NBackSkip(d)+NBackward(d))＜NFwdSkip(d)+NForward(d)
Then: at B
nWith a frame R thereafter
jBetween the switching of camera lens has taken place.
Claims (11)
1, a kind of generation method of MPEG2 code stream index file, it comprises: the program stream of MPEG-2 or MPEG-1, transport stream, packetized datastream or master data stream file, it is characterized in that: it is further comprising the steps of:
A, open a basic stream file and set up the temporary file of a sky;
B, the totalframes counter that contains in the program stream is set is 0, and end mark is FALSE;
If the c screen buffer is empty, then search for, resolve basic stream file, basic stream is read in
Screen buffer;
Various mpeg header information datas in d, search, the parsing screen buffer are if run into the sequence knot
The end mark of bundle sign indicating number or basic stream file then changes step o; If run into a video PES packet header,
Write down the original position in this packet header; If run into figure head, write down the original position of these figure head,
And commentaries on classics step e;
E, resolve this figure head;
F, if the coding of graphics type is the category-B type, the present frame of then decoding is the frame type of coding of B frame, changes
Step I; Otherwise commentaries on classics step g;
G, if end mark is FALSE, then forward reference frame is exchanged to the content of reference frame with the back;
H, decoding present frame are that the back is to reference frame;
If the i end mark is FALSE, then with the start position information of coding of graphics type, figure head
Be deposited into the object that the decoding present frame points to; If stream type is a program stream, simultaneously also with this packet header
Start position information be deposited into the object that the decoding present frame points to, the GOP of checking MPEG2 code stream
Whether structure non-regular situation occurs, if then failure is withdrawed from;
If the totalframes counter that contains in the j program stream is not 0, and the figure chip architecture is frame type, or
Person's end mark is FALSE, if then the coding of graphics type is the category-B type, then plays present frame and is
The frame type of coding of B frame, otherwise the broadcast present frame is a forward reference frame; Change step m;
If k photo current structure is not a frame type, then end mark negate;
If the l end mark is FALSE, then will plays the information of present frame point at objects and put into output
In the buffering area, value+1 of the totalframes counter that contains in the program stream;
If the m output buffer surpasses certain full scale, then take out a certain amount of data, construct if
Dried index, and be written in the temporary file by predetermined file format;
N, commentaries on classics step c;
O, not empty as if output buffer then takes out wherein all data, constructs some index,
And be written in the temporary file by predetermined file format;
P, set up the index file of a sky, data of description be written in the file by the index file form,
The content of temporary file is appended to index file, and closes index file, basic stream file closes
Close and delete temporary file.
2, the generation method of a kind of MPEG2 code stream index file as claimed in claim 1 is characterized in that: two tuples of described MPEG code stream＜G, D〉the element D of index I is the set of index of arranging by DISPLAY ORDER; The structure that element G is is＜FrameRate, Frames, tagRegular, Gop_NP, Gop_NB, BL_GopIndex, BaseFrmNum, TypeStream 〉, wherein: FrameRate is the frame per second of mpeg stream, the totalframes of Frames for containing in this program stream, whether the gop structure of the mpeg stream of tagRegular sign index is regular, Gop_NP, Gop_NB is respectively the P frame contained among each GOP of indexed mpeg stream and the number of B frame, and BL_GopIndex is the byte number of all frames costs among GOP of index in index I, BaseFrmNum be in the mpeg program stream by the frame number of first I frame of playing sequence, TypeStream is the type of index stream.
3, the generation method of a kind of MPEG2 code stream index file as claimed in claim 1 is characterized in that: described index is I index or P index.
4, the generation method of a kind of MPEG2 code stream index file as claimed in claim 3, it is characterized in that: described I index is for containing the index form of the I type figure slice, thin piece group of I figure to reference frame in the figure slice, thin piece group that constitutes GOP, it is a four-tuple＜tag, numB, ipPos, dif_Bs 〉; Described P index is for containing the index form of the P type figure slice, thin piece group of P figure to reference frame in the figure slice, thin piece group that constitutes GOP, it is a four-tuple＜tag, numB, ipPos, dif_Bs 〉; In the described four-tuple, tag is the type of index, the number of the B frame that comprises in the figure slice, thin piece group of numB for this index correspondence, ipPos is the associated description information of the position in stream of I frame or P frame in the corresponding figure slice, thin piece group of this index, dif_Bs is an in order positive manifold of being made up of numB element, and each element wherein is the associated description information of the position of each B frame in the figure slice, thin piece group with respect to the alternate position spike of ipPos.
5, the generation method of a kind of MPEG2 code stream index file as claimed in claim 1 is characterized in that: described index file form is for being the storage format of Data Structures with element G among the index I.
6, the method for arbitrary frame in a kind of random access MPEG2 code stream, it comprises: the program stream of MPEG-2 or MPEG-1, transport stream, packetized datastream or master data stream file, it is characterized in that: it is further comprising the steps of:
A, open basic stream file, adopt as the described a kind of MPEG2 code stream index of claim 1-5
The index file of the corresponding code stream that the generation method of file is set up;
B, the parameter that extraction is correlated with from the index file of corresponding code stream, obtaining frame number is required frame
Index of the I type figure slice, thin piece group correspondence of the frame place GOP of sequence number is in index I in the D element
The position;
C, mobile phase answer the file pointer of index file of code stream to the corresponding position of the position that step b obtains,
And read the content of index size;
D, the file pointer phase in the corresponding figure slice, thin piece group of index that is read that moves basic stream file
Answer the corresponding position of frame in code stream, utilize the decode data of this frame of mpeg decode engine;
If step n is then changeed in numbering=0 of the searched frame of e in set of pictures;
F, establish previous index and be current index;
G, if the frame number value that comprises less than each index of the numbering of searched frame in set of pictures then change the step
Rapid k;
H, from the index file of corresponding code stream, read the content of index size;
I, the file pointer phase in the corresponding figure slice, thin piece group of index that is read that moves basic stream file
Answer the corresponding position of frame in code stream, utilize the decode data of this frame of mpeg decode engine;
J, the searched frame numbering=searched frame in set of pictures numbering-each index in set of pictures
The frame number value that comprises is changeed step f;
K, if numbering=0 of searched frame in set of pictures, then change step n;
L, from the index file of corresponding code stream, read the content of index size, move basic stream
The file pointer of file respective frame phase in code stream in the corresponding figure slice, thin piece group of the index that reads
The position of answering utilizes the decode data of this frame of mpeg decode engine;
M, the file pointer that moves basic stream file are corresponding in the corresponding figure slice, thin piece group of index that reads
The position of corresponding B frame in the corresponding position of frame in code stream utilizes mpeg decode to draw
Hold up the data of this frame of decoding;
N, find out the frame of last decoding; Finish.
7, a kind of high speed shearing lens border search method, it comprises: the program stream of MPEG-2 or MPEG-1, transport stream, packetized datastream or master data stream file, it is characterized in that: it is further comprising the steps of:
A, open basic stream file, adopt as the described a kind of MPEG2 code stream index of claim 1-5
The index file of the corresponding code stream that the generation method of file is set up;
If b has detected all GOP, forward step e1 to; Otherwise, carry out the GOP level and detect,
If satisfy the similitude requirement of setting, then continue to detect I
K+1, I
K+2Between the content similarity degree;
Otherwise I is described
k, I
K+1Between may have the switching of camera lens, carry out step c;
C, carry out figure slice, thin piece group level and detect, establish SP
l, SP
L+1Be two adjacent figure slice, thin piece groups, and SP
L+1
Be P type figure slice, thin piece group, detect SP
l, SP
L+1Reference frame R in the figure slice, thin piece group
m, R
M+1Between the content phase
Like degree,, then continue to detect the reference of next figure slice, thin piece group if satisfy the similitude requirement of setting
Frame R
M+2With R
M+1Between the content similarity, otherwise the explanation R
m, R
M+1Between may have the switching of camera lens,
When finding SP
L+1Be I type figure slice, thin piece group, SP
lThen be last figure slice, thin piece group of a GOP,
Carry out steps d;
D, carry out the frame level and detect, if this B frame sequence belongs to last figure slice, thin piece group of a GOP,
Turn back to step b after then analyzing, otherwise turn back to step c;
E, write down the position that all camera lens switches, finish.
8, a kind of high speed shearing lens border search method as claimed in claim 7 is characterized in that: described GOP level detects and is: to two I frame I at a distance of a GOP length
k, I
K+1Between the detection of content similarity degree.
9, a kind of high speed shearing lens border search method as claimed in claim 7 is characterized in that: described figure slice, thin piece group level detects and is: to being in two I frame I
k, I
K+1Between the detection undertaken by the resolution of figure slice, thin piece group of frame.
10, a kind of high speed shearing lens border search method as claimed in claim 7 is characterized in that: described frame level detects and is: to all the B frame sequence B between two reference frames
1B
2... B
nAnalyze, determine the generation and the accurate position thereof of shearing lens.
11, a kind of high speed shearing lens border search method as claimed in claim 10 is characterized in that: the frame level detects according to the following step:
Correlation function Relevance between a, reference frame of definition (df, db):
Wherein df, db are the frame number of two adjacent reference frames, and NFwdBack (d) and NFwdBackSkip (d) are respectively the function that calculates bi-directional predicted macroblock number and two-way skip macroblock number among the frame d;
The broadcast frame number that Ri, Rj are corresponding respectively is f, b;
B, if: Relevance (f, b) 〉=K
2SumofMacroBlocks, wherein K
2, K
2 ∈(0,1) is the threshold parameter of system,
Then: R
i, R
jBetween do not have the switching of camera lens;
C otherwise, for B
k(k=1,2 ... n), if:
NBackSkip(d)+NBackward(d)＞K
3·(NFwdSkip(d)+NForward(d))
And: Relevance (f, b)≤K
4SumofMacroBlocks
Then at frame B
k(k=1,2 ... n) and the switching of camera lens taken place between its former frame;
Wherein: K
4, K
4 ∈(0,1) is the threshold parameter of system, NBackSkip (d), and NBackward (d) NFwdSkip (d) and NForward (d) are respectively: back among the frame d to the skip macroblock number, backward prediction macroblock number, forward direction skip macroblock number and forward prediction macroblock number; K wherein
3, (K
3＞1) is the threshold parameter of system;
D, for B
n, if: Relevance (f, b)≤K
4SumofMacroBlocks and: K
3(NBackSkip (d)+NBackward (d))＜NFwdSkip (d)+NForward (d) then judges at B
nWith a frame R thereafter
jBetween the switching of camera lens has taken place.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 00129698 CN1131637C (en) | 2000-10-13 | 2000-10-13 | Method of generating data stream index file and using said file accessing frame and shearing lens |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 00129698 CN1131637C (en) | 2000-10-13 | 2000-10-13 | Method of generating data stream index file and using said file accessing frame and shearing lens |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1349351A true CN1349351A (en) | 2002-05-15 |
| CN1131637C CN1131637C (en) | 2003-12-17 |
Family
ID=4593679
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 00129698 Expired - Fee Related CN1131637C (en) | 2000-10-13 | 2000-10-13 | Method of generating data stream index file and using said file accessing frame and shearing lens |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1131637C (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005038643A1 (en) * | 2003-10-16 | 2005-04-28 | Central Research Academy Of Sva Group | A forming method of data stream which can be random accessed and corresponding decoding method |
| CN1306819C (en) * | 2004-07-30 | 2007-03-21 | 联合信源数字音视频技术（北京）有限公司 | Video frequency decoding control method and device |
| CN101149956B (en) * | 2006-09-19 | 2010-05-26 | 智辉研发股份有限公司 | Method for indexing a sports video program carried by a video stream |
| CN101163238B (en) * | 2007-07-20 | 2010-12-01 | 中兴通讯股份有限公司 | Stream media service method of implementing smoothly real-time relay broadcasting/living broadcast |
| CN1926867B (en) * | 2003-12-04 | 2010-12-22 | Etiip控股有限公司 | System and method providing enhanced features for streaming video-on-demand |
| CN101577829B (en) * | 2003-01-17 | 2011-04-13 | 松下电器产业株式会社 | Image encoding method |
| CN101729898B (en) * | 2009-11-16 | 2011-06-15 | 中国人民解放军国防科学技术大学 | Video coding and decoding methods and devices |
| CN102177712A (en) * | 2008-10-09 | 2011-09-07 | 日本电气株式会社 | Terminal, image display method, and program |
| CN102231803A (en) * | 2011-03-14 | 2011-11-02 | 新奥特（北京）视频技术有限公司 | Fault tolerant method for supporting TS streaming media file |
| CN101232611B (en) * | 2007-01-23 | 2011-11-09 | 三星电子株式会社 | Image process apparatus and method thereof |
| CN102667864A (en) * | 2009-10-26 | 2012-09-12 | 索尼计算机娱乐公司 | Image file generation device, image processing device, image file generation method, image processing method, and data structure for image files |
| CN102682016A (en) * | 2011-03-15 | 2012-09-19 | 新奥特（北京）视频技术有限公司 | Indexing system and method supporting MOV (Movie Digital Video Technology)/3GP (3G Player)/MP4 (Mobile Pentium 4) files |
| CN102821100A (en) * | 2012-07-25 | 2012-12-12 | 河南省信息中心 | Method for realizing streaming file system based on security gateway of network application layer |
| CN103081470A (en) * | 2010-09-02 | 2013-05-01 | Lg电子株式会社 | Method for encoding and decoding video, and apparatus using same |
| CN111327896A (en) * | 2018-12-13 | 2020-06-23 | 浙江宇视科技有限公司 | Video transmission method and device, electronic equipment and readable storage medium |
| CN115396729A (en) * | 2022-08-26 | 2022-11-25 | 百果园技术(新加坡)有限公司 | Video target frame determining method, device, equipment and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101820540B (en) * | 2009-12-25 | 2011-09-14 | 北京惠信博思技术有限公司 | MPEG-2 code multiplexing method |
-
2000
- 2000-10-13 CN CN 00129698 patent/CN1131637C/en not_active Expired - Fee Related
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101577829B (en) * | 2003-01-17 | 2011-04-13 | 松下电器产业株式会社 | Image encoding method |
| WO2005038643A1 (en) * | 2003-10-16 | 2005-04-28 | Central Research Academy Of Sva Group | A forming method of data stream which can be random accessed and corresponding decoding method |
| CN1926867B (en) * | 2003-12-04 | 2010-12-22 | Etiip控股有限公司 | System and method providing enhanced features for streaming video-on-demand |
| CN1306819C (en) * | 2004-07-30 | 2007-03-21 | 联合信源数字音视频技术（北京）有限公司 | Video frequency decoding control method and device |
| CN101149956B (en) * | 2006-09-19 | 2010-05-26 | 智辉研发股份有限公司 | Method for indexing a sports video program carried by a video stream |
| US8233048B2 (en) | 2006-09-19 | 2012-07-31 | Mavs Lab. Inc. | Method for indexing a sports video program carried by a video stream |
| CN101232611B (en) * | 2007-01-23 | 2011-11-09 | 三星电子株式会社 | Image process apparatus and method thereof |
| CN101163238B (en) * | 2007-07-20 | 2010-12-01 | 中兴通讯股份有限公司 | Stream media service method of implementing smoothly real-time relay broadcasting/living broadcast |
| CN102177712A (en) * | 2008-10-09 | 2011-09-07 | 日本电气株式会社 | Terminal, image display method, and program |
| CN102667864B (en) * | 2009-10-26 | 2015-06-03 | 索尼计算机娱乐公司 | Image file generation device, image processing device, image file generation method, image processing method |
| CN102667864A (en) * | 2009-10-26 | 2012-09-12 | 索尼计算机娱乐公司 | Image file generation device, image processing device, image file generation method, image processing method, and data structure for image files |
| US8724914B2 (en) | 2009-10-26 | 2014-05-13 | Sony Corporation | Image file generation device, image processing device, image file generation method, image processing method, and data structure for image files |
| CN101729898B (en) * | 2009-11-16 | 2011-06-15 | 中国人民解放军国防科学技术大学 | Video coding and decoding methods and devices |
| CN103081470A (en) * | 2010-09-02 | 2013-05-01 | Lg电子株式会社 | Method for encoding and decoding video, and apparatus using same |
| US9560374B2 (en) | 2010-09-02 | 2017-01-31 | Lg Electronics Inc. | Method for encoding and decoding video, and apparatus using same |
| US11653021B2 (en) | 2010-09-02 | 2023-05-16 | Lg Electronics Inc. | Method for encoding and decoding video, and apparatus using same |
| US11245918B2 (en) | 2010-09-02 | 2022-02-08 | Lg Electronics Inc. | Method for encoding and decoding video, and apparatus using same |
| US10666969B2 (en) | 2010-09-02 | 2020-05-26 | Lg Electronics Inc. | Method for encoding and decoding video, and apparatus using same |
| US10097854B2 (en) | 2010-09-02 | 2018-10-09 | Lg Electronics Inc. | Method for encoding and decoding video, and apparatus using same |
| US9165379B2 (en) | 2010-09-02 | 2015-10-20 | Lg Electronics Inc. | Method for encoding and decoding video, and apparatus using same |
| CN103081470B (en) * | 2010-09-02 | 2016-08-03 | Lg电子株式会社 | The method of coding and decoding video and the device using the method |
| CN102231803A (en) * | 2011-03-14 | 2011-11-02 | 新奥特（北京）视频技术有限公司 | Fault tolerant method for supporting TS streaming media file |
| CN102231803B (en) * | 2011-03-14 | 2013-07-03 | 新奥特（北京）视频技术有限公司 | Fault tolerant method for supporting TS streaming media file |
| CN102682016B (en) * | 2011-03-15 | 2018-10-02 | 新奥特（北京）视频技术有限公司 | A kind of directory system and method for supporting MOV/3GP/MP4 files |
| CN102682016A (en) * | 2011-03-15 | 2012-09-19 | 新奥特（北京）视频技术有限公司 | Indexing system and method supporting MOV (Movie Digital Video Technology)/3GP (3G Player)/MP4 (Mobile Pentium 4) files |
| CN102821100A (en) * | 2012-07-25 | 2012-12-12 | 河南省信息中心 | Method for realizing streaming file system based on security gateway of network application layer |
| CN102821100B (en) * | 2012-07-25 | 2014-10-29 | 河南省信息中心 | Method for realizing streaming file system based on security gateway of network application layer |
| CN111327896A (en) * | 2018-12-13 | 2020-06-23 | 浙江宇视科技有限公司 | Video transmission method and device, electronic equipment and readable storage medium |
| CN111327896B (en) * | 2018-12-13 | 2022-08-23 | 浙江宇视科技有限公司 | Video transmission method and device, electronic equipment and readable storage medium |
| CN115396729A (en) * | 2022-08-26 | 2022-11-25 | 百果园技术(新加坡)有限公司 | Video target frame determining method, device, equipment and storage medium |
| CN115396729B (en) * | 2022-08-26 | 2023-12-08 | 百果园技术(新加坡)有限公司 | Video target frame determining method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1131637C (en) | 2003-12-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1131637C (en) | Method of generating data stream index file and using said file accessing frame and shearing lens | |
| CN1311388C (en) | Method and apparatus for representing a group of images | |
| CN101064846A (en) | Time-shifted television video matching method combining program content metadata and content analysis | |
| CN1520561A (en) | Streaming video bookmarks | |
| US9167260B2 (en) | Apparatus and method for video processing | |
| CN1220065A (en) | System and method for creating trick play video streams from compressed normal play video bitstream | |
| CN101060624A (en) | Video data processing method and storage equipment | |
| CN102486800A (en) | Video searching method, system and method for establishing video database | |
| WO1999041684A1 (en) | Processing and delivery of audio-video information | |
| CN1166202C (en) | Dynamic extraction of feature from compressed digital video signals by video reproducing system | |
| CN101053258A (en) | Method and device for processing coded video data | |
| JP2001526859A (en) | Instruction and editing method of compressed image on world wide web and architecture | |
| CN1956547A (en) | Motion vector estimating device and motion vector estimating method | |
| CN1825978A (en) | Frame compression using cardinal approximation or differential code and escape code | |
| CN1941906A (en) | System for displaying to summarize a moving picture and mobile phone used it | |
| CN1251492C (en) | Frame compression using radix approximation or differential code and escape code | |
| CN1443003A (en) | Method for coding motion image data and its device | |
| KR20090014754A (en) | System and method for managing and detecting duplicate moving picture files based on video contents | |
| CN1643608A (en) | Editing of encoded A/V sequences | |
| Kobla et al. | Indexing and retrieval of MPEG compressed video | |
| CN1419380A (en) | Digital video recorder and video recording method | |
| CN103902569A (en) | Video matching method based on Bag of Words | |
| CN116112690A (en) | Image encoding method, apparatus, and computer-readable storage medium | |
| CN1708993A (en) | Cyclic resynchronization marker for error tolerate video coding | |
| WO2023033300A1 (en) | Encoding and decoding video data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: UNITED XINYUAN DIGITAL AUDIO-VIDEO TECHNOLOGY (BE Free format text: FORMER OWNER: BEIJING SUANTONG DIGITAL TECHNOLOGY RESEARCH CENTER CO., LTD. Effective date: 20080104 Owner name: YOU BANG HU TONG MULTI-MEDIA COMMUNICATIONS SECTI Free format text: FORMER OWNER: UNITED XINYUAN DIGITAL AUDIO-VIDEO TECHNOLOGY (BEIJING) CO., LTD. Effective date: 20080104 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20080104 Address after: Beijing city Haidian District East Road No. 1 Yingchuang power building block A Room 601 zip code: 100080 Patentee after: The union interactive multimedia communication technology (Beijing) Co.,Ltd. Address before: Beijing city Haidian District East Road No. 1 Yingchuang power building block A room 701 zip code: 100080 Patentee before: UNITED XINYUAN DIGITAL AUDIO V Effective date of registration: 20080104 Address after: Beijing city Haidian District East Road No. 1 Yingchuang power building block A room 701 zip code: 100080 Patentee after: UNITED XINYUAN DIGITAL AUDIO V Address before: No. 8 South Road, Zhongguancun Academy of Sciences, Beijing, China: 100080 Patentee before: SUANTONG DIGITAL TECHNOLOGY RE |
|
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20031217 Termination date: 20101013 |