CN106027886A - Method and system for implementing synchronous frames of panoramic video - Google Patents
Method and system for implementing synchronous frames of panoramic video Download PDFInfo
- Publication number
- CN106027886A CN106027886A CN201610332871.2A CN201610332871A CN106027886A CN 106027886 A CN106027886 A CN 106027886A CN 201610332871 A CN201610332871 A CN 201610332871A CN 106027886 A CN106027886 A CN 106027886A
- Authority
- CN
- China
- Prior art keywords
- panoramic video
- video
- synchronization frame
- frame
- identification code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/684—Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time
- H04N23/6845—Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time by combination of a plurality of images sequentially taken
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a method for implementing synchronous frames of a panoramic video. The method comprises the following steps of: S1, starting to record a video by a plurality of pieces of equipment; S2, simultaneously and repeatedly receiving a synchronous signal by the plurality of pieces of equipment, and drawing an identification code on a currently encoded video frame; and S3, respectively extracting the synchronous frames with the identification code, and synchronously synthesizing the panoramic video. A system for implementing the synchronous frames of the panoramic video is used for executing the method; the system comprises a microprocessor, an image acquisition module, a storage module and a display module; and the image acquisition module, the storage module and the display module are all connected with the microprocessor. One specially processed video frame is identified and used as a timestamp of the panoramic video, so that synchronization of the panoramic video is implemented. The defect that a conventional panoramic video cannot achieve an effect of providing a synchronous timestamp is overcome. By identifying the special video frame, a module does not need to be additionally added, the method and the system are more flexible and convenient to implement, and accurate synchronization can be implemented. The method and system can be widely applied to an image mosaic technology.
Description
Technical field
The present invention relates to image mosaic technology, specially panoramic video realizes the method and system of synchronization frame.
Background technology
I frame: be also called Intra pictures, I frame is typically a kind of video compression technology that each GOP(MPEG is used) first frame, through moderately compressing, as the reference point of random access, image can be treated as.
Gop:Group of Pictures, strategy affects coding quality: so-called gop, the meaning is picture group, and a gop is exactly one group of continuous print picture.
A kind of colour coding method (belonging to PAL) that YUV is used by eurovision system, is the color space of PAL and SECAM simulation color television system employing.In modern color television system, three pipe colour cameras or colored CCD camera is generally used to carry out capture, then the colour picture signal obtained is obtained RGB after color separation, respectively amplification correction, obtain luminance signal Y and two i.e. U of colour difference signal B-Y(through matrixer again), R-Y(i.e. V), brightness and three signals of aberration are encoded by last transmitting terminal respectively, send with same channel.The method for expressing of this color is exactly that so-called YUV color space represents.Use the importance of YUV color space to be its luminance signal Y and carrier chrominance signal U, V are to separate.
Panoramic video that is 720 degree or 360 degree of panoramic videos, it is to develop to extend on the technology of 720 degree or 360 degree panoramas, static panoramic pictures is converted into dynamic video image by it, panoramic video can about shooting angle upper and lower 360 degree arbitrarily watch dynamic video.Existing panoramic video cannot realize providing synchronized timestamp, only to start the video recording starting point as panoramic video, terminates the video recording end point for panoramic video.It is therefore desirable to improve.
Summary of the invention
In order to solve above-mentioned technical problem, it is an object of the invention to provide the method and system of a kind of synchronization frame that can realize panoramic video the most accurately.
The technical solution adopted in the present invention is:
A kind of panoramic video realizes the method for synchronization frame, comprises the following steps: S1, multiple devices start video recording；
S2, described multiple devices repeatedly receive synchronizing signal simultaneously, and draw an identification code in the frame of video of present encoding；
There is described in S3, respectively extraction the synchronization frame of identification code, and synchronized compound panoramic video.
As the improvement of this technical scheme, in described step S2, the frame of video of present encoding is random frame.
As the improvement of this technical scheme, described step S3 includes using nearby principle pairing synchronizing signal.
As the improvement of this technical scheme, described identification code includes chequered with black and white rectangular patterns.
Further, described step S3 includes using YUV color space to detect the distribution of color of identification code.
Further, described step S3 includes:
Described synchronization frame is decoded as YUV image；
Added up respectively the Y-component in each solid block of color identification code region of described chequered with black and white rectangle by the image of yuv format, averages, can obtain the distribution of color of identification code；
Identification and the extraction of synchronization frame is carried out according to gained distribution of color.
On the other hand, the present invention also provides for a kind of panoramic video and realizes the system of synchronization frame, and including memorizer and a processor of storage program, described processor runs described program with the method described in execution.
Another further aspect, the present invention also provides for a kind of panoramic video and realizes the system of synchronization frame, including microprocessor, image capture module, memory module and display module；Described image capture module, memory module and display module are all connected with microprocessor.
The invention has the beneficial effects as follows: the frame of video that the present invention processes especially by identifying a frame is used as the timestamp of panoramic video, it is achieved the synchronization of panoramic video.Overcome conventional panoramic video cannot realize providing synchronized timestamp.The present invention, by identifying that special frame of video provides timestamp for panoramic video, is not required to separately add module, it is achieved get up more flexible, convenient, and can realize precise synchronization.
The present invention, by providing timestamp for synthesis panoramic video, can realize the synchronization of panoramic video, it is achieved thereby that panoramic video can cut randomly according to user and precise synchronization time any.Present invention mainly solves the problem of precise synchronization when panoramic video makes.
Accompanying drawing explanation
Below in conjunction with the accompanying drawings the detailed description of the invention of the present invention is described further:
Fig. 1 is the steps flow chart schematic diagram of one embodiment of the invention；
Fig. 2 is the steps flow chart schematic diagram of second embodiment of the invention；
Fig. 3 is the schematic diagram of third embodiment of the invention；
Fig. 4 is the system schematic of fourth embodiment of the invention.
Detailed description of the invention
It should be noted that in the case of not conflicting, the embodiment in the application and the feature in embodiment can be mutually combined.
A kind of panoramic video realizes the method for synchronization frame, comprises the following steps: S1, multiple devices start video recording；
S2, described multiple devices repeatedly receive synchronizing signal simultaneously, and draw an identification code in the frame of video of present encoding；
There is described in S3, respectively extraction the synchronization frame of identification code, and synchronized compound panoramic video.
As the improvement of this technical scheme, in described step S2, the frame of video of present encoding is random frame.
As the improvement of this technical scheme, described step S3 includes using nearby principle pairing synchronizing signal.
As the improvement of this technical scheme, described identification code includes chequered with black and white rectangular patterns.
Further, described step S3 includes using YUV color space to detect the distribution of color of identification code.
Further, described step S3 includes:
Described synchronization frame is decoded as YUV image；
Added up respectively the Y-component in each solid block of color identification code region of described chequered with black and white rectangle by the image of yuv format, averages, can obtain the distribution of color of identification code；
Identification and the extraction of synchronization frame is carried out according to gained distribution of color.
With reference to Fig. 1, it it is the steps flow chart schematic diagram of one embodiment of the invention.Panoramic video passes through multiple stage camera view, obtains the panorama material of every camera, thus realize the synthesis of panoramic video by the way of synchronization frame.A kind of panoramic video realizes the method for synchronization frame, comprises the following steps:
S1, multiple devices start video recording；
S2, described multiple devices repeatedly receive synchronizing signal simultaneously, and draw an identification code in the frame of video of present encoding；
There is described in S3, respectively extraction the synchronization frame of identification code, and synchronized compound panoramic video.
Further, in described step S2, the frame of video of present encoding is random frame.
As preferred embodiment, synchronization frame is I frame, uses I frame as synchronization frame, then reduces the gop cycle, reduces because the time difference of each camera I frame that causes of gop cycle with this.
Described step S3 includes using nearby principle pairing synchronizing signal.
Specifically, synchronizing signal (or synchronization frame) takes pair principle nearby, and first synchronizing signal is for synchronizing commencing signal, then second synchronizing signal is then for synchronizing end signal, by that analogy.Video between these 2 signals is panorama material.Such as there are 4 synchronizing signals, then 1,2 signal pairing, 3,4 signal pairings；If there being 3 synchronizing signals, then 1,2 pairing, the 3rd synchronizing signal is given up.
With reference to Fig. 2, it it is the steps flow chart schematic diagram of second embodiment of the invention.A kind of panoramic video realizes the method for synchronization frame, and it comprises the following steps:
S11, sets up same control station to multiple stage camera, and by control station as frame synchronization benchmark, control station can send synchronization commencing signal and synchronize end signal；Though two kinds of signal external presentation are different, it is essentially same processing mode, hereafter referred to collectively as synchronizing signal.
S22, after starting video recording, control station sends synchronization request, if camera is the most ready, then send request synchronizing signal as control station, after control station receives the request signal of all cameras, it is simultaneously emitted by synchronizing signal to all cameras, when terminating panorama, is simultaneously emitted by end signal by control station is unified again.
S33, after camera receives synchronizing signal, in the frame of video of present encoding draw specify identification code, the drafting mode of identification code as shown above, for chequered with black and white color lump.
S44, during panoramic video synthesis, extracts H264 synchronization frame and is decoded as YUV image.
S55, the Y-component in each solid block of color identification code region of being added up respectively by the image of yuv format, average, the distribution of color of identification code can be obtained.
S66, first synchronization frame detected is the beginning of first paragraph panoramic video, and the synthesis of panoramic video carrys out sample video data by the way of synchronizing signal is matched, and completes the making of panoramic video.
With reference to Fig. 3, it it is the schematic diagram of third embodiment of the invention.As one embodiment of the invention, wherein the marker method of synchronization frame is: when master control receives synchronizing signal, draws 100*200 pixel black and white intersection Filled Rectangle in the upper left corner area of the frame of video of coding.Chequered with black and white color lump is used to increase the serious forgiveness of image recognition, it is to avoid to answer the erroneous judgement of night, solid block of color and special screne, reduce simultaneously and identify difficulty, realize the identification to synchronization frame by the color and color area analyzing each color lump in rectangle frame.
When panoramic video makes, distribution of color in the 200*100 pixel rectangle frame of detection frame of video upper left corner area, if as above distribution of color being detected, then recording this frame is synchronization frame, determine at this to be panoramic video starting point, continue to retrieve next synchronization frame backward simultaneously, determine the end point of panoramic video with this, thus realize the synchronization of panoramic video.
As geometrically describing coordinate set with coordinate space, color space mathematical way describes color set.3 common basic colour models are RGB, CMYK and YUV.By using YUV color space to detect the distribution of color of identification code, luminance signal Y that it is critical only that it of YUV and carrier chrominance signal U, V are to separate.If only Y-signal component and there is no U, V component, then so represent image be exactly black and white gray level image, owing to identification code is black and white color lump, unrelated with colour information, use Y-signal component can retrieve color region distribution.
YCbCr is then as ITU-R in world's blockette knits video standard development process
A part for BT.601 suggestion, is that YUV is through scaling and the reprint of skew in fact.YCbCr wherein Y refers to that luminance component, Cb refer to chroma blue component, and Cr refers to red chrominance component.Human eye is more sensitive to the Y-component of video, and therefore after by chromatic component carries out sub sampling reducing chromatic component, naked eyes are by the change of imperceptible picture quality.Sample format main for YUV has YCbCr 4:2:0, YCbCr 4:2:2, YCbCr 4:1:1 and YCbCr 4:4:4, as one embodiment of the invention, uses the YUV420 sample format obtained by H264 decoding.
On the other hand, the present invention also provides for a kind of panoramic video and realizes the system of synchronization frame, and including memorizer and a processor of storage program, described processor runs described program with the method described in execution.
Another further aspect, the present invention also provides for a kind of panoramic video and realizes the system of synchronization frame, including microprocessor, image capture module, memory module and display module；Described image capture module, memory module and display module are all connected with microprocessor.
With reference to Fig. 4, it it is the system schematic of fourth embodiment of the invention.A kind of panoramic video realizes the system of synchronization frame, and it is for performing the method that described a kind of panoramic video realizes synchronization frame, and it includes microprocessor, image capture module, memory module and display module；Described image capture module, memory module and display module are all connected with microprocessor.
Concrete, described image capture module is camera module, and described display module is LCD display module.
It is above the preferably enforcement of the present invention is illustrated, but the invention is not limited to described embodiment, those of ordinary skill in the art also can make all equivalent variations or replacement on the premise of spirit of the present invention, and deformation or the replacement of these equivalents are all contained in the application claim limited range.
Claims (8)
1. the method that a panoramic video realizes synchronization frame, it is characterised in that comprise the following steps: S1, multiple devices start video recording；
S2, described multiple devices repeatedly receive synchronizing signal simultaneously, and draw an identification code in the frame of video of present encoding；
There is described in S3, respectively extraction the synchronization frame of identification code, and synchronized compound panoramic video.
Panoramic video the most according to claim 1 realizes the method for synchronization frame, it is characterised in that in described step S2, and the frame of video of present encoding is random frame.
Panoramic video the most according to claim 2 realizes the method for synchronization frame, it is characterised in that described step S3 includes using nearby principle pairing synchronizing signal.
Panoramic video the most according to claim 3 realizes the method for synchronization frame, it is characterised in that: described identification code includes chequered with black and white rectangular patterns.
Panoramic video the most according to claim 4 realizes the method for synchronization frame, it is characterised in that described step S3 includes using YUV color space to detect the distribution of color of identification code.
Panoramic video the most according to claim 5 realizes the method for synchronization frame, it is characterised in that described step S3 includes:
Described synchronization frame is decoded as YUV image；
Added up respectively the Y-component in each solid block of color identification code region of described chequered with black and white rectangle by the image of yuv format, averages, can obtain the distribution of color of identification code；
Identification and the extraction of synchronization frame is carried out according to gained distribution of color.
7. panoramic video realizes a system for synchronization frame, including memorizer and a processor of storage program, it is characterised in that described processor runs described program to perform the method described in any one of claim 1 to 6.
8. a panoramic video realizes the system of synchronization frame, it is characterised in that include microprocessor, image capture module, memory module and display module；Described image capture module, memory module and display module are all connected with microprocessor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610332871.2A CN106027886B (en) | 2016-05-17 | 2016-05-17 | A kind of panoramic video realizes the method and system of synchronization frame |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610332871.2A CN106027886B (en) | 2016-05-17 | 2016-05-17 | A kind of panoramic video realizes the method and system of synchronization frame |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106027886A true CN106027886A (en) | 2016-10-12 |
| CN106027886B CN106027886B (en) | 2019-08-06 |
Family
ID=57098914
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610332871.2A Active CN106027886B (en) | 2016-05-17 | 2016-05-17 | A kind of panoramic video realizes the method and system of synchronization frame |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106027886B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107343191A (en) * | 2017-06-11 | 2017-11-10 | 成都吱吖科技有限公司 | A kind of interactive panoramic video player method and device based on virtual reality |
| CN108234820A (en) * | 2016-12-21 | 2018-06-29 | 上海杰图软件技术有限公司 | The method and system of real-time splicing panorama image based on the processing of single channel picture signal |
| WO2018228352A1 (en) * | 2017-06-12 | 2018-12-20 | 深圳市瑞立视多媒体科技有限公司 | Synchronous exposure method and apparatus and terminal device |
| CN110896464A (en) * | 2019-11-19 | 2020-03-20 | 北京奇艺世纪科技有限公司 | Audio data generation method, device and system and controller |
| CN110933349A (en) * | 2019-11-19 | 2020-03-27 | 北京奇艺世纪科技有限公司 | Audio data generation method, device and system and controller |
| CN111586390A (en) * | 2020-04-23 | 2020-08-25 | 湖南傲英创视信息科技有限公司 | Processing method, system and storage medium for circularly scanning three-dimensional panoramic video |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101035194A (en) * | 2007-04-04 | 2007-09-12 | 武汉立得空间信息技术发展有限公司 | Method for obtaining two or more video synchronization frame |
| CN101146231A (en) * | 2007-07-03 | 2008-03-19 | 浙江大学 | Method for generating panoramic video according to multi-visual angle video stream |
| CN102510494A (en) * | 2011-10-09 | 2012-06-20 | 杭州华三通信技术有限公司 | Method and device for synchronizing I frame |
| CN104184961A (en) * | 2013-05-22 | 2014-12-03 | 辉达公司 | Mobile device and system used for generating panoramic video |
| CN204090039U (en) * | 2014-10-16 | 2015-01-07 | 北京十方慧通科技有限公司 | Integration large scene panoramic video monitoring device |
| CN104301677A (en) * | 2014-10-16 | 2015-01-21 | 北京十方慧通科技有限公司 | Panoramic video monitoring method and device orienting large-scale scenes |
| CN105578199A (en) * | 2016-02-22 | 2016-05-11 | 北京佰才邦技术有限公司 | Virtual reality panorama multimedia processing system and method and client device |
-
2016
- 2016-05-17 CN CN201610332871.2A patent/CN106027886B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101035194A (en) * | 2007-04-04 | 2007-09-12 | 武汉立得空间信息技术发展有限公司 | Method for obtaining two or more video synchronization frame |
| CN101146231A (en) * | 2007-07-03 | 2008-03-19 | 浙江大学 | Method for generating panoramic video according to multi-visual angle video stream |
| CN102510494A (en) * | 2011-10-09 | 2012-06-20 | 杭州华三通信技术有限公司 | Method and device for synchronizing I frame |
| CN104184961A (en) * | 2013-05-22 | 2014-12-03 | 辉达公司 | Mobile device and system used for generating panoramic video |
| CN204090039U (en) * | 2014-10-16 | 2015-01-07 | 北京十方慧通科技有限公司 | Integration large scene panoramic video monitoring device |
| CN104301677A (en) * | 2014-10-16 | 2015-01-21 | 北京十方慧通科技有限公司 | Panoramic video monitoring method and device orienting large-scale scenes |
| CN105578199A (en) * | 2016-02-22 | 2016-05-11 | 北京佰才邦技术有限公司 | Virtual reality panorama multimedia processing system and method and client device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108234820A (en) * | 2016-12-21 | 2018-06-29 | 上海杰图软件技术有限公司 | The method and system of real-time splicing panorama image based on the processing of single channel picture signal |
| CN107343191A (en) * | 2017-06-11 | 2017-11-10 | 成都吱吖科技有限公司 | A kind of interactive panoramic video player method and device based on virtual reality |
| WO2018228352A1 (en) * | 2017-06-12 | 2018-12-20 | 深圳市瑞立视多媒体科技有限公司 | Synchronous exposure method and apparatus and terminal device |
| CN110896464A (en) * | 2019-11-19 | 2020-03-20 | 北京奇艺世纪科技有限公司 | Audio data generation method, device and system and controller |
| CN110933349A (en) * | 2019-11-19 | 2020-03-27 | 北京奇艺世纪科技有限公司 | Audio data generation method, device and system and controller |
| CN111586390A (en) * | 2020-04-23 | 2020-08-25 | 湖南傲英创视信息科技有限公司 | Processing method, system and storage medium for circularly scanning three-dimensional panoramic video |
| CN111586390B (en) * | 2020-04-23 | 2022-06-17 | 湖南傲英创视信息科技有限公司 | Processing method, system and storage medium for circularly scanning three-dimensional panoramic video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106027886B (en) | 2019-08-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106027886B (en) | A kind of panoramic video realizes the method and system of synchronization frame | |
| US11138765B2 (en) | Non-linear color correction | |
| WO2016208939A1 (en) | Method and apparatus for generating and transmitting metadata for virtual reality | |
| CN102665031B (en) | Video signal processing method and picture pick-up device | |
| WO2017008377A1 (en) | Image processing method and terminal | |
| CN103716547A (en) | Smart mode photographing method | |
| KR101985880B1 (en) | Display device and control method thereof | |
| WO2003005299A3 (en) | Image segmentation by means of temporal parallax difference induction | |
| CN104581103A (en) | Image processing method and device | |
| US8130317B2 (en) | Method and system for performing interleaved to planar transformation operations in a mobile terminal having a video display | |
| CN102300104A (en) | 3D television and menu processing method thereof | |
| US7688334B2 (en) | Method and system for video format transformation in a mobile terminal having a video display | |
| US8964109B2 (en) | Image processing device and method | |
| CN101923455A (en) | Method for displaying and analyzing digital image in YUV format | |
| CN107396002A (en) | The processing method and mobile terminal of a kind of video image | |
| TWI387325B (en) | Image capturing device and image pre-processing method thereof | |
| CN106507079A (en) | A kind of color rendition method and device | |
| WO2016086493A1 (en) | Immersive video presentation method for intelligent mobile terminal | |
| CN110930340B (en) | Image processing method and device | |
| CN108205795A (en) | Face image processing process and system during a kind of live streaming | |
| CN101729884B (en) | Image acquiring device and image preprocessing method | |
| CN112738425A (en) | Real-time video splicing system with multiple cameras for acquisition | |
| CN112601080B (en) | Method for judging television monochromatic field signal | |
| EP3826294A1 (en) | Systems and methods for image processing | |
| EP2209298A1 (en) | Method for adjusting white balance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |