CN117176985A - Device and method for transmitting video metadata based on matrix codes - Google Patents
Device and method for transmitting video metadata based on matrix codes Download PDFInfo
- Publication number
- CN117176985A CN117176985A CN202311130660.7A CN202311130660A CN117176985A CN 117176985 A CN117176985 A CN 117176985A CN 202311130660 A CN202311130660 A CN 202311130660A CN 117176985 A CN117176985 A CN 117176985A
- Authority
- CN
- China
- Prior art keywords
- video
- image
- metadata
- matrix code
- video metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011159 matrix material Substances 0.000 title claims abstract description 161
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000005540 biological transmission Effects 0.000 claims abstract description 31
- 230000006835 compression Effects 0.000 claims description 11
- 238000007906 compression Methods 0.000 claims description 11
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- -1 structures Substances 0.000 description 1
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a device and a method for transmitting video metadata based on matrix codes, which relate to the technical field of information transmission, wherein the device comprises: a video metadata transmitting device and a video metadata receiving device; the video metadata transmitting device comprises a first input interface, a matrix code encoding unit, an image splicing unit and a first output interface, and the video metadata receiving device comprises a second input interface, an image splitting unit, a matrix code decoding unit and a second output interface. The first video metadata is spliced with the first moving video image after being encoded, and a first expansion video image is generated; the first expansion video image is subjected to coding and decoding processing to obtain a second expansion video image with the same size, and the second expansion video image result is split and decoded to obtain second video metadata and a second moving video image; the complete transmission of video metadata is achieved.
Description
Technical Field
The invention relates to the technical field of information transmission, in particular to a device and a method for transmitting video metadata based on matrix codes.
Background
"Meta" in Metadata (Metadata) refers to an object or an object, and "data" refers to data related to the object. For example, the metadata of the photo can be the image size, shooting time or aperture and shutter information of the photo, GPS data; such as metadata of the video stream, which may be picture size, coding parameters of video and audio, frame rate, color bit depth, duration, etc., which is applicable to the complete video stream, as well as to the timeline segments generated by the video stream, since they do not change due to the cuts; there are also more specific metadata that may change over time in the same video clip, such as metadata that describes the scene, from close-up to medium scene, possibly due to camera movement. Metadata associated with the video stream must be transmitted or stored in synchronization with the video stream to ensure the integrity of the video information so that the video can be played back and displayed without errors.
In the prior art, HDMI, SDI, MIPI is often used to transmit metadata in the image blanking area, as shown in fig. 1, in the HDMI interface, there are data islands (Data Island Period) in both the line blanking (horizontal blanking) and the frame blanking (vertical blanking), and metadata can be transmitted along with Active Video (Active Video) through the data islands; HDMI is an abbreviation for high definition multimedia interface (High Definition Multimedia Interface). A similar mechanism exists in the SDI interface, and metadata can be packed into an auxiliary packet (ancillarypacket) for transmission with Active Video (Active Video) during the blanking period; SDI is an abbreviation for serial digital interface (Serial Digital Interface). As shown in fig. 2, when transmitting video using the MIPI interface, metadata may be transmitted using the IIC interface; MIPI is an abbreviation for Mobile industry processor interface (Mobile Industry Processor Interface); IIC is an acronym for Inter-Integrated Circuit, which is a serial communication bus.
HDMI, SDI, MIPI is not adaptable to all application scenarios, and in some scenarios video images may be transmitted using a wireless channel, and in other scenarios video images may be transmitted over the internet, the following is often encountered: before entering the transmission channel, the encoder performs lossy compression processing on the moving video image; after passing through the transmission channel, the decoder decompresses and restores the moving video image; in addition, the encoder only compresses and encodes the moving video image, and the information of the image blanking period is discarded; whether the original active video image is from HDMI, SDI, or MIPI, the associated metadata is lost after the "encode-transmit-decode" process, as shown in fig. 3.
Therefore, there is a need for a method or apparatus for transmitting video metadata in its entirety, which ensures the integrity of the information during the transmission of the video metadata.
Disclosure of Invention
The invention aims to provide a device and a method for transmitting video metadata based on matrix codes, which realize synchronous transmission and storage of video metadata and video code streams in the video image transmission process and ensure the integrity of video information.
In order to achieve the above object, the present invention provides the following solutions:
a video metadata transmission apparatus comprising: the device comprises a first input interface, a matrix code encoding unit, an image splicing unit and a first output interface;
the first input interface is used for inputting first video metadata and first moving video images;
the matrix code encoding unit is used for obtaining first video metadata from the first input interface and encoding to generate a first matrix code image;
the image stitching unit is used for obtaining the first matrix code image from the matrix code image encoding unit, obtaining a first moving video image from the first input interface, stitching the first moving video image and the first matrix code image together, and generating a first expansion video image.
A video metadata transmission method applied to the video metadata transmission device, comprising the following steps:
step one, obtaining a first moving video image and first video metadata through a first input interface;
step two, the first video metadata is encoded by the matrix code encoding unit to generate a first matrix code image;
and thirdly, splicing the first matrix code image and the first moving video image into a first expansion video image through the image splicing unit.
Further, the step S2 of encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image includes:
the first video metadata are encoded into standard two-dimensional code symbols, or packed into data packets conforming to a set standard protocol, or packed into data packets of a custom protocol, and then encoded into the first matrix code image;
the method specifically comprises the following steps:
taking a matrix formed by brightness values of n x n pixels as a code element, and corresponding to 1-bit binary video metadata, wherein n is a natural number;
when the value of 1 bit metadata in the first video metadata is binary 1, corresponding code elements in the first matrix code image are coded into white; when the value of 1-bit metadata in the first video metadata is binary 0, a corresponding symbol in the first matrix code image is encoded to black.
Further, the step S2 of encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image further includes: taking a brightness value of 1 pixel as a code element, and corresponding to m bits of video metadata, wherein m is a natural number and is smaller than the color bit depth of a video image;
and taking continuous m-bit data in the first video metadata as the highest m-bit of the corresponding symbol brightness value in the first matrix code image, and encoding the rest low-bit data of the symbol brightness value into all 0.
The invention also provides video metadata receiving equipment matched with the video metadata sending equipment, wherein the video metadata receiving equipment comprises a second input interface, an image splitting unit, a matrix code decoding unit and a second output interface;
the second input interface is used for receiving a second extended video image, the second extended video image is obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the second extended video image and the first extended video image have the same size;
the image splitting unit is used for obtaining a second extended video image through the second input interface and splitting the second extended video image into a second matrix code image and a second moving video image;
the matrix code decoding unit is used for obtaining the second matrix code image from the image splitting unit and decoding to generate second video metadata;
the second output interface is used for acquiring the second video metadata from the matrix code decoding unit and acquiring the second active video image from the image splitting unit.
The invention also provides a video metadata receiving method which is applied to the video metadata receiving equipment and comprises the following steps:
step one, obtaining a second extended video image through a second input interface; the second extended video image is the result obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the two extended video images have the same size;
splitting the second extended video image into a second moving video image and a second matrix code image by an image splitting unit; the second moving video image has the same size as the first moving video image; the second matrix code image is the same as the first matrix code image in size;
step three, decoding the second matrix code image by the matrix code decoding unit to generate second video metadata;
and step four, the second video metadata and the second moving video image are sent to a second output interface.
Further, the step three, decoding the second matrix code image by the matrix code decoding unit, generates second video metadata, including:
decoding the second matrix code image to obtain a binary code stream, and decoding to obtain second video metadata by using the two-dimensional code symbol or protocol which is the same as that used in encoding;
the method specifically comprises the following steps:
calculating the average Y of the brightness of n x n pixels in each code element in the second matrix code image avg Or the luminance value Y of the center pixel of each symbol center ；
When said Y avg Or Y center When the value of the corresponding 1-bit metadata in the second video metadata is larger than or equal to a preset threshold value, decoding the value into binary 1;
when said Y avg Or Y center And when the value of the corresponding 1-bit metadata in the second video metadata is smaller than a preset threshold value, decoding the value into binary 0.
Further, the third step of decoding the second matrix code image by the matrix code decoding unit to generate second video metadata further includes: the high m bits of each pixel luminance in the second matrix code image are decoded into consecutive m bits of data in the second video metadata, ignoring the remaining low bit data of symbol luminance values.
The invention also provides a device for transmitting video metadata based on the matrix code, which comprises the video metadata transmitting device and the video metadata receiving device, wherein a first output interface of the video metadata transmitting device is in communication connection with a video encoder, the video encoder is in communication connection with a video decoder through a transmission channel, and a second input interface of the video metadata receiving device is in communication connection with the video decoder.
The invention also provides a method for transmitting video metadata based on the matrix code, which is applied to the device for transmitting video metadata based on the matrix code and comprises the following steps:
s1, obtaining a first moving video image and first video metadata through a first input interface;
s2, encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image;
s3, splicing the first matrix code image and the first moving video image into a first expansion video image through the image splicing unit;
s4, the first extended video image is sent to a video encoder through a first output interface;
s5, obtaining a second extended video image from the video decoder through a second input interface; the second extended video image is the result obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the two extended video images have the same size;
s6, splitting the second extended video image into a second moving video image and a second matrix code image through the image splitting unit; the second moving video image has the same size as the first moving video image; the second matrix code image is the same as the first matrix code image in size;
s7, decoding the second matrix code image through the matrix code decoding unit to generate second video metadata;
and S8, the second video metadata and the second moving video image are sent to a second output interface.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects: the device and the method for transmitting the video metadata based on the matrix code, provided by the invention, have the advantages that the first moving video image and the first video metadata are obtained, the first video metadata are encoded to generate a first matrix code image, the first matrix code image and the first moving video image are spliced into a first extended video image, the first extended video image is transmitted to a video encoder through a first output interface, and the lossless transmission of video metadata video is completed; the first extended video image is decompressed by a video encoder lossy compression-channel transmission-video decoder to obtain a second extended video image, the second extended video image is split into a second active video image and a second matrix code image, the second matrix code image is decoded to generate second video metadata, and the second video metadata and the second active video image are sent to a second output interface to realize lossless reception of video metadata video. The invention can reliably transmit the video metadata, does not need an encoder and a decoder in a network environment to specially process the video metadata, and can adapt to the network environment to lossy compress the video image; in the video image transmission process, the video metadata and the video code stream are synchronously transmitted and stored, and the integrity of video information is ensured.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the drawings that are needed in the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of an HDMI interface in the prior art;
fig. 2 is a schematic diagram of video transmission using MIPI interface in the prior art;
FIG. 3 is a schematic diagram of a prior art "encode-transmit-decode" process;
FIG. 4 is a schematic diagram of an extended video image according to an embodiment of the present invention, wherein a represents 1920 pixels; b represents 1080 pixels; c represents 24 pixels;
FIG. 5 is a flow chart of a method for transmitting video metadata based on matrix codes according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an apparatus for transmitting video metadata based on matrix codes according to an embodiment of the present invention;
reference numerals illustrate: 1. a transmitting end; 2. a receiving end; 3. the differential line transmits video data; 4. the IIC interface transmits metadata; 5. a video encoder (performing compression processing on a moving video image); 6. a video decoder (decompressing to obtain moving video images); 7. an input interface (moving video image+metadata); 8. an output interface (only active video image, no metadata); 9. a transmission channel; 10. expanding the video image; 11. matrix code image (640 x 8 symbols, n=3); 12. moving video images (1920×1080 pixels); 13. a first input interface; 14. a matrix code encoding unit; 15. an image stitching unit; 16. a first output interface; 17. video encoder (lossy compression); 18. a transmission channel; 19. a video decoder; 20. a second input interface; 21. an image splitting unit; 22. a matrix code decoding unit; 23. a second output interface; 24. a network environment; 25. video metadata transmitting means; 26. video metadata receiving device.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention aims to provide a device and a method for transmitting video metadata based on matrix codes, which realize synchronous transmission and storage of video metadata and video code streams in the video image transmission process and ensure the integrity of video information.
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
Example 1
As shown in fig. 6, the present invention provides a video metadata transmission apparatus comprising: a first input interface 13, a matrix code encoding unit 14, an image stitching unit 15, and a first output interface 16;
the first input interface 13 is used for inputting first video metadata and first moving video images;
the matrix code encoding unit 14 is configured to obtain first video metadata from the first input interface, and encode to generate a first matrix code image;
the image stitching unit 15 is configured to obtain the first matrix code image from the matrix code image encoding unit 14, obtain a first moving video image from the first input interface 13, and stitch the first moving video image and the first matrix code image together to generate a first extended video image.
The embodiment also provides a video metadata sending method, which is applied to the video metadata sending device and comprises the following steps:
step one, obtaining a first moving video image and first video metadata through a first input interface 13;
step two, the matrix code encoding unit 14 encodes the first video metadata to generate a first matrix code image;
and step three, splicing the first matrix code image and the first moving video image into a first extended video image through the image splicing unit 15.
In this embodiment, the step S2 of encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image includes:
the first video metadata are encoded into standard two-dimensional code symbols, or packed into data packets conforming to a set standard protocol, or packed into data packets of a custom protocol, and then encoded into the first matrix code image.
In this embodiment, the step S2 of encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image specifically includes:
taking a matrix formed by brightness values of n x n pixels as a code element, and corresponding to 1-bit binary video metadata, wherein n is a natural number;
when the value of 1 bit metadata in the first video metadata is binary 1, corresponding code elements in the first matrix code image are coded into white; when the value of 1-bit metadata in the first video metadata is binary 0, a corresponding symbol in the first matrix code image is encoded to black.
In this embodiment, the S2, encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image, further includes: taking a brightness value of 1 pixel as a code element, and corresponding to m bits of video metadata, wherein m is a natural number and is smaller than the color bit depth of a video image;
and taking continuous m-bit data in the first video metadata as the highest m-bit of the corresponding symbol brightness value in the first matrix code image, and encoding the rest low-bit data of the symbol brightness value into all 0.
Example 2
As shown in fig. 6, the present invention provides a video metadata receiving apparatus, which is matched with the video metadata transmitting apparatus, and includes: a second input interface 20, an image splitting unit 21, a matrix code decoding unit 22, a second output interface 23;
the second input interface 20 is configured to receive a second extended video image, where the second extended video image is obtained by decompressing the first extended video image by a video encoder lossy compression-channel transmission-video decoder, and the second extended video image has the same size;
the image splitting unit 21 is configured to obtain a second extended video image through the second input interface 20, and split the second extended video image into a second matrix code image and a second moving video image;
the matrix code decoding unit is configured to obtain the second matrix code image from the image splitting unit 21, and decode to generate second video metadata;
the second output interface 22 is configured to obtain the second video metadata from the matrix code decoding unit 22 and obtain the second moving video image from the image splitting unit.
The embodiment also provides a video metadata receiving method, which is applied to the video metadata receiving device and comprises the following steps:
step one, obtaining a second extended video image through a second input interface; the second extended video image is the result obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the two extended video images have the same size;
splitting the second extended video image into a second moving video image and a second matrix code image by an image splitting unit; the second moving video image has the same size as the first moving video image; the second matrix code image is the same as the first matrix code image in size;
step three, decoding the second matrix code image by the matrix code decoding unit to generate second video metadata;
and step four, the second video metadata and the second moving video image are sent to a second output interface.
In this embodiment, the second matrix code image is decoded to obtain a binary code stream, and the second video metadata is obtained by decoding the binary code stream using the same two-dimensional code symbol or protocol as that used in encoding.
In this embodiment, the third step of decoding, by the matrix code decoding unit, the second matrix code image to generate second video metadata specifically includes: calculating the average Y of the brightness of n x n pixels in each code element in the second matrix code image avg Or the luminance value Y of the center pixel of each symbol center ；
When said Y avg Or Y center When the value of the corresponding 1-bit metadata in the second video metadata is larger than or equal to a preset threshold value, decoding the value into binary 1;
when said Y avg Or Y center And when the value of the corresponding 1-bit metadata in the second video metadata is smaller than a preset threshold value, decoding the value into binary 0.
In this embodiment, the third step of decoding, by the matrix code decoding unit, the second matrix code image to generate second video metadata further includes: the high m bits of each pixel luminance in the second matrix code image are decoded into consecutive m bits of data in the second video metadata, ignoring the remaining low bit data of symbol luminance values.
Example 3
As shown in fig. 6, the present invention provides an apparatus for transmitting video metadata based on matrix codes, comprising a video metadata transmitting apparatus 25 described in embodiment 1 and a video metadata receiving apparatus 26 described in embodiment 2.
The first output interface of the video metadata transmission device 25 is communicatively connected to a video encoder 17, the video encoder 17 is communicatively connected to a video decoder 19 via a transmission channel 18, and the second input interface of the video metadata reception device 26 is communicatively connected to the video decoder.
The first output interface 16 is configured to output the first extended video image, send the first extended video image to the video encoder 17, and connect the video encoder 17 and the video decoder 19 in a communication manner through the transmission channel 18, where the first extended video image is encoded and decoded by the video encoder 17 and the video decoder 19 to obtain a second extended video image, and the second extended video image has the same size as the first extended video image.
As shown in fig. 5, the embodiment of the invention further provides a method for transmitting video metadata based on matrix codes, which is applied to the device for transmitting video metadata based on matrix codes, and comprises the following steps:
s1, obtaining a first moving video image and first video metadata through a first input interface;
s2, encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image;
s3, splicing the first matrix code image and the first moving video image into a first expansion video image through the image splicing unit;
s4, the first extended video image is sent to a video encoder through a first output interface;
s5, obtaining a second extended video image from the video decoder through a second input interface; the second extended video image is the result obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the two extended video images have the same size;
s6, splitting the second extended video image into a second moving video image and a second matrix code image through the image splitting unit; the second moving video image has the same size as the first moving video image; the second matrix code image is the same as the first matrix code image in size;
s7, decoding the second matrix code image through the matrix code decoding unit to generate second video metadata;
and S8, the second video metadata and the second moving video image are sent to a second output interface.
In a further embodiment, as shown in fig. 4, the first moving video image and the second moving video image have a size of 1920×1080 pixels; the first matrix code image and the second matrix code image are 1920 x 24 pixels in size; the sizes of the first extended video image and the second extended video image are 1920 x 1104 pixels; n=3, 3×3 pixels as one symbol; each frame of the extended video image may carry 640 x 8 symbols for transmitting 640 x 8 bits of video metadata.
In summary, the method and the device for transmitting video metadata based on matrix codes can reliably transmit video metadata, do not need to specially process the metadata by an encoder and a decoder in a network environment, and can adapt to the network environment to lossy compress video images; in the video image transmission process, the video metadata and the video code stream are synchronously transmitted and stored, and the integrity of video information is ensured.
In the other technical features of the embodiment, those skilled in the art can flexibly select to meet different specific actual requirements according to actual conditions. However, it will be apparent to one of ordinary skill in the art that: no such specific details are necessary to practice the invention. In other instances, well-known compositions, structures, or components have not been described in detail so as not to obscure the invention, and are within the scope of the invention as defined by the appended claims.
Modifications and variations which do not depart from the spirit and scope of the invention are intended to be within the scope of the invention as defined by the appended claims. In the above description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that: no such specific details are necessary to practice the invention. In other instances, well-known techniques, such as specific construction details, operating conditions, and other technical conditions, have not been described in detail in order to avoid obscuring the present invention.
The principles and embodiments of the present invention have been described herein with reference to specific examples, the description of which is intended only to assist in understanding the methods of the present invention and the core ideas thereof; also, it is within the scope of the present invention to be modified by those of ordinary skill in the art in light of the present teachings. In view of the foregoing, this description should not be construed as limiting the invention.
Claims (10)
1. A video metadata transmission apparatus, characterized by comprising: the device comprises a first input interface, a matrix code encoding unit, an image splicing unit and a first output interface;
the first input interface is used for inputting first video metadata and first moving video images;
the matrix code encoding unit is used for obtaining first video metadata from the first input interface and encoding to generate a first matrix code image;
the image stitching unit is used for obtaining the first matrix code image from the matrix code image encoding unit, obtaining a first moving video image from the first input interface, stitching the first moving video image and the first matrix code image together, and generating a first expansion video image.
2. A video metadata transmission method applied to the video metadata transmission apparatus of claim 1, characterized by comprising the steps of:
step one, obtaining a first moving video image and first video metadata through a first input interface;
step two, the first video metadata is encoded by the matrix code encoding unit to generate a first matrix code image;
and thirdly, splicing the first matrix code image and the first moving video image into a first expansion video image through the image splicing unit.
3. The video metadata transmission method according to claim 2, wherein S2, encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image, comprises:
the first video metadata are encoded into standard two-dimensional code symbols, or packed into data packets conforming to a set standard protocol, or packed into data packets of a custom protocol, and then encoded into the first matrix code image;
the method specifically comprises the following steps:
taking a matrix formed by brightness values of n x n pixels as a code element, and corresponding to 1-bit binary video metadata, wherein n is a natural number;
when the value of 1 bit metadata in the first video metadata is binary 1, corresponding code elements in the first matrix code image are coded into white; when the value of 1-bit metadata in the first video metadata is binary 0, a corresponding symbol in the first matrix code image is encoded to black.
4. The video metadata transmission method according to claim 2, wherein S2, encoding the first video metadata by the matrix code encoding unit generates a first matrix code image, further comprising: taking a brightness value of 1 pixel as a code element, and corresponding to m bits of video metadata, wherein m is a natural number and is smaller than the color bit depth of a video image;
and taking continuous m-bit data in the first video metadata as the highest m-bit of the corresponding symbol brightness value in the first matrix code image, and encoding the rest low-bit data of the symbol brightness value into all 0.
5. A video metadata receiving device, which is matched with the video metadata transmitting device of claim 1, and is characterized in that the video metadata receiving device comprises a second input interface, an image splitting unit, a matrix code decoding unit and a second output interface;
the second input interface is used for receiving a second extended video image, the second extended video image is obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the second extended video image and the first extended video image have the same size;
the image splitting unit is used for obtaining a second extended video image through the second input interface and splitting the second extended video image into a second matrix code image and a second moving video image;
the matrix code decoding unit is used for obtaining the second matrix code image from the image splitting unit and decoding to generate second video metadata;
the second output interface is used for acquiring the second video metadata from the matrix code decoding unit and acquiring the second active video image from the image splitting unit.
6. A video metadata receiving method applied to the video metadata receiving device of claim 5, characterized by comprising the steps of:
step one, obtaining a second extended video image through a second input interface; the second extended video image is the result obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the two extended video images have the same size;
splitting the second extended video image into a second moving video image and a second matrix code image by an image splitting unit; the second moving video image has the same size as the first moving video image; the second matrix code image is the same as the first matrix code image in size;
step three, decoding the second matrix code image by the matrix code decoding unit to generate second video metadata;
and step four, the second video metadata and the second moving video image are sent to a second output interface.
7. The video metadata reception method according to claim 6, wherein the step three of decoding the second matrix code image by the matrix code decoding unit to generate second video metadata includes:
decoding the second matrix code image to obtain a binary code stream, and decoding to obtain second video metadata by using the two-dimensional code symbol or protocol which is the same as that used in encoding;
the method specifically comprises the following steps:
calculating the average Y of the brightness of n x n pixels in each code element in the second matrix code image avg Or the luminance value Y of the center pixel of each symbol center ；
When said Y avg Or Y center When the value of the corresponding 1-bit metadata in the second video metadata is larger than or equal to a preset threshold value, decoding the value into binary 1;
when said Y avg Or Y center And when the value of the corresponding 1-bit metadata in the second video metadata is smaller than a preset threshold value, decoding the value into binary 0.
8. The video metadata reception method according to claim 6, wherein the step three of decoding the second matrix code image by the matrix code decoding unit generates second video metadata, further comprises: the high m bits of each pixel luminance in the second matrix code image are decoded into consecutive m bits of data in the second video metadata, ignoring the remaining low bit data of symbol luminance values.
9. A device for transmitting video metadata based on matrix codes, comprising the video metadata transmitting device of claim 1 and the video metadata receiving device of claim 5, wherein a first output interface of the video metadata transmitting device is communicatively connected to a video encoder, the video encoder is communicatively connected to a video decoder via a transmission channel, and a second input interface of the video metadata receiving device is communicatively connected to a video decoder.
10. A method for transmitting video metadata based on matrix codes, applied to the device for transmitting video metadata based on matrix codes according to claim 9, comprising the steps of:
s1, obtaining a first moving video image and first video metadata through a first input interface;
s2, encoding the first video metadata by the matrix code encoding unit to generate a first matrix code image;
s3, splicing the first matrix code image and the first moving video image into a first expansion video image through the image splicing unit;
s4, the first extended video image is sent to a video encoder through a first output interface;
s5, obtaining a second extended video image from the video decoder through a second input interface; the second extended video image is the result obtained by the first extended video image through 'lossy compression of a video encoder-channel transmission-decompression of a video decoder', and the two extended video images have the same size;
s6, splitting the second extended video image into a second moving video image and a second matrix code image through the image splitting unit; the second moving video image has the same size as the first moving video image; the second matrix code image is the same as the first matrix code image in size;
s7, decoding the second matrix code image through the matrix code decoding unit to generate second video metadata;
and S8, the second video metadata and the second moving video image are sent to a second output interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311130660.7A CN117176985A (en) | 2023-09-04 | 2023-09-04 | Device and method for transmitting video metadata based on matrix codes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311130660.7A CN117176985A (en) | 2023-09-04 | 2023-09-04 | Device and method for transmitting video metadata based on matrix codes |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117176985A true CN117176985A (en) | 2023-12-05 |
Family
ID=88939001
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311130660.7A Pending CN117176985A (en) | 2023-09-04 | 2023-09-04 | Device and method for transmitting video metadata based on matrix codes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117176985A (en) |
-
2023
- 2023-09-04 CN CN202311130660.7A patent/CN117176985A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3192256B1 (en) | Image processing apparatus and image processing method | |
| JP7340659B2 (en) | Method and apparatus for reconstructing image data from decoded image data | |
| EP1813119B1 (en) | Film grain sei message insertion for bit-accurate simulation in a video system | |
| US20130114687A1 (en) | Fixed intra run-level mode for cavlc in hevc | |
| US11838568B2 (en) | Custom data indicating nominal range of samples of media content | |
| CN113826396B (en) | Method and apparatus for encoding or decoding video data | |
| JP2018191269A (en) | Method and device of reconstructing image data from decoded image data | |
| GB2512658A (en) | Transmitting and receiving a composite image | |
| GB2512825A (en) | Transmitting and receiving a composite image | |
| CN102843566B (en) | Communication method and equipment for three-dimensional (3D) video data | |
| KR100746463B1 (en) | Apparatus and method for video transmission in video conferencing system | |
| CN117176985A (en) | Device and method for transmitting video metadata based on matrix codes | |
| TWI835236B (en) | Image processing method and image processing device | |
| TWI835238B (en) | Image processing method and image processing device | |
| US20040179136A1 (en) | Image transmission system and method thereof | |
| KR101409526B1 (en) | Apparatus and Method for keeping Bit rate of Image Data | |
| CN115086780A (en) | Video stream transmission method, system, device and terminal equipment | |
| CN202957932U (en) | 3D video data communication device and communication system | |
| CN115811620A (en) | Live broadcasting method and system | |
| CN114866779A (en) | Image coding method, image reconstruction method, image coding device, image reconstruction device, electronic equipment and storage medium | |
| CN117676146A (en) | Encoding and decoding method and device | |
| JP2004056234A (en) | Image encoder and image encoding method | |
| JPH10164573A (en) | Image transmission method and image transmitter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |