CN115665357B - Image data transmission method, system, injection method and electronic equipment - Google Patents
Image data transmission method, system, injection method and electronic equipment Download PDFInfo
- Publication number
- CN115665357B CN115665357B CN202211303579.XA CN202211303579A CN115665357B CN 115665357 B CN115665357 B CN 115665357B CN 202211303579 A CN202211303579 A CN 202211303579A CN 115665357 B CN115665357 B CN 115665357B
- Authority
- CN
- China
- Prior art keywords
- image data
- data
- image
- check code
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Color Television Systems (AREA)
Abstract
The invention discloses an image data transmission method, an image data transmission system, an image data injection method and electronic equipment. The image data transmission method comprises the following steps: firstly, acquiring image data, and dividing the image data into a first part of data, a second part of data and a third part of data, wherein the format of the image data comprises a RAW format; dividing the image data into three parts according to a preset dividing mode to obtain first part data, second part data and third part data, and respectively putting the first part data, the second part data and the third part data into red, green and blue three channels; and finally, based on the three channels, transmitting the image data to an image injection unit through a high-definition multimedia data interface circuit. The invention can divide the image data in the RAW format into three parts, and transmit the data in the HDMI through three RGB channels, so that the RAW format image data can be transmitted through the HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to an image data transmission method, an image data transmission system, an image data injection method, and an electronic device.
Background
In the process of developing algorithms in the unmanned technology, training, verification, testing, etc. of algorithms (for example, neural networks) in the controller are required, which requires injection of various video image data into the controller. In the process of injecting image data, the image processing unit generally transmits the processed image data to the image injecting unit, and then the image injecting unit synchronously reinjects the processed image data to the controller.
At present, image data is mostly transmitted between an image processing unit and an image injection unit through an HDMI (High Definition Multimedia Interface ) line, but the HDMI line generally supports an RGB format, but does not support a RAW format; however, the controller needs to receive the RAW format data sometimes, and the current solution is to convert the RAW format into RGB format and transmit the RAW format through the HDMI line, which complicates the transmission flow and is not beneficial to improving the efficiency of image data transmission.
Disclosure of Invention
In order to overcome the above problems and disadvantages, an object of the present invention is to provide an image data transmission method, system, injection method and electronic device, which can transmit image data in RAW format through a high-definition multimedia interface line, thereby improving the image data transmission efficiency.
To achieve the above object, a first aspect of the present invention provides an image data transmission method, including:
acquiring image data, wherein the format of the image data comprises a RAW format;
dividing image data into three parts according to a preset dividing mode to obtain first part data, second part data and third part data, and respectively putting the first part data, the second part data and the third part data into a red channel, a green channel and a blue channel of a red, green and blue color mode;
the first part of data, the second part of data and the third part of data are transmitted to the image injection unit through the high-definition multimedia data interface circuit based on the red channel, the green channel and the blue channel.
Optionally, the step of dividing the image data into three parts comprises:
acquiring a check code, and inserting the check code into the image data to obtain the image data to be checked;
the image data to be checked is divided into three parts.
Optionally, the binary number of bits of the check code is smaller than the binary number of bits of the image data, and a difference between binary numbers of any two of the first partial data, the second partial data, and the third partial data is smaller than or equal to 1.
Optionally, the binary digits of the check code are five, the binary digits of the image data are twelve, the binary digits of the image data to be checked are seventeen, and the binary digits of the first part of data, the second part of data and the third part of data are six, and the binary digits of the other part of data are five.
Optionally, the check code is located at the 2 nd in the image data to be checked n Bits, where n is an integer greater than or equal to 0.
A second aspect of the present invention provides an image data injection method, including:
acquiring image data, wherein the image data is acquired through the image data transmission method;
restoring the image data into RAW format image data, and determining the image data to be injected based on the RAW format image data;
the image data to be injected is injected into the image receiving unit.
Optionally, before the step of restoring the image data to the RAW format image data, the method further includes:
acquiring a check code in the image data;
judging whether the image data has errors according to the check code;
and if the image data has errors, correcting the image data according to the check code.
Optionally, the step of correcting the image data according to the check code includes:
determining code bits with errors in the image data according to the check code;
and correcting the data corresponding to the code bit with the error.
A third aspect of the present invention provides an image data transmission system comprising:
an image processing unit for executing the above image data transmission method;
and the image injection unit is used for executing the image data injection method.
An electronic device according to a fourth aspect of the present invention includes a processor and a memory, the memory storing a computer program, which when executed by the processor, implements the above-described image data transmission method and/or the above-described image data injection method.
Compared with the prior art, the invention has the beneficial effects that: the image data transmission method comprises the steps of firstly acquiring image data, dividing the image data into first part data, second part data and third part data, wherein the formats of the image data comprise RAW formats; dividing the image data into three parts according to a preset dividing mode to obtain first part data, second part data and third part data, and respectively putting the first part data, the second part data and the third part data into a red channel, a green channel and a blue channel of a red-green-blue color mode; and finally, transmitting the first part of data, the second part of data and the third part of data to an image injection unit through a high-definition multimedia data interface circuit based on the red channel, the green channel and the blue channel. The invention can divide the image data in the RAW format into three parts, and transmit data in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the image data in the RAW format can be transmitted through an HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention. It is evident that the drawings in the following description are only some embodiments of the present invention and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art. In the drawings:
FIG. 1 is a schematic diagram of an image data transmission system according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating an exemplary method for transmitting image data according to the present invention;
FIG. 3 is a schematic diagram illustrating the division of image data according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating an image data injection method according to an embodiment of the present invention;
FIG. 5 is a second flowchart illustrating an exemplary method of image data injection according to the present invention;
FIG. 6 is a schematic diagram illustrating an architecture of an image data transmission device according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a computer system of an electronic device according to an embodiment of the invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, devices, steps, etc. In other instances, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the elements and operations/steps, nor must they be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.
An embodiment of the present invention provides an image data transmission system, as shown in fig. 1, which includes an image processing unit 1 and an image injection unit 2. The image processing unit 1 is for performing an image data transmission method provided hereinafter, and the image injection unit 2 is for performing an image data injection method provided hereinafter.
The image injection unit 2 may comprise one or more FPGA (Field-Programmable Gate Array, field programmable gate array) video injection boards, among others.
The image processing unit 1 may be a host computer, an industrial personal computer, a real-time computer or a service host computer, and may perform decoding processing on the image data. Data can be transmitted between the image processing unit 1 and the image injection unit 2 through an HDMI (high definition multimedia interface) line, which is a full digital video and audio transmission interface, and uncompressed audio and video signals can be transmitted.
The pixel mode transmitted over HDMI is typically in RGB format. The sampling range of the transmitted data is generally classified as either a full range (0 to 255) or a limited effective range (16 to 235).
The image data transmission method and the image data injection method of the embodiment can be used for simulation test in unmanned technology. The image injection unit 2 injects image data into the image receiving unit 3, and the image receiving unit 3 may be a controller with a neural network model, has a machine learning algorithm, may process the received image data to obtain an output result, for example, may perform object recognition on a video image. The image receiving unit 3 may perform processing such as algorithm verification, development, or testing in unmanned automatic driving (or assisted driving) technology using the image data.
Specifically, an embodiment of the present invention provides an image data transmission method, as shown in fig. 2, including a step 100, a step 200, and a step 300, which specifically includes the following steps:
in step 100, image data is acquired, the format of the image data including a RAW format. Wherein, the RAW format image data is original image data.
Step 200, dividing the image data into three parts according to a preset dividing mode, obtaining first part data, second part data and third part data, and respectively putting the first part data, the second part data and the third part data into a red channel, a green channel and a blue channel of a red, green and blue color mode. The preset dividing mode may be to divide the image data into three parts equally, or divide the image data into three parts with unequal data amounts, or three parts with equal parts.
Among them, the Red, green and Blue (RGB) color mode is a color standard in industry, and various colors are obtained by changing three color channels of Red (Red), green (Green) and Blue (Blue) and overlapping them with each other, RGB is a color representing three channels of Red, green and Blue, and the standard almost includes all colors perceived by human eyesight, and is one of the most widely used color systems.
Step 300, transmitting the first part of data, the second part of data and the third part of data to the image injection unit through the high-definition multimedia data interface circuit based on the red channel, the green channel and the blue channel.
In this embodiment, through the above steps, the image data in the RAW format is divided into three parts, and the data is transmitted in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the transmission of the image data in the RAW format through the HDMI line can be realized without converting the RAW format into the RGB format, and the image data transmission efficiency is improved. The problem that the HDMI line does not support the RAW format and cannot transmit the RAW format data is solved.
In one implementation of this embodiment, in step 200, the step of dividing the image data into three portions includes:
step 201, a check code is obtained, and the check code is inserted into the image data to obtain the image data to be checked.
The check code may be a hamming check code or a CRC check code (Cyclic Redundancy Check, cyclic redundancy check code). The implementation principle of Hamming check is that r check bits are added beyond k data bits, so that a new code word with k+r bits is formed, and the code distance of the new code word is uniformly increased. Each binary bit of the data is distributed in a combination of a plurality of different even check bits, and when one bit goes wrong, the value of the relevant check bits is changed, so that the error can be found, the error can be pointed out, and a basis is provided for further automatic error correction.
Taking the hamming check code as an example, as shown in fig. 3, assume that the image data (binary number) is a total of 12-bit codes of D0, D1, D2, …, D11; the check code (binary number) is 5 bit codes of P0, P1, P2, P3 and P4; p0, P1, P2P3, P4 is inserted into D0, D1, D2, …, D11 to obtain 17-bit code of image data to be checked, specifically P0, P1, D0, P2, D1, D2, D3, P3, D4, D5, D6, D7, D8, D9, D10, P4, D11. In the present embodiment, the check code is located at the 1 st, 2 nd, 4 th, 8 th, 16 th bits of the image data to be checked, i.e., the check code is located at the 2 nd bit in the image data to be checked n Bits, where n is an integer greater than or equal to 0. Therefore, the subsequent calibration and error correction can be conveniently performed by utilizing the Hamming calibration mode.
Step 202, dividing the image data to be verified into a first part of data, a second part of data and a third part of data.
For example, by using the Hamming method, P0, P1, D0, P2, D1, D2, D3, P3, D4, D5, D6, D7, D8, D9, D10, P4, D11 are divided into three parts, the first part of data is D8, D9, D10, P4, D11, and put into the red (R) channel, the second part of data is D3, P3, D4, D5, D6, D7, and put into the green (R) channel, and the third part of data is P0, P1, D0, P2, D1, D2, and put into the (B) blue channel.
Specifically, the check code is 01010, i.e., P0, P1, P2, P3, P4 are 1,0,0,1,0 respectively; image data is 110010100101, i.e., D0, D1, D2, …, D11 is 1,1,0,0,1,0,1,0,0,1,0,1, respectively; the image data to be verified is 10101001101001001. The first part of data is 01001, the second part of data is 011010, and the third part of data is 101010.
After the image data to be checked is transmitted to the image injection unit, the image injection unit performs check error correction on the image data to be checked. Specifically, the 1 st, 2 nd, 4 th, 8 th and 16 th code words are extracted from the image data to be checked to obtain a 5 th code P0', P1', P2', P3', P4', and the 5 th code and the check codes P0, P1, P2, P3, P4 are compared and verified, so that whether the original image data (D0, D1, D2, …, D11) have errors in the transmission process can be judged according to the comparison and verification result, which bit number has errors is positioned, and error correction is performed (the data on the bit with errors is changed from 0 to 1 or 1 to 0), and finally the accurate image data D0, D1, D2, … and D11 are obtained.
It should be noted that, the specific calibration and error correction process and principle adopts the hamming calibration method, which is a technical means commonly known by those skilled in the art, so that there is no implementation obstacle for those skilled in the art, and it should be understood that the above technical solution described in this embodiment is fully disclosed.
By the steps, the embodiment can ensure that sporadic errors of the image data in the transmission process can be correctly repaired. Wherein, sporadic errors refer to: bit errors during transmission (poor accuracy, e.g., 35 values when sent and 34 values when received), such as those caused by color format.
In the above step, the binary number of the check code is smaller than the binary number of the image data. For example, the binary number of bits of the image data is 12 bits, and the binary number of bits of the check code is 5 bits, then the binary number of bits of the image data to be checked is 17, so that the total number of bits of the image data to be checked can be kept within a proper range after the check code is inserted into the image data.
In one embodiment, the difference in the number of binary bits of any two of the first portion of data, the second portion of data, and the third portion of data is less than or equal to 1. Specifically, according to the above example, the binary number of bits of the first partial data is 5 bits, and the second partial data and the third partial data are 6 bits. This allows for a more uniform distribution of image data into the three channels of RGB.
In one embodiment, before the step of dividing the image data into three parts according to the preset division manner to obtain the first part data, the second part data and the third part data, the method further includes:
encoding information to be transmitted corresponding to the image data onto a target pixel to replace the original value of the target pixel, wherein the target pixel is a pixel of a designated area on a video image frame corresponding to the image data, and the information to be transmitted comprises at least one of timestamp information, geographic position information and bus information.
Since the HDMI line generally transmits RGB format image data, the time stamp information waiting transmission information cannot be transmitted together with the image data. The video data is composed of each frame of image, each frame of image corresponds to one piece of time stamp information, and when a plurality of video data are transmitted, the image injection unit may inject images of the same time into the image receiving unit according to the time stamp information on the image data. If the time stamp information is absent, the synchronous injection of video images cannot be completed.
Through the steps, the information to be transmitted corresponding to the image data can be encoded on the target pixel, and in the transmission process of the image data, the information to be transmitted is transmitted to the image injection unit along with the image data by the image processing unit, so that the defect of the information to be transmitted is avoided, and the image injection unit is beneficial to injecting the image data to the image receiving unit according to the information to be transmitted.
In one embodiment, the step of transmitting the first portion of data, the second portion of data and the third portion of data to the image injection unit via the high definition multimedia data interface further comprises:
and determining transmission opportunity information, and transmitting the image data and the time stamp information to an image injection unit according to the transmission opportunity information and the time stamp information corresponding to the image data, so that the image injection unit injects video image frames in the image data to an image receiving unit according to the time stamp information, wherein the transmission opportunity information is used for representing the advance degree of the time of transmitting the video image frames to the image injection unit relative to the time stamp information of the video image frames.
Through the steps, the number of the frames of the video image cached in the image injection unit can be ensured to be smaller (for example, the frames of the video image cached in 1 second time are cached), so that the image injection unit can be beneficial to synchronously injecting the frames of the video image into the image receiving unit, and the image receiving unit can effectively perform the processing such as algorithm verification, development or test in the unmanned automatic driving (or auxiliary driving) technology.
In one implementation of this embodiment, step 300 may include:
step 301, the current time is obtained.
In step 302, a transmission time point and a second time interval are determined as transmission timing information, and a minimum value of the second time interval is greater than the transmission time point.
Wherein greater than is also understood to be later than the minimum value thereof, and the earliest moment in the second time interval.
Step 303, comparing the transmission time point with the current time, and if the current time reaches the transmission time point, transmitting the video frame image with the timestamp information falling in the second time interval and the timestamp information thereof to the image injection unit.
Therefore, the number of the frames of the video image cached in the image injection unit is ensured to be smaller (for example, the frames of the video image within 1 second are cached), and the image injection unit is beneficial to synchronously injecting the frames of the video image into the image receiving unit, so that the image receiving unit can effectively perform the processing such as algorithm verification, development or test in unmanned automatic driving (or auxiliary driving) technology.
In one embodiment, video image frames may be injected into the image receiving unit based on the time stamp information, and prior to injection, fault injection may also be performed on the video image frames, e.g., some faults may be injected.
For example, video fault configuration information may be determined according to a target fault scenario, and faults may be injected based on the video fault configuration information, which may include, for example, fault type and video fault parameters; the target fault scenario includes at least one sub-fault scenario, the sub-fault scenario corresponding to a video fault type.
For example, the sub-fault scenario may include a fault scenario of communication delay, a fault scenario of interface looseness, a fault scenario of communication interference, and the like, which may occur in automatic driving of an automobile. The communication delay refers to a communication delay existing in the video data transmission network; interface looseness refers to looseness of a certain interface in a video data transmission link; communication interference refers to communication interference that exists in the video data transmission network.
Specifically, the target fault scenario may be determined according to a preset fault scenario generation timing, where the fault scenario generation timing is used to characterize the time and sequence of occurrence of each sub-fault scenario. For example, a fault scenario in which communication is delayed occurs in the t1-t2 seconds, a fault scenario in which interface looseness occurs in the t2-t3 seconds, and a fault scenario does not occur in the t3-t4 seconds.
If the sub fault scene comprises a fault scene of communication delay, the video fault type comprises a time delay fault, and the corresponding video fault parameters are time delay parameters used for defining information such as time delay amplitude and the like;
if the sub-fault scene comprises a fault scene with loose interfaces, the video fault type comprises a frame dropping fault, the video fault parameters comprise frame dropping parameters used for determining frame dropping image frames, and further, the determined frame dropping image frames need to be removed from the video image frames to be injected, namely, in the fault scene with loose interfaces, the image frames injected into the video processing unit in the initial video data do not comprise frame dropping image frames.
If the sub-fault scenario includes a fault scenario of communication interference, and the video fault type includes an out-of-order fault, then: the video fault parameters comprise disorder parameters for determining a plurality of disorder image frames, and further, the sequence and time stamp information of the plurality of disorder image frames of the video image frames to be injected need to be exchanged, so that disorder simulation is realized.
In a failure scenario of a communication network problem, error code failures may also occur. In the error code fault, the error code condition of partial image frame data occurs, the data of any number of image frames are randomly modified, and the fault simulation of signal error code caused by the communication network problem is completed.
In the above process, for ease of understanding, each sub-fault scenario is described as corresponding to one fault type, in an actual scheme, one fault scenario may also correspond to multiple fault types, and multiple fault types may occur simultaneously or may occur sequentially according to a preset time sequence.
Therefore, fault simulation of different scenes can be realized, and real fault conditions can be simulated. In addition, different video data which are synchronously injected are related sometimes, further, if a certain video injection unit needs to simulate a fault scene with poor communication environment as a target fault scene, each video injection unit can be synchronously configured as the same target fault scene, corresponding to the simulation of a frame dropping fault (the frame dropping parameters can be the same or different) in each path of video, if a certain video injection unit needs to simulate a fault scene with weak interface, only the video injection unit can configure the fault scene as the target fault scene, corresponding to the simulation of a time delay fault in the path of video, and other video injection units are not configured as the fault scene faults. The process may be determined by communication between video injection units and/or video processing units.
The image data transmission method of the present embodiment includes first acquiring image data, and dividing the image data into first partial data, second partial data, and third partial data, wherein the format of the image data includes a RAW format; then the first part of data, the second part of data and the third part of data are respectively put into a red channel, a green channel and a blue channel of a red, green and blue color mode; and finally, transmitting the first part of data, the second part of data and the third part of data to an image injection unit through a high-definition multimedia data interface circuit. The invention can divide the image data in the RAW format into three parts, and transmit data in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the image data in the RAW format can be transmitted through an HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
The embodiment of the invention also provides an image data injection method, as shown in fig. 4, comprising the following steps:
step 400, obtaining image data, wherein the image data is obtained through the image data transmission method;
step 500, restoring the image data into RAW format image data, and determining the image data to be injected based on the RAW format image data;
at step 600, the image data to be injected is injected into the image receiving unit.
By the image data injection method of the embodiment, the image data in the RAW format can be divided into three parts, and the data is transmitted in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the image data in the RAW format can be transmitted through the HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
In one implementation of the present embodiment, as shown in fig. 5, before the step of restoring the image data to the RAW format image data, the method further includes:
step 501, obtaining a check code in image data;
step 502, judging whether the image data has errors according to the check code;
step 503, if there is an error in the image data, correcting the image data according to the check code.
In one embodiment, correcting the image data according to the check code specifically includes:
determining code bits with errors in the image data according to the check code;
and correcting the data corresponding to the code bit with the error.
By the above steps it is ensured that the image data transferred from the image processing unit to the image injection unit is correct. The verification code can adopt a Hamming verification code, and the verification mode also adopts a Hamming verification mode.
An embodiment of the present invention provides an image data transmission device, configured to be used in the image data transmission method provided in the foregoing embodiment, as shown in fig. 6, including:
the acquiring module 701 is configured to acquire image data, where a format of the image data includes a RAW format. Wherein, the RAW format image data is original image data.
The dividing module 702 is configured to divide the image data into three parts, and put the three parts into a red channel, a green channel, and a blue channel of a red, green, and blue color mode, respectively, to obtain first part data, second part data, and third part data.
Among them, the Red, green and Blue (RGB) color mode is a color standard in industry, and various colors are obtained by changing three color channels of Red (Red), green (Green) and Blue (Blue) and overlapping them with each other, RGB is a color representing three channels of Red, green and Blue, and the standard almost includes all colors perceived by human eyesight, and is one of the most widely used color systems.
A transmission module 703, configured to transmit the first portion of data, the second portion of data, and the third portion of data to the image injection unit through the high-definition multimedia data interface line.
According to the image data transmission device provided by the embodiment of the invention, the image data in the RAW format can be divided into three parts, and the data is transmitted in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the image data in the RAW format can be transmitted through an HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
Fig. 7 shows a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.
It should be noted that, the computer system of the electronic device shown in fig. 7 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present invention.
As shown in fig. 7, the computer system includes a central processing unit (Central Processing Unit, CPU) 1801, which can perform various appropriate actions and processes, such as performing the methods described in the above embodiments, according to a program stored in a Read-Only Memory (ROM) 1802 or a program loaded from a storage section 1808 into a random access Memory (Random Access Memory, RAM) 1803. In the RAM 1803, various programs and data required for system operation are also stored. The CPU 1801, ROM 1802, and RAM 1803 are connected to each other via a bus 1804. An Input/Output (I/O) interface 1805 is also connected to the bus 1804.
The following components are connected to the I/O interface 1805: an input section 1806 including a keyboard, a mouse, and the like; an output portion 1807 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and a speaker, etc.; a storage section 1808 including a hard disk or the like; and a communication section 1809 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 1809 performs communication processing via a network such as the internet. The drive 1810 is also connected to the I/O interface 1805 as needed. Removable media 1811, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memory, and the like, is installed as needed on drive 1810 so that a computer program read therefrom is installed as needed into storage portion 1808.
In particular, according to embodiments of the present invention, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a computer program for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via the communication portion 1809, and/or installed from the removable medium 1811. When executed by a Central Processing Unit (CPU) 1801, performs various functions defined in the system of the present invention.
It should be noted that, the computer readable medium shown in the embodiments of the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with a computer-readable computer program embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present invention may be implemented by software, or may be implemented by hardware, and the described units may also be provided in a processor. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
Specifically, the electronic device of the present embodiment includes a processor and a memory, and the memory stores a computer program, which when executed by the processor, implements the image data transmission method and/or the image data injection method provided in the foregoing embodiments.
By the electronic device of the present embodiment, image data is first acquired, and the image data is divided into first partial data, second partial data, and third partial data, the format of the image data including a RAW format; then the first part of data, the second part of data and the third part of data are respectively put into a red channel, a green channel and a blue channel of a red, green and blue color mode; and finally, transmitting the first part of data, the second part of data and the third part of data to an image injection unit through a high-definition multimedia data interface circuit. The invention can divide the image data in the RAW format into three parts, and transmit data in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the image data in the RAW format can be transmitted through an HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
As another aspect, the present invention also provides a computer-readable storage medium that may be contained in the electronic device described in the above-described embodiment; or may exist alone without being incorporated into the electronic device. The storage medium carries one or more computer programs which, when executed by a processor of the electronic device, cause the electronic device to implement the methods provided in the embodiments described above.
It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the invention. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.
From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a touch terminal, or a network device, etc.) to perform the method according to the embodiments of the present invention.
Specifically, with the storage medium of the present embodiment, image data is first acquired, and the image data is divided into first partial data, second partial data, and third partial data, the format of the image data including a RAW format; then the first part of data, the second part of data and the third part of data are respectively put into a red channel, a green channel and a blue channel of a red, green and blue color mode; and finally, transmitting the first part of data, the second part of data and the third part of data to an image injection unit through a high-definition multimedia data interface circuit. The invention can divide the image data in the RAW format into three parts, and transmit data in the high-definition multimedia data interface (HDMI) through the red (R) channel, the green (G) channel and the blue (B) channel, so that the image data in the RAW format can be transmitted through an HDMI line without converting the RAW format into the RGB format, and the image data transmission efficiency is improved.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (10)
1. An image data transmission method, comprising:
acquiring image data, wherein the format of the image data comprises a RAW format;
dividing the image data into three parts according to a preset dividing mode to obtain first part data, second part data and third part data, and respectively putting the first part data, the second part data and the third part data into a red channel, a green channel and a blue channel of a red-green-blue color mode;
determining transmission timing information of the image data; the transmission time information is used for representing the advance degree of the time of the video image frame transmitted to the image injection unit relative to the time stamp of the video image frame;
based on the red channel, the green channel, and the blue channel, the time stamp of the image data, the first partial data, the second partial data, and the third partial data are transmitted to the image injection unit through a high definition multimedia data interface line according to the transmission timing information, and the video image frame is injected to an image receiving unit by the image injection unit according to the time stamp of the video image frame.
2. The image data transmission method according to claim 1, wherein the step of dividing the image data into three parts comprises:
obtaining a check code, and inserting the check code into the image data to obtain image data to be checked;
dividing the image data to be checked into three parts.
3. The image data transmission method according to claim 2, wherein the number of binary bits of the check code is smaller than the number of binary bits of the image data, and a difference in the number of binary bits of any two of the first partial data, the second partial data, and the third partial data is smaller than or equal to 1.
4. The image data transmission method according to claim 3, wherein the number of binary digits of the check code is five, the number of binary digits of the image data is twelve, the number of binary digits of the image data to be checked is seventeen, and the number of binary digits of the first partial data, the second partial data and the third partial data are six, and the number of binary digits of the other one is five.
5. The image data transmission method according to claim 2, wherein the check code is located at 2 nd in the image data to be checked n Bits, where n is an integer greater than or equal to 0.
6. An image data injection method, comprising:
acquiring image data obtained by the image data transmission method according to any one of claims 1 to 5;
restoring the image data into RAW format image data, and determining image data to be injected based on the RAW format image data;
and injecting the video image frames in the image data to be injected into an image receiving unit according to the time stamp of the image data to be injected.
7. The image data injection method according to claim 6, further comprising, before the step of restoring the image data to RAW format image data:
acquiring a check code in the image data;
judging whether the image data has errors according to the check code;
and if the image data has errors, correcting the image data according to the check code.
8. The image data injection method according to claim 7, wherein the step of correcting the image data according to the check code comprises:
determining code bits with errors in the image data according to the check code;
and correcting the data corresponding to the code bit with the error.
9. An image data transmission system, comprising:
an image processing unit configured to execute the image data transmission method according to any one of claims 1 to 5;
an image injection unit for performing the image data injection method of any one of claims 6 to 8.
10. An electronic device comprising a processor and a memory, the memory having stored thereon a computer program which, when executed by the processor, implements the image data transmission method of any one of claims 1 to 5 and/or the image data injection method of any one of claims 6 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211303579.XA CN115665357B (en) | 2022-10-24 | 2022-10-24 | Image data transmission method, system, injection method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211303579.XA CN115665357B (en) | 2022-10-24 | 2022-10-24 | Image data transmission method, system, injection method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115665357A CN115665357A (en) | 2023-01-31 |
| CN115665357B true CN115665357B (en) | 2023-08-08 |
Family
ID=84992325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211303579.XA Active CN115665357B (en) | 2022-10-24 | 2022-10-24 | Image data transmission method, system, injection method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115665357B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102209261A (en) * | 2010-03-31 | 2011-10-05 | 日立民用电子株式会社 | Video transmission device, video reception device, and video transmission system |
| CN102404578A (en) * | 2011-12-21 | 2012-04-04 | 中国科学院自动化研究所 | Multi-channel video transmission system and method |
| CN105635802A (en) * | 2015-12-31 | 2016-06-01 | 浙江大华技术股份有限公司 | Transmission method of digital media data and device |
| CN110574363A (en) * | 2017-11-22 | 2019-12-13 | 深圳市大疆创新科技有限公司 | Image noise calibration method and device, image noise reduction method and device, and image processing device |
| CN111614952A (en) * | 2019-02-25 | 2020-09-01 | 北京地平线机器人技术研发有限公司 | Method and device for detecting reliability of image transmission channel |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6668964B2 (en) * | 2016-06-13 | 2020-03-18 | コニカミノルタ株式会社 | Image forming system, image data transmission unit, and image data transmission method |
-
2022
- 2022-10-24 CN CN202211303579.XA patent/CN115665357B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102209261A (en) * | 2010-03-31 | 2011-10-05 | 日立民用电子株式会社 | Video transmission device, video reception device, and video transmission system |
| CN102404578A (en) * | 2011-12-21 | 2012-04-04 | 中国科学院自动化研究所 | Multi-channel video transmission system and method |
| CN105635802A (en) * | 2015-12-31 | 2016-06-01 | 浙江大华技术股份有限公司 | Transmission method of digital media data and device |
| CN110574363A (en) * | 2017-11-22 | 2019-12-13 | 深圳市大疆创新科技有限公司 | Image noise calibration method and device, image noise reduction method and device, and image processing device |
| CN111614952A (en) * | 2019-02-25 | 2020-09-01 | 北京地平线机器人技术研发有限公司 | Method and device for detecting reliability of image transmission channel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115665357A (en) | 2023-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103136094B (en) | A kind of page method of testing and device | |
| US11849251B2 (en) | Method and device of transmitting video signal, method and device of receiving video signal, and display device | |
| WO2008060025A1 (en) | Method and system for partitioning and encoding of uncompressed video for transmission over wireless medium | |
| US7243291B1 (en) | System and method for communicating image data using error correction coding | |
| CN103763067A (en) | Method and device for error correction and calibration of communication data packets | |
| CN115665357B (en) | Image data transmission method, system, injection method and electronic equipment | |
| US20100095188A1 (en) | Apparatus and method for detecting and correcting errors in control characters of a multimedia interface | |
| CN112511259B (en) | Intelligent terminal clock management method and device, storage medium and terminal equipment | |
| CN103795499B (en) | Satellite load high-speed serial port error detection and correction method | |
| CN115665502B (en) | Video data processing method, injection method, system, equipment and storage medium | |
| CN115665422B (en) | Video data transmission method, system, injection method and electronic equipment | |
| CN106709368A (en) | Data analysis method and device | |
| US8582685B2 (en) | Apparatus and method for encoding a signal | |
| CN114220380B (en) | Calibration digital circuit, source driver and display panel | |
| CN116684543A (en) | Data transmission method and device, chip, electronic equipment and storage medium | |
| CN115022682B (en) | Video data transmission verification method based on serdes channel | |
| CN118827962A (en) | Verification method and device for image signal processing and electronic equipment | |
| JPS5996516A (en) | Correcting and encoding method of error | |
| CN115665403A (en) | Video injection method and system, video injection configuration method and electronic equipment | |
| CN110533576B (en) | Multimedia pipeline type device | |
| US20240371123A1 (en) | Electronic device, video system including the same, and method for generating image pattern of test video | |
| US8392812B2 (en) | Teletext decoder | |
| CN116233531A (en) | Video live broadcast testing method and device, electronic equipment and storage medium | |
| CN109547850B (en) | Video shooting error correction method and related product | |
| CN118036626A (en) | Card reader control method and device and card reader |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |