WO2022012153A1

WO2022012153A1 - Data transmission method and device, and storage medium

Info

Publication number: WO2022012153A1
Application number: PCT/CN2021/094684
Authority: WO
Inventors: 刘国树
Original assignee: RealMe重庆移动通信有限公司
Priority date: 2020-07-16
Filing date: 2021-05-19
Publication date: 2022-01-20
Also published as: CN111885404A

Abstract

Disclosed are a data transmission method and device, and a storage medium, which are applied to the technical field of data transmission and can solve the problem of being unable to realize the transmission of mass data. The method comprises: a first device collecting a picture of each frame of an image in a video stream played on a screen of a second device to obtain M original images, wherein the video stream is generated by encoding first data, the video stream comprises M frames of an image, each frame of the image in the video stream comprises N image display regions, each image display region indicates one data unit in the first data, and M and N are integers greater than or equal to 2; and the first device decoding the M original images to obtain the first data.

Description

Data transmission method, device and storage medium

technical field

Embodiments of the present invention relate to the technical field of data transmission, and in particular, to a data transmission method, device, and storage medium.

Background technique

At present, there are various data transmission methods. Among the more common data transmission methods in life, there is the method of using images to transmit data, such as using two-dimensional code as a carrier to transmit data, but the amount of information carried is relatively small, so it cannot be realized. Transmission of large amounts of data.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a data transmission method, device, and storage medium, so as to solve the problem in the prior art that the transmission of a large amount of data cannot be realized.

In order to solve the above technical problems, the embodiments of the present invention are implemented as follows:

In a first aspect, a data transmission method is provided, including:

The first device collects the picture of each frame of image in the video stream played on the screen of the second device, and obtains M original images, the video stream is generated by encoding the first data, and the video stream includes M frames of images, and the video stream Each frame of image in includes N image display areas, and each image display area indicates a data unit in the first data, wherein M and N are integers greater than or equal to 2;

The first device decodes the M original images to obtain first data.

In a second aspect, a data transmission method is provided, including:

The second device obtains the first data to be transmitted, and encodes the first data to generate a video stream;

The second device plays the video stream on the screen, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates that the first data a data unit, so that the first device collects the picture of each frame of the image in the video stream played on the screen of the second device, obtains M original images, and decodes the M original images, to obtain the first data, wherein M and N are integers greater than or equal to 2.

In a third aspect, a first device is provided, including:

The receiving module is used to collect the picture of each frame of image in the video stream played on the screen of the second device, and obtain M original images, the video stream is generated by encoding the first data, and the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates a data unit in the first data;

a processing module, configured to decode the M original images to obtain the first data.

In a fourth aspect, a second device is provided, comprising:

a processing module, configured to obtain the first data to be transmitted, and encode the first data to generate a video stream;

A playback module, configured to play the video stream on the screen, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates the first A data unit in the data, so that the first device collects the picture of each frame of the image in the video stream played on the screen of the second device, obtains M original images, and performs the processing on the M original images. decoding to obtain the first data.

In a fifth aspect, a first device is provided, comprising: a processor, a memory, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor to achieve the following: The steps of the data transmission method described in the first aspect.

In a sixth aspect, a second device is provided, comprising: a processor, a memory, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor to achieve the following: The steps of the data transmission method described in the second aspect.

In a seventh aspect, a computer-readable storage medium is provided, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the data transmission method described in the first aspect are implemented, Alternatively, the steps of the data transmission method described in the second aspect are implemented.

In the embodiment of the present invention, the first device collects images of each frame of images in the video stream played on the screen of the second device, and obtains M original images, the video stream is generated by encoding the first data, and the video stream is Including M frames of images, each frame of image in the video stream includes N image display areas, each image display area indicates a data unit in the first data, wherein, M and N are integers greater than or equal to 2; the first device Decode the M original images to obtain the first data. With this solution, since each frame of image in the video stream on the second device can indicate a data unit through the image display area, the first device can capture the picture of each frame of image in the video stream on the second device through the camera, to obtain a large amount of information carried by the video stream, so that a large amount of data can be transmitted between the first device and the second device.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments and the prior art. Obviously, the drawings in the following description are only some implementations of the present application. For example, other drawings may also be obtained from these drawings.

FIG. 1 is a schematic diagram 1 of an architecture for implementing data transmission according to an embodiment of the present invention;

2 is a schematic diagram of a lossy encoding and lossless encoding provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram 2 of an architecture for implementing data transmission according to an embodiment of the present invention

4 is a schematic diagram 1 of a data transmission method provided by an embodiment of the present invention;

5 is a schematic diagram of dividing a mobile phone screen into multiple display areas according to an embodiment of the present invention;

6 is a schematic diagram 2 of a data transmission method provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram 3 of a data transmission method provided by an embodiment of the present invention;

8 is a schematic structural diagram of a first device according to an embodiment of the present invention;

9 is a schematic structural diagram of a second device according to an embodiment of the present invention;

FIG. 10 is a schematic diagram of hardware of a mobile phone according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The terms "first" and "second" and the like in the description and claims of the present invention are used to distinguish different objects, rather than to describe a specific order of the objects. For example, the first device and the second device, etc. are used to distinguish different devices, not to describe a specific order of the devices.

It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to represent examples, illustrations, or descriptions. Any embodiments or designs described as "exemplary" or "such as" in the embodiments of the present invention should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present the related concepts in a specific manner.

According to statistics, at least 80% of the current data arithmetic is carried out with images as carriers. Images have the characteristics of carrying a large amount of information, being intuitive and easy to understand, and image processing is a necessary guarantee for the achievability and security of image information transmission. In the related art, as shown in Figure 1 is a schematic diagram of the architecture implemented by a data transmission method. After the image is captured, encoded, compressed and encrypted, the data transmission device can transmit it through the Internet, etc., and the data receiving device is decompressed and decoded. , After the decryption process, the effective information contained in the image can be extracted.

Further, due to the large amount of information contained in the image, the memory space it occupies is also very large. A 1024*768 24-bit color image without encoding and compression will have a size of 2.25MB, but after encoding and compression, it will only have Dozens of KB in size, encoding compression can greatly reduce the size of the image. Commonly used encoding methods include lossless numbering (which can completely restore the original image after decompression without any loss of information) and lossy encoding (which is irreversible, the decoded image cannot completely restore the original image, and there will be some information. lost).

Optionally, the image encoding formats include PNG format and JPEG format. Among them, the PNG format is a lossless encoding method, and the JPEG format is a lossy encoding format. The encoding process of the image is a compression process of the image. During encoding, the algorithm will remove a large amount of redundant information on the image and only retain the indispensable and effective information. Exemplarily, as shown in Figure 2, for lossy encoding, the algorithm will integrate multiple pixel points with similar pixel values into the same pixel value for storage, which would have required space for storing multiple pixel values. After encoding and compression, only one pixel value needs to be stored, which greatly saves storage space. As shown in 2, the four pixel points with the same pixel value indicated by 21 and the four pixel points with the same pixel value indicated by 22 are finally integrated into 23 This is a pixel; while the lossless encoding algorithm will only integrate multiple pixels with the same pixel value into one value for storage to achieve the purpose of compression. The lossless encoded image will occupy a larger space than the lossy encoded image, that is, The four pixel points indicated by 21 shown in FIG. 2 are finally integrated into one pixel point 24 , and the four pixel points indicated by 22 are finally integrated into one pixel point 25 .

Although the amount of transmitted data can be increased based on the above-mentioned image compression technology, the increase in the amount of transmitted data is very limited, and some image information may be lost.

In this embodiment of the present invention, in order to further increase the data volume of data transmission, it may be implemented by transmitting a video stream, and the video stream may include M frames of images, wherein each frame of image may indicate the first data to be transmitted through the image display area. A data unit is displayed on the screen, so that the first device can capture each frame of image in the video stream on the second device through the camera to obtain a large amount of data carried by the video stream, so that the first device and the second device can be used. A large amount of data is transmitted between the two devices.

The data transmission method provided in the embodiment of the present invention may be implemented through data transmission between two devices (the first device and the second device in the embodiment of the present invention), wherein the first device may serve as a data sending end, and the second device The device may serve as a data receiving end, or the first device may serve as a data receiving end, and the second device may serve as a data sending end.

The device in this embodiment of the present invention may be an intelligent peripheral device, a mobile terminal device, or a non-mobile terminal device. The mobile terminal device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle-mounted terminal device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA) etc.; the non-mobile terminal device may be a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in this embodiment of the present invention.

Exemplarily, FIG. 3 is a schematic diagram of an architecture for implementing data transmission provided by an embodiment of the present invention. Among them, two independent devices are involved, one device is a smart peripheral that can capture images, play video streams, and receive and play audio, and the other device is a smart phone, and the smart phone can be installed on the smart peripheral. Among them, an application can be installed on the smartphone. The application can encrypt the audio, picture, video, text file and other data through special encoding and then continuously display it on the screen of the mobile phone in the form of a video stream. The encryption key is passed through the audio module. (that is, an audio playback device or a speaker) to play and send, and the smart peripheral uses the camera it carries to capture the picture of each frame of the video stream presented on the smartphone screen to obtain the original image, and uses the audio module (that is, the audio receiver). or microphone) to receive the audio key, and then process and decode and decrypt the collected original image in turn in combination with the audio key to obtain the data transmitted by the smartphone.

Further, if the smart peripheral needs to transmit information to the smart phone, the smart peripheral can play the specially encrypted video stream on its screen, and at the same time use the speaker to play the audio key, and the smart phone uses the camera it carries to collect the smart peripheral. Set the picture of each frame of image in the video stream played on the screen to obtain the original image, and use the audio receiver to receive the audio key, and decode and decrypt the original image to obtain the data transmitted by the intelligent peripheral, thus The two parties can effectively transmit data to each other, and the two parties use Bluetooth, Wi-Fi technology, etc. to achieve handshake or command mutual transmission, which is specifically implemented by the Bluetooth/WIFI module in the device in Figure 3). Use specially modulated audio as a key.

Further, the smart peripheral can also be connected to other terminals (such as the peripheral terminal shown in Figure 3) through wired cables or wireless WIFI, and the smart peripheral can send audio data to the audio terminal and video data to the projector. , the lighting control data is sent to the lighting control terminal, etc.

The following takes the first device as the data receiving end and the second device as the data sending end as an example for exemplary description. In this embodiment of the present invention, the first device and the second device may be two devices within a certain distance range, and the distance and positional relationship between the two needs to be able to satisfy the requirements that the second device can collect on the first device through the camera. The video stream is set as the criterion, which is not limited in this embodiment of the present invention.

Example 1

As shown in FIG. 4, an embodiment of the present invention provides a data transmission method, and the method may include:

401. The second device acquires the first data to be transmitted, and encodes the first data to generate a video stream.

In this embodiment of the present invention, the data type of the first data includes at least one of an image data type, an audio data type, a video data type, and a text data type.

402. Play the video stream on the screen of the second device.

The video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates a data unit in the first data, so that the first device can capture the screen of the second device The picture of each frame of the image in the video stream played on the above is obtained, and M original images are obtained, and the M original images are decoded to obtain the first data, wherein M and N are integers greater than or equal to 2.

Optionally, each image display area above indicates a data unit in the first data through a displayed color.

The two-dimensional code is a binary code, which can use black and white to indicate data. The two-dimensional code is filled with black and white colors in different display areas to carry data. In the embodiment of the present invention, a more Multiple colors are used to fill each frame of image, and each color indicates different data information carried, so that a large amount of information can be carried through the combination of multiple colors, so that hundreds of frames of data can be transmitted per second, and even thousands of data can be transmitted. frame data.

Exemplarily, all color classification divisions can be encoded into quaternary, octal or other base codes. Assuming that the quaternary system is used as an example, the quaternary code has 00, 01, 10 and 11, then it can be specified that black represents 00, red represents 01, green represents 10, and yellow represents 11. If you need to encode into other systems, you can Divide the colors according to your needs.

Optionally, each image display area described above may also indicate a data unit in the first data through a shape, or indicate a data unit in the first data according to other features of each image display area. There is no specific limitation.

Exemplarily, the second device can be a mobile phone. As shown in FIG. 5 , it can be seen from the schematic diagram of the screen of the mobile phone that the screen can be divided into a plurality of small squares, and each small square is a display area. A color is displayed in each small square to carry data, wherein each small square can display different colors according to different requirements of the transmitted data.

It should be noted that, in this embodiment of the present invention, in addition to the way of dividing the display area on the screen of the mobile phone in FIG. 5 , the screen of the mobile phone may also have other ways of dividing the display area, and FIG. 5 is only an exemplary illustration . For example, it can be divided into more or less display areas than in FIG. 5 , the screen of the mobile phone can also be divided into display areas with multiple rows and one column, and the screen of the mobile phone can be divided into display areas with multiple columns and one row.

403. The first device collects images of each frame of images in the video stream played on the screen of the second device, and obtains M original images.

Wherein, the first device may collect images of each frame of images in the video stream played on the screen of the second device through a camera to obtain M original images.

Optionally, the first device may use a camera of a high-speed camera to capture images of each frame of the video stream played on the screen of the second device, so that a faster data transmission speed can be achieved.

404. The first device decodes the M original images to obtain first data.

In the embodiment of the present invention, the first device collects images of each frame of images in the video stream played on the screen of the second device to obtain M original images, the video stream is generated by encoding the first data, and the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, each image display area indicates a data unit in the first data, wherein M and N are integers greater than or equal to 2; the first device pair The M original images are decoded to obtain the first data. With this solution, since each frame of image in the video stream on the second device can indicate a data unit through the image display area and display it on the screen, the first device can capture the video stream on the second device through the camera. The picture of each frame of image is obtained to obtain a large amount of information carried by the video stream, so that a large amount of data can be transmitted between the first device and the second device.

Embodiment 2

To ensure data security during data transmission, the video stream in this embodiment of the present invention may be encrypted.

Optionally, the foregoing encryption process may refer to setting some or all of the data units in the first data into other data units through a pre-agreed encryption rule. For example, the data unit "00" is an encrypted data unit, and the data unit may be "01" or other data units before encryption.

As shown in Figure 6, a data transmission method is provided, including:

601. The second device acquires the first data to be transmitted, and encodes the first data to generate a video stream.

Optionally, the data type of the first data includes: at least one of an image data type, an audio data type, a video data type, and a text data type.

602. Play the video stream on the screen of the second device.

603. The first device collects pictures of each frame of images in the video stream played on the screen of the second device, and obtains M original images.

For the descriptions of the above 601 to 603, reference may be made to the descriptions of the above 401 to 403, which will not be repeated here.

604. The first device acquires a key associated with the video stream from the second device.

In this embodiment of the present invention, the second device transmits the key associated with the video stream, and correspondingly, the first device obtains the key associated with the video stream from the second device.

Wherein, there may be many ways to transmit the key between the first device and the second device.

The first possible implementation is as follows: the target frame image in the video stream includes a key, and the target frame image includes one or more frames of images; the first device obtains the key associated with the video stream from the second device. It may be: the first device decodes the first target image in the M original images to obtain the key, wherein the first target image is an image obtained by collecting a picture of the target frame image in the video stream.

Exemplarily, the actually carried data information may be obtained after calculation for the data information indicated in the pictures of the multi-frame images. For example, the first device can calculate the data information actually carried by the video stream through the frame difference method (data information in the previous frame or multiple frames minus the data information in the next frame or subsequent multiple frames), or other algorithms, In this way, it is necessary to continuously extract multiple frames of pictures for decryption to obtain the actually transmitted data. This method has better encryption effect and higher security.

In this implementation, the key can be carried in the video stream, so that the key and the actually transmitted data are transmitted through the video stream, so that the transmission device only needs to use a device for playing the video stream and a device for collecting the video stream. The device (that is, the transmitting end device needs to have a display function module, and the receiving end device needs to have an image acquisition module) can complete the transmission, without the cooperation of other devices, the transmission method is more concise, and the requirements for the device hardware are lower.

The second possible implementation manner is: the first device collects the audio signal played by the second device through the audio playback device, analyzes the audio signal, and obtains the key.

Optionally, the key may be an audio signal whose frequency is modulated, and the frequency data of the audio signal is used to indicate the content of the key. In this case, parsing the audio signal to obtain the key includes: obtaining the frequency data of the audio signal, determining the content of the key indicated by the frequency data of the audio signal, and decrypting the original data according to the content of the key to obtain the first data.

In this implementation, the key can be carried in the audio signal, so that the sender of the key can output the key through the speaker, and the receiver of the key can receive the key through the microphone, so that the data is transmitted through the video stream. Transmission, key transmission is carried out by means of audio signals, so that different data are transmitted in two transmission channels, which can improve the reliability of transmission.

The third possible implementation manner is: the second device can establish wireless communication through Bluetooth technology or WIFI technology, and then the second device sends the key to the terminal device.

605. The first device decodes the M original images according to the color displayed in each of the M original images, and obtains the original data corresponding to the M original images.

Optionally, for the above-mentioned first possible implementation manner, the first device can decrypt the second target image according to the key to obtain the first data, and the second target image is the M original images except the first target image. image.

606. The first device decrypts the original data according to the encryption key to obtain the first data.

In the embodiment of the present invention, the video stream is encrypted, so that the process of data transmission is more secure and reliable, thereby ensuring the security of data transmission on the basis of transmitting a large amount of data.

In a possible implementation, the first data includes first target data obtained after decoding each of the M original images, the first target data includes an image sequence number, and the image sequence number is used to indicate that the image corresponds to the first target data. The order in which the images are played in the video stream. After the above 606, it may further include: if the image sequence numbers included in the first data are not consecutive, the first device sends the missing target sequence number to the second device, so that the second device re-outputs the playback sequence in the video stream according to the target sequence number. The image corresponding to the target serial number. Correspondingly, the second device receives the target sequence number sent by the first device, and the second device resends images in the video stream whose playback order corresponds to the target sequence number according to the target sequence number.

In the above implementation manner, since the first data received by the first device can include the first target data obtained by decoding each original image, and the first target data includes the image serial number, there is a leakage of collection in practical applications. In the case of a certain frame of image in the video stream, the second device can replay the image corresponding to the image serial number by feeding back these missing image serial numbers to the second device, so that the first device can capture again, There is no need to retransmit the entire video stream, thereby improving the efficiency of data retransmission when data is missing.

In another possible implementation manner, optionally, after the above 606, the following steps may be further included:

607. The first device detects a target terminal device that is communicatively connected to the first device.

Optionally, the first device may detect all devices that are communicatively connected to the first device, and the above-mentioned target terminal device may be one or more terminal devices that are communicatively connected to the first device.

608. Detect the data type supported by the target terminal device.

Exemplarily, if the target terminal device is a display device, it can support image data, audio and text data, and video data; if the target terminal device is a speaker device, it can support audio data.

609. If the first data includes target data of the same type as the data supported by the target terminal device, send the target data to the target terminal device.

Exemplarily, assuming that the first data includes image data and audio data, the image data can be sent to the display device, and the audio data can be sent to the speaker device.

In this embodiment of the present invention, the first device may distribute data to the terminal device associated with the first device according to the data type, and only after determining the data type that the terminal device can support, send data of the data type supported by the terminal device to the terminal device, In order to avoid wasting data transmission resources when the type of data to be sent is not supported by the terminal device.

The above 609 may specifically include the following steps:

6091. If the first data includes target data of the same data type as that supported by the target terminal device, the first device determines whether the device identifier associated with the target data is the same as the device identifier of the target terminal device.

In practical applications, there may be multiple terminal devices that support a certain type of data. At this time, it can be detected whether the certain type of data is associated with a device ID. If there is no associated device ID, send the data to the multiple terminal devices. Send the data of the data type it supports; if the device ID is associated, then further determine whether the associated device ID is the same as the device ID of the target terminal device, and in the same case, the data of a certain type (ie the target data ) to the target terminal device.

6092. If the device identification associated with the target data is the same as the device identification of the target terminal device, the first device sends the target data to the target terminal device.

In the embodiment of the present invention, in the case where there are multiple terminal devices supporting the target data, the receiving end device during data distribution can be further specified according to the device identifier associated with the target data, and the device identifier associated with the target data can be further specified. Only when the device identification of the target terminal device is the same, the target data is sent to the target terminal device, which can improve the accuracy of data distribution.

Embodiment 3

The following describes a process of transmitting data between a sender and a receiver using the data transmission method provided by the embodiment of the present invention with reference to FIG. 7 .

701. Start.

702. Whether the handshake between the sender and the receiver is successful.

Among them, the handshake command can be transmitted through Bluetooth or WIFI technology to establish a communication connection. When the communication connection is successfully established, it means that the sender and the receiver have successfully shaken hands.

If successful, continue to perform the following steps 703 to 715; if it fails, the user may be guided to establish a connection with the peer device using WIFI or Bluetooth, and continue to perform the above 702 after a period of time.

703. The transmission instruction agrees on the sender and the receiver.

Optionally, the instructions involved in this implementation manner may be instructions transmitted through Bluetooth or WIFI technology.

That is to say, which device the sender and receiver are, can be agreed upon by the interaction of instructions between the two devices.

704. The receiver turns on the camera and the microphone.

705. The receiver informs the sender that the preparation is completed through an instruction.

Notifying the sender that the data is ready through the instruction can facilitate the sender to provide data in a timely manner, so as to prevent the data provided too early and cannot be received, or the data provided too late, which affects the efficiency of data transmission.

706. The sender turns on the screen to present the first frame of the video stream.

707. The sender informs the receiver that the preparation is completed through an instruction.

The sender informs the receiver that the preparation is complete through an instruction, which can let the receiver know that the sender knows that the sender is about to provide data and is ready to receive the data.

708. The sender's screen plays the video stream, and the speaker plays the audio key.

709. The receiver's camera collects the picture of the image in the video stream, and the microphone collects audio.

710. The sender informs the receiver that the sending is completed through an instruction.

After the sender informs the receiver that the transmission is completed through an instruction, the receiver can confirm whether the video data is complete based on the data it receives.

711. The receiver decrypts and parses the video stream by using the audio key, and confirms the video data.

712. The receiver judges whether the data is complete.

If it is not complete, execute the following 713 and continue to execute from 704 until the complete data is received and execute the following 714 and 715; if it is complete, execute the following 714 and 715 directly.

713. The receiver informs the sender to resend the missing part of the data through a Bluetooth command.

714. The receiver informs the sender that complete data has been received through an instruction.

715. End.

The above data transmission method can carry a large amount of data for transmission through video stream transmission, and can ensure the security of the transmitted data through the audio key, and when the data received by the receiver is incomplete, it can also notify the sender through an instruction, So that the sender can retransmit the missing data, thereby also ensuring the integrity of the data transmission.

The above data transmission method provided in the embodiment of the present invention can also be applied to data transmission between two or more smart phones, wherein one mobile phone can play the video stream obtained by encoding the first data on the screen, and the other The mobile phone or multiple mobile phones turn on the cameras at the same time to collect the picture of each frame of image in the video stream, and then sequentially decode the original image obtained after collecting the picture of each frame of image to obtain the first data.

The data transmission method in the embodiment of the present invention can be applied to various scenarios involving data transmission in real life. For example, smart home scenarios, stage control scenarios, etc.

Scenario 1: When the data transmission method provided by the embodiment of the present invention is applied in a smart home scenario, the above-mentioned first device may be a smart door lock, and the above-mentioned second device may be a mobile phone.

When the user needs to open the smart door lock in the smart home scenario, the mobile phone can play a video stream that has been specially encoded and encrypted for the unlocking data on the screen, and play the audio signal associated with the video stream through the speaker of the mobile phone (the audio signal The frequency data can be used to indicate the content of the key), at this time, the smart door lock with a camera can collect each frame of the image in the video stream played on the mobile phone through the camera to obtain the original data, and then analyze the original image. Decode to obtain the first data; the smart door lock can collect the audio signal through the microphone, then obtain the key content by analyzing the frequency data of the audio signal, and decrypt according to the key content to obtain the unlocking data, and finally obtain the The unlocking data of the device is compared with the pre-stored unlocking data. When it matches, the smart door lock is opened, and when it does not match, it is forbidden to open the smart door lock.

In this smart home scenario, the data transmission method provided by the embodiment of the present invention is applied to unlock, which is different from the traditional unlocking method (for example, fingerprint, password, etc.) performance in human-computer interaction.

Further, in the smart home scenario, smart door locks can also achieve more functions. Exemplary, can include:

When the smart door lock detects a visitor outside the smart door lock, it can obtain the visitor's personal characteristic information;

If the personal feature information of the visitor does not match the pre-stored trusted personal feature information, it is determined whether the user inside the smart door lock belongs to the preset protected user; among them, the smart door lock detects the presence of a visitor outside the smart door lock by detecting Whether there is an operation of the user touching the smart door lock, it can also be checked whether there is a user staying outside the door for a time longer than a preset time; the protected user can be a woman, the elderly or a child;

If the user inside the smart door lock belongs to the preset protected user, obtain the external confusion voice of the designated user pre-configured for the protected user, and the external confusion voice is used to confuse the identity of the visitor, so that the visitor thinks that the designated user is located in the smart door Inside the lock; the designated user can be a parent, guardian or a male in the family.

And, control the smart door lock to play external confusing sounds, and prohibit the smart door lock from performing the door opening operation.

In the above implementation manner, the smart door lock can detect whether the person at home is a protected user such as a woman, the elderly or a child when it is determined that there is a visitor coming and is an unfamiliar visitor. Play the external confusing sound of the designated user to make visitors think that there are parents, guardians or men in the home to ensure the safety of the people in the home.

Optionally, the visitor's personal feature information includes: the visitor's face image information and the visitor's voice information;

After obtaining the visitor's personal characteristic information, the method also includes:

If the visitor's personal feature information does not match the pre-stored trusted personal feature information, send the visitor's face image information to the display device inside the smart door lock, and send the visitor's voice information to the speaker device inside the smart door lock;

The display device inside the smart door lock displays the user's face image information, and the speaker device inside the smart door lock plays the visitor's voice information.

Optionally, after acquiring the personal characteristic information of the visitor, the method further includes:

If the personal characteristic information of the visitor does not match the pre-stored trusted personal characteristic information, the monitoring screen outside the smart door lock is acquired, and the monitoring screen is sent to the display device inside the smart door lock.

In the above implementation manner, when it is determined that the visitor is an unfamiliar visitor, the smart door lock can send the relevant information of the visitor to other terminal devices in the home (such as display devices, speaker devices, etc.), so that people at home can know the visitor's situation, The smart home equipment can provide users with information flexibly and improve the performance of human-computer interaction.

Optionally, after the smart door lock acquires the personal characteristic information of the visitor, the method further includes:

If the personal characteristic information of the visitor does not match the pre-stored trusted personal characteristic information, determine whether there is a terminal device of an emergency contact associated with the smart door lock;

If it exists, acquire the monitoring picture outside the smart door lock, and send the monitoring picture outside the smart door lock to the terminal device of the emergency contact.

In the above implementation manner, when it is determined that the visitor is an unfamiliar visitor, the smart door lock can also send the relevant information of the visitor to the terminal device of the emergency contact associated with the smart door lock, so that the emergency contact can know the situation of the visitor, so that the Smart home devices can provide users with information flexibly and improve human-computer interaction performance.

Scenario 2: When the data transmission method provided by the embodiment of the present invention is applied in a stage control scenario, the above-mentioned first device may be a stage control device, and the stage control device may be connected to a terminal device (for example, a large screen, an audio device) on the stage. , lighting device), and the second device may be a mobile terminal device (for example, a mobile phone). The mobile phone can encode and encrypt the local stage control data to generate a video stream, and play the video stream within the range that can be captured by the stage control device. screen, then obtain the original data, analyze the original data to obtain the first control data, and the stage control device can collect the audio signal associated with the video stream through the microphone (the frequency data of the audio signal can be used to indicate the key content), Then, the key content is obtained by analyzing the frequency data of the audio signal, and the first control data is decrypted according to the key content to obtain the stage control data, and then the stage control device distributes the stage control data to the connected terminal devices. .

Assuming that the stage control data includes: image data, audio data and lighting control data (ie lighting control instructions) the stage control device distributing the stage control data to its connected terminal equipment may include: the stage control device sending the image data to the large screen, In order to make the image corresponding to the image data displayed on the large screen; the stage control equipment sends the audio data to the audio equipment, so that the audio equipment plays the audio signal corresponding to the audio data; the stage control equipment sends the lighting control instructions to the lighting equipment to control Changes in the color and intensity of lighting equipment.

When the data transmission method provided by the embodiment of the present invention is applied in a stage control scene, the data in the mobile terminal device that can be moved flexibly is transmitted to the stage control device, and the large screen, audio equipment and Lighting equipment distributes data, which can not only achieve relatively safe large-scale data transmission, but also store some common stage control data in mobile terminal devices that can move flexibly, which can easily carry stage control data to different stage systems. data reuse.

As shown in FIG. 8 , an embodiment of the present invention provides a first device, where the first device includes:

The receiving module 801 is used to collect the picture of each frame of image in the video stream played on the screen of the second device, and obtain M original images, the video stream is generated by encoding the first data, and the video stream includes M frames of images , each frame of image in the video stream includes N image display areas, and each image display area indicates a data unit in the first data;

The processing module 802 is configured to decode the M original images to obtain first data.

Optionally, each image display area indicates a data unit in the first data through a displayed color.

Optionally, the video stream is encrypted;

The receiving module 801 is further configured to obtain the key associated with the video stream from the second device before the processing module 802 decodes the M original images to obtain the first data;

The processing module 802 is specifically used for the first device to decode the M original images according to the color displayed in each of the M original images, and obtain the original data corresponding to the M original images;

Decrypt the original data according to the key to obtain the first data.

Optionally, the target frame image in the video stream includes a key, and the target frame image includes one or more frames of images;

The receiving module 801 is specifically configured to decode the first target image in the M original images to obtain a key, wherein the first target image is an image obtained by collecting a picture of the target frame image in the video stream;

The processing module 802 is specifically configured to decrypt the second target image according to the key to obtain the first data, where the second target image is an image other than the first target image among the M original images.

Optionally, the receiving module 801 is specifically configured to collect the audio signal played by the second device through the audio playback device;

Parse the audio signal to obtain the key.

Optionally, the key is an audio signal whose frequency is modulated, and the frequency data of the audio signal is used to indicate the content of the key;

The receiving module 801 is specifically configured to obtain frequency data of the audio signal;

determine the key content indicated by the frequency data of the audio signal;

Decrypt the original data according to the key content to obtain the first data.

Optionally, the first data includes first target data obtained after decoding each of the M original images, the first target data includes an image sequence number, and the image sequence number is used to indicate that the image corresponding to the first target data is in the video. the playback order in the stream;

The first device also includes:

The sending module 803, configured to decode the M original images in the processing module 802 to obtain the first data, further includes:

If the image sequence numbers included in the first data are discontinuous, the missing target sequence numbers are sent to the second device, so that the second device re-outputs images in the video stream whose playback order corresponds to the target sequence numbers according to the target sequence numbers.

Optionally, the data type of the first data includes: at least one of an image data type, an audio data type, a video data type and a text data type;

The sending module 803 is also used for the first device to detect the target terminal device that is communicatively connected to the first device; to detect the data type supported by the target terminal device; if the first data includes a target with the same data type supported by the target terminal device data, then send the target data to the target terminal device.

Optionally, the sending module 803 is further configured to determine whether the device identifier associated with the target data is the same as the device identifier of the target terminal device if the first data includes the same target data as the data type supported by the target terminal device;

If the device identification associated with the target data is the same as the device identification of the target terminal device, the target data is sent to the target terminal device.

As shown in FIG. 9, an embodiment of the present invention provides a second device, including:

an acquisition module 901, configured to acquire the first data to be transmitted, and encode the first data to generate a video stream;

Playing module 902, for playing a video stream on the screen, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates a data unit in the first data, In order to facilitate the first device to collect the picture of each frame of image in the video stream played on the screen of the second device, to obtain M original images, and to decode the M original images to obtain the first data, wherein M and N is an integer greater than or equal to 2.

Optionally, the video stream is encrypted, and the playback module 902 transmits the key associated with the video stream, so that the first device obtains the key associated with the video stream from the second device, and the first device According to the color displayed in each of the M original images, the M original images are decoded to obtain the original data corresponding to the M original images; the original data is decrypted according to the key to obtain the first data.

Optionally, the second device further includes: a receiving module 903 for receiving the target sequence number sent by the first device after the playback module 902 plays the video stream on the screen, where the target sequence number is the number of images of each frame of the video stream captured by the first device. picture, the image sequence number that is missing in the image sequence numbers included in the obtained M original images; resend the image corresponding to the playback sequence and the target sequence number in the video stream according to the target sequence number.

Optionally, both the first device and the second device provided in this embodiment of the present invention may be mobile phones. Exemplarily, as shown in FIG. 10, the mobile phone may include: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity ( Wireless fidelity, WiFi) module 1070, processor 1080, and power supply 1090 and other components. The radio frequency circuit 1010 includes a receiver 1011 and a transmitter 1012 . Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 10 does not constitute a limitation on the mobile phone, and may include more or less components than the one shown, or combine some components, or arrange different components.

The RF circuit 1010 can be used to receive and transmit signals during information transmission and reception or during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 1080; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1010 can also communicate with networks and other devices via wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to the global system of mobile communication (global system of mobile communication, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access) multiple access, CDMA), wideband code division multiple access (WCDMA), long term evolution (long term evolution, LTE), email, short message service (short messaging service, SMS) and so on.

The memory 1020 can be used to store software programs and modules, and the processor 1080 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1020 . The memory 1020 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 1020 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1030 can be used for receiving inputted number or character information, and generating key signal input related to user setting and function control of the mobile phone. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032 . The touch panel 1031, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on or near the touch panel 1031). operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 1031 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 1080, and can receive the command sent by the processor 1080 and execute it. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. Besides the touch panel 1031 , the input unit 1030 may also include other input devices 1032 . Specifically, other input devices 1032 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, and the like.

The display unit 1040 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1040 may include a display panel 1041. Optionally, the display panel 1041 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 1031 may cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near it, it transmits it to the processor 1080 to determine the type of the touch event, and then the processor 1080 determines the type of the touch event according to the touch event Type provides corresponding visual output on display panel 1041 . Although in FIG. 10, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated to form Realize the input and output functions of the mobile phone.

The cell phone may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1041 and/or when the mobile phone is moved to the ear. or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when it is stationary. games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. Repeat. In this embodiment of the present invention, the terminal device may include an acceleration sensor, a depth sensor, or a distance sensor, or the like.

The audio circuit 1060, the speaker 1061, and the microphone 1062 can provide an audio interface between the user and the mobile phone. The audio circuit 1060 can convert the received audio data into an electrical signal, and transmit it to the speaker 1061, and the speaker 1061 converts it into a sound signal and outputs it; After receiving, it is converted into audio data, and then the audio data is output to the processor 1080 for processing, and then sent to, for example, another mobile phone through the RF circuit 1010, or the audio data is output to the memory 1020 for further processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 1070, which provides users with wireless broadband Internet access. Although FIG. 10 shows the WiFi module 1070, it can be understood that it is not a necessary component of the mobile phone, and can be completely omitted as required within the scope of not changing the essence of the invention.

The processor 1080 is the control center of the mobile phone, and uses various interfaces and lines to connect various parts of the entire mobile phone, by running or executing the software programs and/or modules stored in the memory 1020, and calling the data stored in the memory 1020. Various functions of the mobile phone and processing data, so as to monitor the mobile phone as a whole. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc. , the modem processor mainly deals with wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 1080.

The mobile phone also includes a power supply 1090 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1080 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system. Although not shown, the mobile phone may also include a camera, a Bluetooth module, and the like, which will not be repeated here.

In this embodiment of the present invention, the above-mentioned mobile phone may further include a camera, and the camera may be used to capture a video stream by using the camera. Each frame of image in the video stream includes a plurality of image display areas, and each image display area can be carried by the displayed color indication. data information;

Each process involved in the above-mentioned first device can be implemented through the above-mentioned devices such as the processor 1080, the audio circuit 1060, the RF circuit 1010, the input unit 1030, the WiFi module 1070, and the display unit 1040, or the above-mentioned second device can be implemented. each process.

Embodiments of the present invention further provide a first device, which may include: a processor, a memory, and a computer program stored in the memory and running on the processor, where the computer program can implement the above when executed by the processor Each process performed by the first device in the method embodiment can achieve the same technical effect. To avoid repetition, details are not repeated here.

An embodiment of the present invention further provides a second device, the second device may include: a processor, a memory, and a computer program stored in the memory and running on the processor, the computer program being executed by the processor can implement the above-mentioned Each process performed by the second device in the method embodiment can achieve the same technical effect. To avoid repetition, details are not described here.

Embodiments of the present invention provide a computer-readable storage medium, characterized in that, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, each process performed by the first device in the foregoing method embodiments is implemented.

Embodiments of the present invention provide a computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, each process performed by the second device in the foregoing method embodiments is implemented.

The first device, the second device, and the storage medium provided in the embodiment of the present invention can achieve the same technical effect as the data transmission method protected in the Shanghai Defense embodiment. To avoid repetition, the technical effect will not be repeated here.

Wherein, the computer-readable storage medium may be a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk, an optical disk, or the like.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods of the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from

Within the scope of protection of the spirit of the present invention and the claims, many forms can also be made, which all fall within the protection of the present invention.

Claims

A data transmission method, comprising:

The first device collects the picture of each frame of image in the video stream played on the screen of the second device, and obtains M original images, the video stream is generated by encoding the first data, and the video stream includes M frames an image, each frame of image in the video stream includes N image display areas, each image display area indicates a data unit in the first data, wherein M and N are integers greater than or equal to 2;

The first device decodes the M original images to obtain the first data.
The method according to claim 1, wherein each image display area indicates a data unit in the first data through a displayed color.
The method according to claim 2, wherein the video stream is encrypted;

Before the first device decodes the M original images to obtain the first data, the method further includes:

the first device obtains a key associated with the video stream from the second device;

The first device decodes the M original images to obtain the first data, including:

The first device decodes the M original images according to the color displayed in each of the M original images, and obtains the original data corresponding to the M original images;

Decrypt the original data according to the key to obtain the first data.
The method according to claim 3, wherein the key is included in the target frame image in the video stream, and the target frame image includes one or more frames of images;

Obtaining, by the first device, a key associated with the video stream from the second device includes: the first device decoding a first target image in the M original images to obtain the the key, wherein the first target image is an image obtained by collecting a picture of the target frame image in the video stream;

The first device decodes the M original images to obtain the first data, including:

Decrypt a second target image according to the key to obtain the first data, where the second target image is an image other than the first target image among the M original images.
The method according to claim 3, wherein the obtaining, by the first device, a key associated with the video stream from the second device comprises:

The first device collects the audio signal played by the second device through the audio playback device;

The audio signal is parsed to obtain the key.
The method according to claim 5, wherein the key is an audio signal whose frequency is modulated, and the frequency data of the audio signal is used to indicate the content of the key;

The parsing of the audio signal to obtain the key includes:

obtain frequency data of the audio signal;

determining the key content indicated by the frequency data of the audio signal;

Decrypt the original data according to the key content to obtain the first data.
The method according to claim 1, wherein the first data includes first target data obtained after decoding each of the M original images, and the first target data includes an image sequence number, The image sequence number is used to indicate the playback sequence of the image corresponding to the first target data in the video stream;

After the first device decodes the M original images to obtain the first data, the method further includes:

If the image sequence numbers included in the first data are not consecutive, the first device sends the missing target sequence numbers to the second device, so that the second device re-outputs the target sequence numbers according to the target sequence numbers. The images in the video stream whose playback order corresponds to the target sequence number.
The method according to any one of claims 1 to 7, wherein the data type of the first data comprises: at least one of an image data type, an audio data type, a video data type and a text data type;

After the first device decodes the M original images to obtain the first data, the method further includes:

The first device detects a target terminal device that is communicatively connected to the first device;

Detecting the data type supported by the target terminal device;

If the first data includes target data of the same data type as that supported by the target terminal device, the target data is sent to the target terminal device.
The method according to claim 8, wherein if the first data includes target data of the same data type as that supported by the target terminal device, sending the target data to the target terminal device ,include:

If the first data includes the same target data as the data type supported by the target terminal device, then determine whether the device identifier associated with the target data is the same as the device identifier of the target terminal device;

If the device identification associated with the target data is the same as the device identification of the target terminal device, the target data is sent to the target terminal device.
A data transmission method, comprising:

The second device obtains the first data to be transmitted, and encodes the first data to generate a video stream;

The video stream is played on the screen of the second device, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates that in the first data a data unit, so that the first device collects the picture of each frame of the image in the video stream played on the screen of the second device, obtains M original images, and decodes the M original images, to obtain the first data, wherein M and N are integers greater than or equal to 2.
The method according to claim 10, wherein each image display area indicates a data unit in the first data through a displayed color.
The method according to claim 11, wherein the video stream is encrypted, and the method further comprises:

The second device transmits the key associated with the video stream, so that the first device obtains the key associated with the video stream from the second device, and the first device according to The color displayed in each of the M original images, decode the M original images, and obtain the original data corresponding to the M original images; decrypt the original data according to the key to obtain the first data.
The method according to claim 11 or 12, wherein after the video stream is played on the screen of the second device, the method further comprises:

The second device receives the target sequence number sent by the first device, and the target sequence number is the image of each frame of the video stream captured by the first device, and the image sequence numbers included in the obtained M original images are included. The missing image sequence number;

The second device resends, according to the target sequence number, images in the video stream whose playback order corresponds to the target sequence number.
A first device, characterized in that it includes:

The receiving module is used to collect the picture of each frame of image in the video stream played on the screen of the second device, and obtain M original images, the video stream is generated by encoding the first data, and the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates a data unit in the first data;

a processing module, configured to decode the M original images to obtain the first data.
A second device, comprising:

a processing module, configured to obtain the first data to be transmitted, and encode the first data to generate a video stream;

A playback module, configured to play the video stream on the screen, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates the first A data unit in the data, so that the first device collects the picture of each frame of the image in the video stream played on the screen of the second device, obtains M original images, and performs the processing on the M original images. decoding to obtain the first data.
A first device, characterized by comprising: a processor, a memory, and a computer program stored on the memory and executable on the processor, when the computer program is executed by the processor, the The processor is used to perform the following steps:

Collect the picture of each frame of image in the video stream played on the screen of the second device, and obtain M original images, the video stream is generated by encoding the first data, and the video stream includes M frames of images, so Each frame of image in the video stream includes N image display areas, and each image display area indicates a data unit in the first data;

The M original images are decoded to obtain the first data.
The first device according to claim 16, wherein each image display area indicates a data unit in the first data through a displayed color.
The first device according to claim 17, wherein the video stream is encrypted;

The processor is further configured to obtain a key associated with the video stream from the second device before decoding the M original images to obtain the first data;

The processor is specifically configured to decode the M original images according to the color displayed in each of the M original images, and obtain the original data corresponding to the M original images;

Decrypt the original data according to the key to obtain the first data.
The first device according to claim 18, wherein the key is included in the target frame image in the video stream, and the target frame image includes one or more frames of images;

The processor is specifically configured to obtain the key associated with the video stream from the second device, including: the first device decoding the first target image in the M original images, to obtain the key, wherein the first target image is an image obtained by collecting the image of the target frame image in the video stream; decrypt the second target image according to the key to obtain the first target image. A piece of data, wherein the second target image is an image other than the first target image among the M original images.
The first device according to claim 18, wherein the processor is specifically configured for the first device to collect an audio signal played by the second device through an audio playback device; and to analyze the audio signal , to obtain the key.
The first device according to claim 20, wherein the key is an audio signal whose frequency is modulated, and the frequency data of the audio signal is used to indicate the content of the key; the processor is specifically configured to obtain frequency data of the audio signal; determine the key content indicated by the frequency data of the audio signal; decrypt the original data according to the key content to obtain the first data.
The first device according to claim 16, wherein the first data includes first target data obtained after decoding each of the M original images, and the first target data includes an image serial number, the image serial number is used to indicate the playback order of the images corresponding to the first target data in the video stream; the processor is also used to decode the M original images to obtain the After the first data, if the image sequence numbers included in the first data are discontinuous, the first device sends the missing target sequence numbers to the second device, so that the second device can The target sequence number re-outputs the images in the video stream whose playback order corresponds to the target sequence number.
The first device according to any one of claims 16 to 22, wherein the data type of the first data comprises: at least one of an image data type, an audio data type, a video data type, and a text data type ;

The processor is further configured to decode the M original images to obtain the first data, and then the first device detects a target terminal device that is communicatively connected to the first device; detects the target The data type supported by the terminal device; if the first data includes target data of the same data type as the data type supported by the target terminal device, the target data is sent to the target terminal device.
The first device according to claim 23, wherein the processor is specifically configured to, if the first data includes target data of the same data type as the data type supported by the target terminal device, determine the Whether the device identification associated with the target data is the same as the device identification of the target terminal device; if the device identification associated with the target data is the same as the device identification of the target terminal device, send the target data to the target terminal device. the target terminal device.
A second device, comprising: a processor, a memory, and a computer program stored on the memory and executable on the processor, when the computer program is executed by the processor, the The processor is used to perform the following steps:

Obtain the first data to be transmitted, and encode the first data to generate a video stream;

Controlling to play the video stream on the screen, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates one of the first data A data unit, so that the first device collects the picture of each frame of the image in the video stream played on the screen of the second device, obtains M original images, and decodes the M original images to obtain In the first data, M and N are integers greater than or equal to 2.
26. The second device according to claim 25, wherein each image display area indicates a data unit in the first data by a displayed color.
The second device according to claim 26, wherein the video stream is encrypted;

The processor is further configured to transmit a key associated with the video stream, so that the first device obtains the key associated with the video stream from the second device, and the first device A device decodes the M original images according to the color displayed in each of the M original images, and obtains the original data corresponding to the M original images; decrypts the original data according to the key , to obtain the first data.
The second device according to claim 27, wherein the processor is further configured to control, after the video stream is played on the screen, to receive a target sequence number sent by the first device, where the target sequence number is the first A device collects the picture of each frame of the video stream, and obtains the missing image sequence number in the image sequence numbers included in the M original images; resends the playback sequence and the target sequence number in the video stream according to the target sequence number. the corresponding image.
A data transmission system, characterized by comprising: the first device as claimed in any one of claims 16 to 24 or claim 14, and the first device as claimed in any one of claims 25 to 28 or claim 15 second device.
A computer-readable storage medium, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the data transmission according to any one of claims 1 to 9 is implemented The steps of the method, or, the steps of implementing the data transmission method as claimed in any one of claims 10 to 13.