CN111125426A

CN111125426A - Data storage and query method and device

Info

Publication number: CN111125426A
Application number: CN201911329856.2A
Authority: CN
Inventors: 陈鑫; 王艳辉; 亓娜; 任双双
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-12-20
Filing date: 2019-12-20
Publication date: 2020-05-08
Anticipated expiration: 2039-12-20
Also published as: CN111125426B

Abstract

The embodiment of the invention provides a method and a device for storing and querying data. The data storage method comprises the following steps: acquiring target data information; the target data information comprises data content and identification information corresponding to the data content; storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet; sending the video networking data packet to a second server through the video networking so that the second server stores the data content according to a second storage path generated in advance and returns the data content to the second storage path; and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information. The embodiment of the invention not only can realize the backup storage of the data in the video network, but also is convenient for the follow-up query of the stored data.

Description

Data storage and query method and device

Technical Field

The present invention relates to the field of data storage and query, and in particular, to a method and an apparatus for data storage and query.

Background

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video. In order to prevent data loss in the video network, a copy of data can be backed up in a different video network server.

However, the data backup in the current video network is limited to the storage of data; and does not involve a subsequent query procedure that may be performed. Therefore, the current mode of backing up or storing the data is inconvenient for subsequent query operation.

Disclosure of Invention

In view of the above, embodiments of the present invention are proposed in order to provide a method and apparatus for data storage and querying that overcomes or at least partially solves the above mentioned problems.

In a first aspect, an embodiment of the present invention discloses a data storage method, which is applied to a first server, and the method includes:

acquiring target data information; the target data information comprises data content and identification information corresponding to the data content;

storing the data content according to a first storage path generated in advance, and encapsulating the target data information through a video networking protocol to obtain a video networking data packet;

sending the video networking data packet to a second server through a video networking so that the second server analyzes the video networking data packet to obtain the target data information, storing data contents in the target data information according to a pre-generated second storage path, and returning to the second storage path;

and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information.

Optionally, the first server is preset with configuration information, where the configuration information includes a terminal number of a first video networking virtual terminal arranged on the first server and a terminal number of a second video networking virtual terminal arranged on the second server;

the destination virtual terminal number protocol field of the video networking data packet stores the terminal number of the second video networking virtual terminal; and the source virtual terminal number protocol field stores the terminal number of the first video network virtual terminal.

Optionally, the step of sending the internet-of-video data packet to the second server through the internet of video includes:

and the first video networking virtual terminal sends the video networking data packet to the second video networking virtual terminal through the video networking.

Optionally, the step of sending the video networking data packet to the second video networking virtual terminal by the first video networking virtual terminal through the video networking includes:

and the first video network virtual terminal sends the video network data packet to the second video network virtual terminal in a packet sending mode through the video network.

Optionally, the data content is a log file; the identification information is at least one of a unique identification of a source server of the log file, a name of the log file and a type of the log file.

Optionally, the step of storing the data content according to a first storage path generated in advance, and encapsulating the target data information by using a video networking protocol to obtain a video networking data packet includes:

encrypting the log file according to a preset encryption algorithm to obtain an encrypted log file;

storing the encrypted log file according to a first storage path generated in advance;

and packaging the encrypted log file and the identification information through a video networking protocol to obtain a video networking data packet.

Optionally, after the step of encrypting the log file according to a preset encryption algorithm to obtain an encrypted log file, the method further includes:

and generating a file check code of the encrypted log file according to a preset check algorithm.

In a second aspect, an embodiment of the present invention further discloses a data query method, applied to a first server, where the method includes:

sending the video networking data packet to a second server through a video networking so that the second server analyzes the video networking data packet to obtain the target data information, storing the data content in the target data information according to a pre-generated second storage path process, and returning to the second storage path;

receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information;

when an inquiry request sent by terminal equipment is received, determining a target index according to an inquiry condition carried in the inquiry request, wherein the target index is an index meeting the inquiry condition;

obtaining, in the first server, data content indicated by the first storage path in the target index; or acquiring the data content indicated by the second storage path in the target index in the second server;

and returning the acquired data content to the terminal equipment.

In a third aspect, an embodiment of the present invention further discloses a data storage apparatus, which is applied to a first server, and the apparatus includes:

the acquisition module is used for acquiring target data information; the target data information comprises data content and identification information corresponding to the data content;

the processing module is used for storing the data content according to a first storage path generated in advance, and packaging the target data information through a video networking protocol to obtain a video networking data packet;

the sending module is used for sending the video networking data packet to a second server through a video networking so that the second server can analyze the video networking data packet to obtain the target data information, store the data content in the target data information according to a pre-generated second storage path and return the data content to the second storage path;

and the index module is used for receiving the second storage path and generating an index of the target data information according to the second storage path, the first storage path and the identification information.

Optionally, the sending module is specifically configured to control the first video networking virtual terminal to send the video networking data packet to the second video networking virtual terminal through the video networking.

Optionally, the sending module is specifically configured to control the first video networking virtual terminal to send the video networking data packet to the second video networking virtual terminal in a packet sending manner through the video networking.

Optionally, the processing module includes:

the encryption unit is used for encrypting the log file according to a preset encryption algorithm to obtain an encrypted log file;

the path unit is used for storing the encrypted log file according to a first storage path generated in advance;

and the packaging unit is used for packaging the encrypted log file and the identification information through a video networking protocol to obtain a video networking data packet.

Optionally, the apparatus further comprises:

and the check code module is used for generating a file check code of the encrypted log file according to a preset check algorithm.

In a fourth aspect, an embodiment of the present invention further discloses a data query apparatus, which is applied to a first server, and the apparatus includes:

the index module is used for receiving the second storage path and generating an index of the target data information according to the second storage path, the first storage path and the identification information;

the device comprises a determining module, a searching module and a searching module, wherein the determining module is used for determining a target index according to a searching condition carried in a searching request when the searching request sent by terminal equipment is received, and the target index is an index meeting the searching condition;

the query module is used for acquiring the data content indicated by the first storage path in the target index in the first server; or acquiring the data content indicated by the second storage path in the target index in the second server;

and the feedback module is used for returning the acquired data content to the terminal equipment.

In a fifth aspect, an embodiment of the present invention further discloses an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the method of the first aspect or the second aspect is implemented.

In a sixth aspect, an embodiment of the present invention further discloses a computer-readable storage medium, where a computer program for executing the method in the first aspect or the second aspect is stored in the computer-readable storage medium.

The method and the device for storing and querying the data, provided by the embodiment of the invention, are used for acquiring target data information; the target data information comprises data content and identification information corresponding to the data content; and storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet. And storing the data content according to the first storage path, so that the data content stored in the data content can be found according to the first storage path. The video networking data packet obtained after the video networking protocol is packaged can be transmitted under the video networking environment. Sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing data contents in the target data information according to a pre-generated second storage path, and returning to the second storage path; and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information. When multiple pieces of target data information are acquired, an index is generated corresponding to each piece of target data information. Therefore, in the query process, the corresponding storage path can be found only by determining the corresponding index according to the query condition, and the required data can be obtained. The invention not only can realize the backup storage of the data in the video network, but also is convenient for the follow-up inquiry of the stored data.

Drawings

FIG. 1 is a schematic diagram of method steps for data storage according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of method steps for querying data according to an embodiment of the present invention;

FIG. 3 is a signal transmission diagram of a method for data query according to an embodiment of the present invention;

FIG. 4 is an application architecture diagram of a method for data query provided by an embodiment of the present invention;

FIG. 5 is a schematic diagram of an apparatus for data storage according to an embodiment of the present invention;

FIG. 6 is a diagram of an apparatus for querying data according to an embodiment of the present invention;

FIG. 7 is a networking diagram of a video network provided by an embodiment of the invention;

fig. 8 is a schematic hardware structure diagram of a node server according to an embodiment of the present invention;

fig. 9 is a schematic hardware structure diagram of an access switch according to an embodiment of the present invention;

fig. 10 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Fig. 1 illustrates a method for storing data, applied to a first server, according to an embodiment of the present invention, the method includes the following steps:

step 101, target data information is obtained.

It should be noted that the target data information includes data content and identification information of the corresponding data content; the data content is data to be stored, and the identification information and the data content are in one-to-one correspondence, that is, the unique data content can be determined according to the identification information. The identification information may be information related to the data content, and may be, for example, a name, a type, and the like of the data content. But may of course also be coded independently of the data content. The first server can actively acquire the target data information and can also passively receive the target data information pushed by other equipment.

And 102, storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet.

It should be noted that different data content may be stored in the same or different first storage paths. A first storage path can be generated according to the identification information, so that the data content is stored; or a path generation rule may be configured in advance, after the target data information is acquired, a first storage path is generated according to the preconfigured path generation rule, and then the target data information is stored according to the first storage path. Of course, a path information table including a plurality of first storage paths may be configured in advance, and after the target data information is acquired, the first storage paths in the target data information are sequentially extracted according to the path information table, so as to store the target data information.

In order to enable the target data information to be transmitted in the video networking environment, the target data information needs to be encapsulated through a video networking protocol, so that a video networking data packet which can be transmitted in the video networking environment is generated.

And 103, sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing the data content in the target data information according to a pre-generated second storage path, and returning to the second storage path.

It should be noted that data interaction between the first server and the second server can be performed through the video network. After the second server stores the data content, the second server needs to inform the first server of the second storage path, so that the data content stored in the second server can be directly acquired through the first server through the second storage path.

And 104, receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information.

It should be noted that the index includes the second storage path, the first storage path, and the identification information. Each piece of target data information corresponds to an index. When querying the data content, the index may be determined according to the identification information corresponding to the data content, and then the first storage path and the second storage path may be obtained through the determined index, so as to obtain the required data content. The data content stored in the first storage path and the second storage path is the same and is the required data content. And if the data content can not be acquired in one of the storage paths, the data content can be acquired through the rest storage paths.

After the index is generated, the index may be sent to the database for storage, or may be stored in the first server.

In the embodiment of the invention, target data information is obtained; the target data information comprises data content and identification information corresponding to the data content; and storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet. And storing the data content according to the first storage path, so that the data content stored in the data content can be found according to the first storage path. The video networking data packet obtained after the video networking protocol is packaged can be transmitted under the video networking environment. Sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing data contents in the target data information according to a pre-generated second storage path, and returning to the second storage path; and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information. When multiple pieces of target data information are acquired, an index is generated corresponding to each piece of target data information. Therefore, in the query process, the corresponding storage path can be found only by determining the corresponding index according to the query condition, and the required data can be obtained. The invention not only can realize the backup storage of the data in the video network, but also is convenient for the follow-up inquiry of the stored data.

In order to conveniently adjust a second server for backing up and storing data contents, on the basis of the embodiment of the invention, in the embodiment of the invention, the first server is preset with configuration information, and the configuration information comprises a terminal number of a first video network virtual terminal arranged on the first server and a terminal number of a second video network virtual terminal arranged on the second server;

the destination virtual terminal number protocol field of the video networking data packet stores the terminal number of the second video networking virtual terminal; the source virtual terminal number protocol field stores the terminal number of the first video network virtual terminal.

It should be noted that the first server and the second server storing the data content may be adjusted by adjusting the configuration information. The number of the second servers may be multiple, and the configuration information includes the terminal numbers of the multiple second virtual terminals.

Preferably, the step of sending the video networking data packet to the second server via the video networking comprises: the first video network virtual terminal sends the video network data packet to the second video network virtual terminal through the video network.

In order to improve the transmission efficiency of the video networking data packets, on the basis of the embodiment of the present invention, in the embodiment of the present invention, the step of sending the video networking data packets to the second video networking virtual terminal by the first video networking virtual terminal through the video networking includes:

the first video network virtual terminal sends the video network data packets to the second video network virtual terminal in a packet sending mode through the video network.

It should be noted that each video networking packet is divided into a plurality of packets and then sent in batches. Preferably, after receiving each batch of data packets, the second virtual terminal of the video network determines whether the number of the data packets is consistent with the total number of the packets, and if not, the second virtual terminal of the video network notifies the first virtual terminal of resending the batch of data packets, and if so, the second virtual terminal of the video network continues to receive the next batch of data packets. And when the received data packets of all the batches have no problem, combining and storing the data packets of all the batches, and sending a mark of successful backup to the first video network virtual terminal after successful storage. And of course, if the second video network virtual terminal informs the first video network virtual terminal that the number of times of retransmitting the data packets exceeds the preset threshold value, the first video network virtual terminal is controlled to stop transmitting the data packets to the second video network virtual terminal, and the identification information of the backup failure is generated or the identification information of the backup failure is generated by the second video network virtual terminal and is transmitted to the first video network virtual terminal. Preferably, identification information of the backup success and the backup failure may also be added to the index when the index is generated. The preset threshold may be 3, but is not limited thereto.

On the basis of the above embodiments of the present invention, in the embodiments of the present invention, the data content is a log file; the identification information is at least one of a unique identification of a source server of the log file, a name of the log file, and a type of the log file.

It should be noted that when the first server is a log management server, the second server is a remote storage server. The log management server can acquire various types of log files, then save the log files locally, and backup the log files in a remote storage server. Preferably, the identification information is a unique identification of a source server of the log file, a name of the log file, and a type of the log file. In generating the first storage path according to the identification information, a first storage path of "unique identification of origin server" - > "year-month" - > "filename-year-month-day, log" may be generated, where "year-month" and "year-month-day" are specific times of the received log file.

To further improve security, on the basis of the foregoing embodiments of the present invention, in the embodiments of the present invention, the step of storing data content according to a first storage path generated in advance, and encapsulating target data information by using a video networking protocol to obtain a video networking data packet includes:

It should be noted that, when a user queries a log file, the queried encrypted log file is decrypted, and the decrypted log file is displayed to the user. After the step of encrypting the log file according to a preset encryption algorithm to obtain an encrypted log file, the method further comprises: and generating a file check code of the encrypted log file according to a preset check algorithm.

The predetermined verification algorithm is any one of the verification algorithms, and preferably, the predetermined verification algorithm may be an SHA256 algorithm. After the file check code is generated, the file check code is added into the video networking data packet, after the second server receives the video networking data packet, the check code is generated according to a preset check algorithm, and the generated check code is compared with the file check code carried in the video networking data packet. If the data packets are consistent, the video networking data packets have no problem, otherwise, the first server is informed, and the video networking data packets are retransmitted by the first server.

As shown in fig. 2, according to another aspect of the present invention, there is provided a method for querying data, applied to a first server, the method including:

step 201, acquiring target data information; the target data information comprises data content and identification information corresponding to the data content.

Step 202, storing the data content according to a first storage path generated in advance, and encapsulating the target data information through a video networking protocol to obtain a video networking data packet.

And 203, sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing the data content in the target data information according to a pre-generated second storage path process, and returning to a second storage path.

And 204, receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information.

It should be noted that, the process of storing the target data information in step 201 to step 204 is similar to the process of step 101 to step 104 in the foregoing embodiment of the present invention, and is not described again here.

Step 205, when receiving a query request sent by a terminal device, determining a target index according to a query condition carried in the query request, where the target index is an index meeting the query condition.

It should be noted that, the user may input the query condition through the terminal device, and then the terminal device sends the query request carrying the query condition to the first server. The query condition is related to the index, for example, the index contains a file name of the log file, a file type, a unique identifier of a source server of the log file, and the like, and the query condition may be, but is not limited to, a query condition composed of one or more of a file name, a file type, and a unique identifier of a source server of the log file. And if the index is stored in the database, the first server accesses the database according to the query request to determine the index when receiving the query request.

Step 206, acquiring the data content indicated by the first storage path in the target index in the first server; or acquiring the data content indicated by the second storage path in the target index in the second server.

It should be noted that the data content may be preferentially acquired in the first server, and if the data content cannot be acquired in the first server, the data content may be acquired in the second server.

Step 207, returning the acquired data content to the terminal device.

In the embodiment of the invention, target data information is obtained; the target data information comprises data content and identification information corresponding to the data content; and storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet. And storing the data content according to the first storage path, so that the data content stored in the data content can be found according to the first storage path. The video networking data packet obtained after the video networking protocol is packaged can be transmitted under the video networking environment. Sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing data contents in the target data information according to a pre-generated second storage path, and returning to the second storage path; and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information. When a query request sent by terminal equipment is received, determining a target index according to a query condition carried in the query request, wherein the target index is an index meeting the query condition; acquiring data content indicated by a first storage path in a target index in a first server; or acquiring the data content indicated by the second storage path in the target index from the second server; and returning the acquired data content to the terminal equipment. When multiple pieces of target data information are acquired, an index is generated corresponding to each piece of target data information. Therefore, in the query process, the corresponding storage path can be found only by determining the corresponding index according to the query condition, and the required data can be obtained. The invention not only can realize the backup storage of the data in the video network, but also is convenient for the follow-up inquiry of the stored data.

Fig. 3 is a schematic signal transmission diagram of a data query method according to an embodiment of the present invention; after the log file is obtained, the log management service encrypts the log file first and then stores the encrypted log file to a local disk. And generating a check code of the encrypted log file by using the SHA256 algorithm. The log management service sends the encrypted log file and the check code to the remote storage service through the video networking protocol.

And after each batch of data packets are received, the remote storage service confirms whether the number of the data packets is consistent with the total number in the message, and if the number of the data packets is not consistent with the total number in the message, the log management service is required to resend the file. After receiving all the data packets, the remote storage service stores the file, generates a check code for the file through an SHA256 algorithm, compares whether the check code is consistent with the one sent by the log management service, returns a successful file reception to the log management service if the contents are consistent, and notifies the log management service if the contents are inconsistent, and sends all the data packets again. For convenience of searching, log files are stored according to a directory level of a source-end server unique identifier "- >" year-month "- >" filename-year-month-day, log "when the log files are stored in a local disk and a remote storage server.

And after confirming that the normal return result of the remote storage service is received, the log management service writes file record information into the data center, performs 3 trials on the remote server with abnormal log storage, and marks the data record if the log management service still cannot store the file record information. The file information comprises a file name, a local file storage position, a virtual terminal number of a remote storage server, a remote backup state, file storage time, a file type, a source end server unique identifier, an SHA256 check code and the like.

The front-end interface of the security management center can filter and query log file records according to the server type, the file name, the file type and the time range, and can preview or download files in a page. And when receiving a file preview or download request, the log management service finds out the corresponding log file from the local file storage path, decrypts the file content and returns the log file content to the front end. If the log management service does not find the log file locally, the log file is retrieved from the remote storage service. Preferably, the protocol used by the data packet sent by the log management service to the remote storage service is shown in table 1; the protocol used by the data packets sent by the remote storage service to the log management service is shown in table 2;

table 1:

table 2:

fig. 4 is an application architecture diagram of a method for querying data according to an embodiment of the present invention; the log collection module collects log files of a log source end and sends the collected log files to a log management service. The log management service encrypts the log file, stores the encrypted log file to the local, and sends the encrypted log file back to the remote storage service through the virtual terminal. The remote storage service stores the encrypted log file and returns storage result information to the log management service. The log management service generates a record according to the log file and the related information, and sends the record to the database. When a user inquires or downloads a log file, taking inquiry as an example, the log management service inquires the corresponding log file related information of the access database, then reads the corresponding log file locally, and if the corresponding log file is not read locally, reads the corresponding log file in the remote service in a remote reading mode.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

As shown in fig. 5, an apparatus for storing data provided in an embodiment of the present invention is applied to a first server, and the apparatus includes:

an obtaining module 51, configured to obtain target data information; the target data information comprises data content and identification information corresponding to the data content;

the processing module 52 is configured to store the data content according to a first storage path generated in advance, and encapsulate the target data information through the video networking protocol to obtain a video networking data packet;

the sending module 53 is configured to send the video networking data packet to the second server through the video networking, so that the second server analyzes the video networking data packet to obtain target data information, stores data content in the target data information according to a second storage path generated in advance, and returns the data content to the second storage path;

and the index module 54 is configured to receive the second storage path, and generate an index of the target data information according to the second storage path, the first storage path, and the identification information.

Optionally, the first server is preset with configuration information, where the configuration information includes a terminal number of a first video network virtual terminal arranged on the first server and a terminal number of a second video network virtual terminal arranged on the second server;

Optionally, the sending module 53 is specifically configured to control the first video network virtual terminal to send the video network data packet to the second video network virtual terminal through the video network.

Optionally, the sending module 53 is specifically configured to control the first virtual terminal of the video network to send the video network data packets to the second virtual terminal of the video network in a manner of packet sending through the video network.

Optionally, the data content is a log file; the identification information is at least one of a unique identification of a source server of the log file, a name of the log file, and a type of the log file.

Optionally, the processing module 52 includes:

Optionally, the apparatus further comprises:

In the embodiment of the invention, target data information is firstly obtained; the target data information comprises data content and identification information corresponding to the data content; and storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet. And storing the data content according to the first storage path, so that the data content stored in the data content can be found according to the first storage path. The video networking data packet obtained after the video networking protocol is packaged can be transmitted under the video networking environment. Sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing data contents in the target data information according to a pre-generated second storage path, and returning to the second storage path; and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information. When multiple pieces of target data information are acquired, an index is generated corresponding to each piece of target data information. Therefore, in the query process, the corresponding storage path can be found only by determining the corresponding index according to the query condition, and the required data can be obtained. The invention not only can realize the backup storage of the data in the video network, but also is convenient for the follow-up inquiry of the stored data.

Fig. 6 shows an apparatus for querying data according to another embodiment of the present invention, applied to a first server, the apparatus includes:

an obtaining module 61, configured to obtain target data information; the target data information comprises data content and identification information corresponding to the data content;

the processing module 62 is configured to store the data content according to a first storage path generated in advance, and encapsulate target data information through a video networking protocol to obtain a video networking data packet;

the sending module 63 is configured to send the video networking data packet to the second server through the video networking, so that the second server analyzes the video networking data packet to obtain target data information, stores data content in the target data information according to a second storage path generated in advance, and returns the data content to the second storage path;

the index module 64 is configured to receive the second storage path, and generate an index of the target data information according to the second storage path, the first storage path, and the identification information;

a determining module 65, configured to determine a target index according to a query condition carried in a query request when the query request sent by a terminal device is received, where the target index is an index meeting the query condition;

a query module 66, configured to obtain, in the first server, data content indicated by the first storage path in the target index; or acquiring the data content indicated by the second storage path in the target index from the second server;

and the feedback module 67 is configured to return the acquired data content to the terminal device.

In the embodiment of the invention, target data information is firstly obtained; the target data information comprises data content and identification information corresponding to the data content; and storing the data content according to a first storage path generated in advance, and encapsulating target data information through a video networking protocol to obtain a video networking data packet. And storing the data content according to the first storage path, so that the data content stored in the data content can be found according to the first storage path. The video networking data packet obtained after the video networking protocol is packaged can be transmitted under the video networking environment. Sending the video networking data packet to a second server through the video networking so that the second server analyzes the video networking data packet to obtain target data information, storing data contents in the target data information according to a pre-generated second storage path, and returning to the second storage path; and receiving the second storage path, and generating an index of the target data information according to the second storage path, the first storage path and the identification information. When a query request sent by terminal equipment is received, determining a target index according to a query condition carried in the query request, wherein the target index is an index meeting the query condition; acquiring data content indicated by a first storage path in a target index in a first server; or acquiring the data content indicated by the second storage path in the target index from the second server; and returning the acquired data content to the terminal equipment. When multiple pieces of target data information are acquired, an index is generated corresponding to each piece of target data information. Therefore, in the query process, the corresponding storage path can be found only by determining the corresponding index according to the query condition, and the required data can be obtained. The invention not only can realize the backup storage of the data in the video network, but also is convenient for the follow-up inquiry of the stored data.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiment of the invention also discloses electronic equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the computer program to realize the method of any embodiment.

The embodiment of the invention also discloses a computer readable storage medium, and the computer readable storage medium stores a computer program for executing the method for realizing any embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network circuit Switching (circuit Switching), the internet of vision technology employs network Packet Switching to satisfy the demand of Streaming (which is interpreted as Streaming, continuous broadcasting, and is a data transmission technology that changes received data into a stable continuous stream and continuously transmits the stream, so that the sound heard or image seen by the user is very smooth, and the user can start browsing on the screen before the whole data is transmitted). The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server technology (Servertechnology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 7, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (circled part), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 8, the system mainly includes a network interface module 801, a switching engine module 802, a CPU module 803, and a disk array module 804.

The network interface module 801, the CPU module 803, and the disk array module 804 all enter the switching engine module 802; the switching engine module 802 performs an operation of looking up the address table 805 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 806 based on the packet's steering information; if the queue of the packet buffer 806 is nearly full, discard; the switching engine module 802 polls all packet buffer queues and forwards if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 804 mainly implements control over the hard disk, including initialization, reading and writing operations on the hard disk; the CPU module 803 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 805 (including a downlink protocol packet address table, an uplink protocol packet address table and a data packet address table), and configuring the disk array module 804.

The access switch:

as shown in fig. 9, the network interface module (downstream network interface module 901 and upstream network interface module 902), the switching engine module 903 and the CPU module 904 are mainly included.

Wherein, a packet (uplink data) coming from the downlink network interface module 901 enters the packet detection module 905; the packet detection module 905 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet requirements, if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 903, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 902 enters the switching engine module 903; the data packet coming from the CPU module 904 enters the switching engine module 903; the switching engine module 903 performs an operation of looking up the address table 906 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 903 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 907 in association with the stream-id; if the queue of the packet buffer 907 is close to full, it is discarded; if the packet entering the switching engine module 903 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 907 according to the guiding information of the packet; if the queue of the packet buffer 907 is close to full, it is discarded.

The switching engine 903 polls all packet buffer queues in the embodiment of the present invention in two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) and obtaining the token generated by the code rate control module.

If the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 908 is configured by the CPU module 904 and generates tokens for packet buffer queues going to the upstream network interface from all downstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 904 is mainly responsible for protocol processing with the node server, configuration of the address table 906, and configuration of the code rate control module 908.

Ethernet protocol conversion gateway：

As shown in fig. 10, the system mainly includes a network interface module (a downlink network interface module 1001 and an uplink network interface module 1002), a switching engine module 1003, a CPU module 1004, a packet detection module 1005, a rate control module 1008, an address table 1006, a packet buffer 1007, a MAC adding module 1009, and a MAC deleting module 1010.

Wherein, the data packet coming from the downlink network interface module 1001 enters the packet detection module 1005; the packet detection module 1005 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deleting module 1010 subtracts MAC DA, MAC SA, length orframe type (2byte), and enters a corresponding receiving buffer, otherwise, the MAC deleting module discards the MAC DA, MAC SA, and length orframe type;

the downlink network interface module 1001 detects the transmission buffer of the port, and if there is a packet, acquires the ethernet MAC DA of the corresponding terminal according to the video networking destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MACSA of the ethernet coordination gateway, and the ethernet length or frame type, and transmits the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 3 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (e.g. various protocol packets, multicast data packets, unicast data packets, etc.), there are at most 256 possibilities, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses.

The Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA).

The reserved byte consists of 2 bytes.

The payload part has different lengths according to types of different datagrams, and is 64 bytes if the type of the datagram is a variety of protocol packets, or is 1056 bytes if the type of the datagram is a unicast packet, but is not limited to the above 2 types.

The CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of a Label of Multi-Protocol Label switching (MPLS), and assuming that there are two connections between a device a and a device B, there are 2 labels for a packet from the device a to the device B, and 2 labels for a packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

Claims

1. A method for storing data, applied to a first server, the method comprising:

2. The method according to claim 1, wherein the first server is preset with configuration information, and the configuration information comprises a terminal number of a first video network virtual terminal arranged on the first server and a terminal number of a second video network virtual terminal arranged on the second server;

3. The method of claim 2, wherein the step of sending the internet of view data packet to a second server via an internet of view comprises:

4. The method of claim 3, wherein the step of the first video network virtual terminal sending the video network data packet to the second video network virtual terminal over a video network comprises:

5. The method of claim 1, wherein the data content is a log file; the identification information is at least one of a unique identification of a source server of the log file, a name of the log file and a type of the log file.

6. The method of claim 5, wherein the step of storing the data content according to a first pre-generated storage path and encapsulating the target data information by using an internet protocol to obtain an internet protocol data packet comprises:

7. The method according to claim 6, wherein after the step of encrypting the log file according to a preset encryption algorithm to obtain an encrypted log file, the method further comprises:

8. A method for querying data is applied to a first server, and is characterized by comprising the following steps:

and returning the acquired data content to the terminal equipment.

9. An apparatus for storing data, applied to a first server, the apparatus comprising:

10. An apparatus for querying data, applied to a first server, includes:

11. An electronic device comprising a processor, a memory and a computer program stored on the memory and executable on the processor, characterized in that the computer program, when executed by the processor, implements the method of data storage according to any of claims 1 to 7 or the steps of the method of data query according to claim 8.

12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of data storage according to any one of claims 1 to 7 or the method of data query according to claim 8.