CN112000671B - Database table processing method, device and system based on block chain - Google Patents
Database table processing method, device and system based on block chain Download PDFInfo
- Publication number
- CN112000671B CN112000671B CN202010859199.9A CN202010859199A CN112000671B CN 112000671 B CN112000671 B CN 112000671B CN 202010859199 A CN202010859199 A CN 202010859199A CN 112000671 B CN112000671 B CN 112000671B
- Authority
- CN
- China
- Prior art keywords
- source system
- database table
- current source
- association
- management platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a database table processing method, device and system based on a blockchain, wherein the method comprises the following steps: when receiving a database table change request sent by a current source system, determining an associated source system of the current source system according to the association relationship between database tables of the source system; the associated source system and the data management platform perform consensus on a database table change request sent by the current source system; and if the consensus is passed, synchronously updating the change of the database table of the current source system to the associated source system and the data management platform through the blockchain network. The invention determines the association source system based on the association relationship, when the association source system and the data management platform pass through the consensus, the current source system can change the database table, and meanwhile, the change of the database table of the current source system can be effectively and synchronously updated to the association source system and the data management platform through the blockchain network, so that the synchronization of the database table change among the current source system, the association source system and the data management platform is realized.
Description
Technical Field
The present invention relates to the field of data synchronization technologies, and in particular, to a method, an apparatus, and a system for processing a database table based on a blockchain.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
A source system, which is a system that provides metadata to a data governance platform, includes database tables. The database table is used to define fields, types, primary keys, foreign keys, indexes, and the like of one database table. The data management platform is a data full life cycle management platform for realizing data processing links such as generation, migration, storage, use, archiving, destruction and the like of data based on metadata provided by a source system.
The data management platform is generally abutted to a plurality of source systems, database table relations among the plurality of source systems are complex, association dependency relations exist, and the data management platform cannot be completely independent. When the database table of a certain source system changes, the associated source system cannot be ensured to know the change of the database table of the source system in real time, so that the database table provided by the source system to the data management platform is wrong. In addition, when the database table of a certain source system changes, the data management platform cannot know the change of the database table of the source system in real time, so that the database table of the source system stored by the data management platform is wrong.
Therefore, the prior art has the problem that the change of the database table of the source system cannot be effectively and synchronously updated to the associated source system and the data management platform.
Disclosure of Invention
The embodiment of the invention provides a database table processing method based on a block chain, which is used for synchronously updating the change of a database table of a source system to an associated source system and a data management platform, and comprises the following steps:
when receiving a database table change request sent by a current source system, determining an associated source system of the current source system according to the association relationship between database tables of the source system; an association relation exists between the database table of the association source system and the database table of the current source system; a source system, which is a system for providing metadata to a data governance platform, and comprises a database table; the association relation between the source system database tables is preconfigured and stored in a block chain network;
the associated source system and the data management platform perform consensus on a database table change request sent by the current source system; the source system comprising a current source system and an associated source system and the data management platform are connected into a blockchain network; the data management platform is a data full life cycle management platform for realizing a data processing link based on metadata provided by a source system;
If the database table change request sent by the associated source system and the data management platform pass through the common knowledge, the database table change request of the current source system is synchronously updated to the associated source system and the data management platform through the block chain network.
The embodiment of the invention also provides a database table processing device based on the blockchain, which is used for synchronously updating the change of the database table of the source system to the associated source system and the data management platform, and comprises the following components:
the association source system determining module is used for determining an association source system of the current source system according to association relations among database tables of the source system when receiving a database table change request sent by the current source system; an association relation exists between the database table of the association source system and the database table of the current source system; a source system, which is a system for providing metadata to a data governance platform, and comprises a database table; the association relation between the source system database tables is preconfigured and stored in a block chain network;
the change consensus module is used for consensus the database table change request sent by the current source system by the associated source system and the data management platform which have an association relationship with the current source system; the source system comprising a current source system and an associated source system and the data management platform are connected into a blockchain network; the data management platform is a data full life cycle management platform for realizing a data processing link based on metadata provided by a source system;
And the synchronous updating module is used for synchronously updating the change of the database table of the current source system to the associated source system and the data management platform through the blockchain network if the database table change request sent by the associated source system and the data management platform passes through the common recognition.
The embodiment of the invention also provides a database table processing system based on the block chain, which is used for synchronously updating the change of the database table of the source system to the associated source system and the data management platform, and comprises the following components:
the system comprises a blockchain network, a source system connected to the blockchain network and a data management platform; a source system, which is a system for providing metadata to a data governance platform, and comprises a database table; the data management platform is a data full life cycle management platform for realizing a data processing link based on metadata provided by a source system;
the current source system is used for sending a database table change request to the blockchain network;
the block chain network is used for determining an associated source system of the current source system according to the association relation between the database tables of the source system when receiving a database table change request sent by the current source system; an association relation exists between the database table of the association source system and the database table of the current source system; the association relation between the source system database tables is preconfigured and stored in a block chain network;
The associated source system and the data management platform are used for consensus on a database table change request sent by the current source system;
and the current source system is also used for synchronously updating the change of the database table of the current source system to the associated source system and the data management platform through the blockchain network if the associated source system and the data management platform commonly pass through the database table change request sent by the current source system.
The embodiment of the invention also provides computer equipment, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the block chain-based database table processing method when executing the computer program.
The embodiment of the invention also provides a computer readable storage medium which stores a computer program for executing the block chain-based database table processing method.
In the embodiment of the invention, when receiving a database table change request sent by a current source system, determining an associated source system of the current source system according to the association relationship between database tables of the source system; the associated source system and the data management platform perform consensus on a database table change request sent by the current source system; and if the consensus is passed, synchronously updating the change of the database table of the current source system to the associated source system and the data management platform through the blockchain network. According to the embodiment of the invention, the association source system is determined based on the association relationship, when the association source system and the data management platform are commonly recognized to pass, the current source system can only change the database table, and meanwhile, the change of the database table of the current source system can be effectively and synchronously updated to the association source system and the data management platform through the blockchain network, so that the synchronization of the database table change among the current source system, the association source system and the data management platform is realized.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. In the drawings:
FIG. 1 is a flowchart of a method for processing a blockchain-based database table according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an implementation of step 101 in a blockchain-based database table processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart of another implementation of a blockchain-based database table processing method provided by an embodiment of the present invention;
FIG. 4 is a flowchart illustrating the implementation of step 103 in a blockchain-based database table processing method according to an embodiment of the present invention;
FIG. 5 is a flow chart of a portion of another exemplary blockchain-based database table processing method in accordance with an embodiment of the present invention;
FIG. 6 is a functional block diagram of a blockchain-based database table processing device according to an embodiment of the present invention;
FIG. 7 is a block diagram illustrating a configuration of an association source system determination module 601 in a blockchain-based database table processing device according to an embodiment of the present invention;
FIG. 8 is a functional block diagram of a block chain based database table processing apparatus according to an embodiment of the present invention;
FIG. 9 is a block diagram illustrating a synchronization update module 603 in a blockchain-based database table processing device according to an embodiment of the present invention;
FIG. 10 is a block diagram of a portion of a block chain based database table processing apparatus according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of a block chain based database table processing system according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention will be described in further detail with reference to the accompanying drawings. The exemplary embodiments of the present invention and their descriptions herein are for the purpose of explaining the present invention, but are not to be construed as limiting the invention.
Fig. 1 shows an implementation flow of a blockchain-based database table processing method according to an embodiment of the present invention, and for convenience of description, only a portion relevant to the embodiment of the present invention is shown, which is described in detail below:
as shown in fig. 1, a blockchain-based database table processing method includes:
Step 101, when receiving a database table change request sent by the current source system 1104, determining an associated source system 1105 of the current source system 1104 according to an association relationship between database tables of the source system 1102; an association exists between the database table of the association source system 1105 and the database table of the current source system 1104;
102, associating the source system 1105 and the data management platform 1103 to perform consensus on a database table change request sent by the current source system 1104; the source system 1102 including the current source system 1104 and the associated source system 1105 and the data governance platform 1103 are both connected to the blockchain network 1101;
step 103, if the associated source system 1105 and the data management platform 1103 pass the database table change request sent by the current source system 1104, synchronously updating the database table change of the current source system 1104 to the associated source system 1105 and the data management platform 1103 through the blockchain network 1101.
In an embodiment of the present invention, source system 1102 includes current source system 1104 and associated source system 1105, and may include other source systems in addition to current source system 1104 and associated source system 1105. The current source system 1104 refers to a source system that sends a database table change request or a source system that needs to make a database table change. Wherein, there is an association (or dependency) between the database tables of the current source system 1104 and the database tables of the associated source system 1105, while there is no association between the database tables of the other source systems 1102 and the database tables of the current source system 1104.
In addition, the source system 1102 and the data governance platform 1103 are connected to the blockchain network 1101 by a protocol, that is, at least the current source system 1104, the associated source system 1105 and the data governance platform 1103 are connected to the blockchain network 1101 by a protocol, and other source systems 1102 are connected to the blockchain network 1101 by a protocol. The change of the database table may include a new addition, a deletion, or a modification of the database table structure, for example, a new addition, a deletion, or a modification of the database table structure.
When the database table synchronization is performed, the current source system 1104 sends a database table change request to the blockchain network 1101, and when the blockchain network 1101 receives the database table change request sent by the current source system 1104, the associated source system 1105 of the current source system 1104 is determined based on the association relationship between the database tables of the source system 1102. The association relationship between the database tables of each source system 1102 is pre-stored and configured, which indicates and reflects the association relationship between the database table of a certain source system and the database tables of another source system or systems. Preferably, the associations between database tables of the source system are configurable and stored in the blockchain network 1101.
Wherein, there is an association relationship between the database table of the current source system 1104 and the database table of the association source system 1105, that is, the database table having an association relationship with the database table of the current source system 1104 can be determined through the database table of the current source system 1104, and then the source system 1102 corresponding to the database table having an association relationship with the database table of the current source system 1104, that is, the association source system 1105, is determined based on the database table having an association relationship with the database table of the current source system 1104.
In view of the fact that there is a correlation between the current source system 1104 and the associated source system 1105 and the data management platform 1103, for example, a certain field of the database table of the current source system 1104 and a certain field of the database table of the associated source system 1105, the current source system 1104 needs to accurately transmit the database table to the data management platform 1103 under certain conditions, so that the change of the database table of the current source system 1104 affects the associated source system 1105 and the data management platform 1103, and therefore when receiving the database table change request sent by the current source system 1104, the associated source system 1105 and the data management platform 1103 need to commonly identify the database table change request sent by the current source system 1104. Allowing the current source system 1104 to make changes to the database table when the consensus passes; the current source system 1104 is not permitted to make changes to the database tables if the consensus fails.
Therefore, when the database table change request sent by the associated source system 1105 and the data management platform 1103 to the current source system 1104 passes through, the current source system 1104 is allowed to change the database table, and the database table change of the current source system 1104 is synchronously updated to the associated source system 1105 and the data management platform 1103 through the blockchain network 1101, so that the database table change of the source system 1102 is synchronized in other source systems 1102 and the data management platform 1103.
In the embodiment of the invention, when receiving a database table change request sent by the current source system 1104, determining an associated source system 1105 of the current source system 1104 according to the association relationship between database tables of the source system 1102; further, the associated source system 1105 and the data management platform 1103 perform consensus on the database table change request sent by the current source system 1104; if the consensus passes, then the changes to the database tables of the current source system 1104 are synchronously updated to the associated source system 1105 and the data administration platform 1103 via the blockchain network 1101. According to the embodiment of the invention, the association source system 1105 is determined based on the association relationship, when the association source system 1105 and the data management platform 1103 pass through the consensus, the current source system 1104 can perform database table change, and meanwhile, the database table change of the current source system 1104 can be effectively and synchronously updated to the association source system 1105 and the data management platform 1103 through the blockchain network 1101, so that the database table change synchronization among the current source system 1104, the association source system 1105 and the data management platform 1103 is realized.
Fig. 2 shows a flow of implementing step 101 in the blockchain-based database table processing method according to the embodiment of the present invention, and for convenience of description, only the portion relevant to the embodiment of the present invention is shown, which is described in detail below:
in an embodiment of the present invention, in order to improve the efficiency of determining the associated source system 1105, as shown in fig. 2, step 101, when receiving a database table change request sent by the current source system 1104, determines the associated source system 1105 of the current source system 1104 according to the association relationship between database tables of the source system 1102, including:
step 201, when receiving a database table change request sent by the current source system 1104, acquiring an association table from the blockchain network 1101; the association table comprises association between database tables of the source system 1102;
step 202, determining the associated source system 1105 of the current source system 1104 according to the association relationship between the database tables of the source system 1102 in the association relationship table.
In an embodiment of the present invention, the association between database tables of the source system 1102 may be pre-configured in an association table in the blockchain network 1101. In this way, when determining the association source system 1105 of the current source system 1104, only the association relationship table needs to be directly obtained from the blockchain network 1101, and then the association source system 1105 of the current source system 1104 is determined through the association relationship table.
Specifically, upon receiving the database table change request sent by the current source system 1104, an association table containing association relationships between database tables of each source system 1102 is obtained from the blockchain network 1101. Further, the source system 1102 corresponding to the database table having the association relationship with the database table of the current source system 1104, that is, the association source system 1105 is determined by determining the database table having the association relationship with the database table of the current source system 1104 and then based on the database table having the association relationship with the database table of the current source system 1104.
In the embodiment of the present invention, when receiving the database table change request sent by the current source system 1104, the association relationship table is obtained from the blockchain network 1101, and the association source system 1105 of the current source system 1104 is determined according to the association relationship between the database tables of the source system 1102 in the association relationship table, so that the efficiency of determining the association source system 1105 can be improved. Meanwhile, the association table configuration is stored in the blockchain network 1101, so that the accuracy of the association between database tables of the source system 1102 can be ensured.
Fig. 3 shows another implementation flow of the blockchain-based database table processing method according to the embodiment of the present invention, and for convenience of description, only the portion relevant to the embodiment of the present invention is shown, which is described in detail below:
In an embodiment of the present invention, in order to improve accuracy of the association table, as shown in fig. 3, based on the above method steps, the method for processing a database table based on a blockchain further includes:
step 301, when a configuration request of an association table is received, obtaining a consensus result of a source system 1102 in a blockchain network 1101;
in step 302, after the source system 1102 passes the configuration request consensus of the association table, the association table is configured into the blockchain network 1101.
In the embodiment of the invention, the association table can be configured in the blockchain network 1101 through the blockchain technology, so that the accuracy of the association table is improved. Meanwhile, the association relation between the database tables of the source system 1102 is configured in a manner of configuring the association relation table, so that the flexibility of adjusting the association relation between the database tables of the source system 1102 can be improved.
Specifically, when configuring the association table, firstly, a configuration request of the association table is received, and in view of the association between database tables of the source system 1102 reflected by the association table, each source system 1102 accessing the blockchain network 1101 performs consensus on the configuration request of the association table, and configures the association table in the blockchain network 1101 under the condition that the consensus passes.
In the embodiment of the invention, when receiving the configuration request of the association table, the consensus result of the source system 1102 in the blockchain network 1101 is obtained, and after the configuration request of the source system 1102 for the association table is consensus passed, the association table is configured in the blockchain network 1101, so that the accuracy of the association table can be improved, and meanwhile, the flexibility of adjusting the association between database tables of the source system 1102 can be improved.
In an embodiment of the present invention, in order to improve the accuracy of the database table of the source system 1102, as shown in fig. 3, the method for processing the database table based on the blockchain further includes:
in step 303, if the database table change request sent by the associated source system 1105 and the data management platform 1103 to the current source system 1104 fails to pass the consensus, the change of the database table of the current source system 1104 cannot be written into the blockchain network 1101.
In the embodiment of the present invention, the associated source system 1105 and the data management platform 1103 perform consensus on the database table change request sent by the current source system 1104, and if the consensus is not passed, the database table change of the current source system 1104 is refused to be written into the blockchain network 1101, that is, the database table is not allowed to be changed by the current source system 1104 at this time, so that the accuracy of the database table of the source system 1102 can be improved.
In the embodiment of the present invention, if the database table change request sent by the associated source system 1105 and the data management platform 1103 to the current source system 1104 fails to be known together, the change of the database table of the current source system 1104 cannot be written into the blockchain network 1101, so that the accuracy of the database table of the source system 1102 can be improved.
Fig. 4 shows a flow implemented in step 103 in the blockchain-based database table processing method according to the embodiment of the present invention, and for convenience of description, only the portions relevant to the embodiment of the present invention are shown, which are described in detail below:
in an embodiment of the present invention, in order to improve the accuracy of the synchronized database tables, as shown in fig. 4, step 103, if the database table change request sent by the associated source system 1105 and the data management platform 1103 to the current source system 1104 is commonly passed, the database table change of the current source system 1104 is synchronously updated to the associated source system 1105 and the data management platform 1103 through the blockchain network 1101, including:
step 401, if the associated source system 1105 and the data management platform 1103 pass the database table change request sent by the current source system 1104, the current source system 1104 writes the change of the database table into the blockchain network 1101;
In step 402, the blockchain network 1101 synchronously updates changes to the database tables of the current source system 1104 to the associated source system 1105 and the data administration platform 1103.
When the database table of the current source system 1104 is changed and synchronized to the associated source system 1105 and the data management platform 1103, if the database table change request sent by the associated source system 1105 and the data management platform 1103 passes through the database table change request, the current source system 1104 is allowed to change the database table, namely, the current source system 1104 writes the change of the database table into the blockchain network 1101 to ensure the accuracy of the database table, and then the blockchain network 1101 synchronously updates the change of the database table of the current source system 1104 to the associated source system 1105 and the data management platform 1103, thereby improving the accuracy of the database table synchronized to the associated source system 1105 and the data management platform 1103.
In the embodiment of the present invention, if the associated source system 1105 and the data management platform 1103 pass the database table change request sent by the current source system 1104, the current source system 1104 writes the change of the database table into the blockchain network 1101, and the blockchain network 1101 synchronously updates the change of the database table of the current source system 1104 to the associated source system 1105 and the data management platform 1103, so that the accuracy of the synchronized database table can be improved.
FIG. 5 shows a partial implementation flow of yet another blockchain-based database table processing method according to an embodiment of the present invention, and for convenience of description, only the portion relevant to the embodiment of the present invention is shown, which is described in detail below:
in an embodiment of the present invention, in order to improve the accuracy of the database table issued by the current source system 1104 to the data administration platform 1103, as shown in fig. 5, the blockchain-based database table processing method further includes:
step 501, when receiving a data issuing request sent by a current source system 1104, comparing a database table of the current source system 1104 with a database table of an associated source system 1105 in a blockchain network 1101, which has an association relationship with the database table of the current source system 1104;
step 502, if the database table associated with the database table of the current source system 1104 in the association source system 1105 in the blockchain network 1101 is inconsistent with the database table of the current source system 1104, updating the database table of the current source system 1104 according to the database table associated with the database table of the current source system 1104 in the association source system 1105;
in step 503, according to the data issuing request sent by the current source system 1104, the updated database table of the current source system 1104 is issued to the data management platform 1103 through the blockchain network 1101.
In an embodiment of the present invention, the database tables of the source system 1102 are all configured in the blockchain network 1101. Upon receiving a data issue request sent by the current source system 1104, in order to ensure the accuracy of the database table issued by the current source system 1104, the database table of the current source system 1104 is compared with the database table of the associated source system 1105 in the blockchain network 1101. The database table of the association source system 1105 refers to a database table having an association relationship with the database table of the current source system 1104.
If the database table of the current source system 1104 is consistent with the database table of the associated source system 1105 in the blockchain network 1101, indicating that the database table of the current source system 1104 is accurate, the database table of the current source system 1104 may be directly issued to the data administration platform 1103 by the blockchain network 1101.
If the database table of the current source system 1104 is inconsistent with the database table of the associated source system 1105 in the blockchain network 1101, the database table of the associated source system 1105 is generally accurate because the database table of the associated source system 1105 in the blockchain network 1101 is stored in the blockchain network after being agreed, which indicates that the database table of the current source system 1104 is inaccurate, the database table of the current source system 1104 cannot be directly issued to the data administration platform 1103 through the blockchain network 1101. At this time, the database table of the current source system 1104 needs to be updated based on the database table of the accurate associated source system 1105, so as to synchronize the database table content of the accurate associated source system 1105 to the database table of the current source system 1104, and after updating, based on the data issuing request, the updated database table of the current source system 1104 is issued to the data management platform 1103 through the blockchain network 1101.
In the embodiment of the present invention, when a data issuing request sent by a current source system 1104 is received, a database table of the current source system 1104 is compared with a database table of an associated source system 1105 in a blockchain network 1101, where the database table of the associated source system 1105 in the blockchain network is in association with the database table of the current source system 1104, if the database table of the associated source system 1105 in the blockchain network is inconsistent with the database table of the current source system 1104, the database table of the current source system 1104 is updated according to the database table of the associated source system 1105 in association with the database table of the current source system 1104, and the updated database table of the current source system 1104 is issued to a data management platform 1103 by the blockchain network 1101 according to the data issuing request sent by the current source system 1104, so that the accuracy of the database table of the current source system 1104 issued to the data management platform 1103 can be improved.
The embodiment of the invention also provides a database table processing device based on the block chain, which is described in the following embodiment. Since the principle of solving the problem by these devices is similar to that of the database table processing method based on the blockchain, the implementation of these devices can be referred to the implementation of the method, and the repetition is omitted.
Fig. 6 shows functional modules of a blockchain-based database table processing device according to an embodiment of the present invention, and for convenience of explanation, only the portions relevant to the embodiment of the present invention are shown in detail as follows:
referring to fig. 6, each module included in the blockchain-based database table processing device is configured to perform each step in the corresponding embodiment of fig. 1, and specifically please refer to fig. 1 and the related description in the corresponding embodiment of fig. 1, which are not repeated herein. In the embodiment of the present invention, the database table processing device based on the blockchain includes a determining module 601 of the association source system 1105, a changing consensus module 602 and a synchronous updating module 603.
The association source system 1105 determining module 601 is configured to determine, when receiving a database table change request sent by the current source system 1104, an association source system 1105 of the current source system 1104 according to an association relationship between database tables of the source system 1102; there is an association between the database table of the associated source system 1105 and the database table of the current source system 1104.
A change consensus module 602, configured to consensus a database table change request sent by a current source system 1104 by using an associated source system 1105 and a data management platform 1103 that have an association relationship with the current source system 1104; the source system 1102, including the current source system 1104 and the associated source system 1105, and the data governance platform 1103 are all accessed into the blockchain network 1101.
The synchronization updating module 603 is configured to synchronously update, through the blockchain network 1101, a database table change request sent by the associated source system 1105 and the data management platform 1103 to the associated source system 1105 and the data management platform 1103 if the database table change request sent by the current source system 1104 passes through the database table change request.
In the embodiment of the invention, when receiving the database table change request sent by the current source system 1104, the associated source system 1105 determining module 601 determines the associated source system 1105 of the current source system 1104 according to the association relationship between the database tables of the source system 1102; further, the change consensus module 602 correlates the source system 1105 and the data management platform 1103 to perform consensus on the database table change request sent by the current source system 1104; if the consensus passes, the synchronization update module 603 synchronously updates the database table of the current source system 1104 to the associated source system 1105 and the data management platform 1103 through the blockchain network 1101. According to the embodiment of the invention, the association source system 1105 is determined based on the association relationship, when the association source system 1105 and the data management platform 1103 pass through the consensus, the current source system 1104 can perform database table change, and meanwhile, the database table change of the current source system 1104 can be effectively and synchronously updated to the association source system 1105 and the data management platform 1103 through the blockchain network 1101, so that the database table change synchronization among the current source system 1104, the association source system 1105 and the data management platform 1103 is realized.
Fig. 7 shows a schematic structural diagram of the association source system 1105 determining module 601 in the blockchain-based database table processing apparatus according to the embodiment of the present invention, and for convenience of explanation, only the portions related to the embodiment of the present invention are shown, which is described in detail below:
in an embodiment of the present invention, in order to improve the efficiency of determining the association source system 1105, referring to fig. 7, each unit included in the association source system 1105 determining module 601 is configured to execute each step in the corresponding embodiment of fig. 2, and detailed descriptions of fig. 2 and the corresponding embodiment of fig. 2 are omitted herein. In the embodiment of the present invention, the association source system 1105 determining module 601 includes an association relationship table obtaining unit 701 and an association source system 1105 determining unit 702.
An association table obtaining unit 701, configured to obtain an association table from the blockchain network 1101 when receiving a database table change request sent by the current source system 1104; the association table includes associations between database tables of the source system 1102.
The association source system 1105 determining unit 702 is configured to determine, according to the association relationship between the database tables of the source system 1102 in the association relationship table, an association source system 1105 of the current source system 1104.
In the embodiment of the present invention, when receiving the database table change request sent by the current source system 1104, the association table obtaining unit 701 obtains the association table from the blockchain network 1101, and the association source system 1105 determining unit 702 determines the association source system 1105 of the current source system 1104 according to the association relationship between the database tables of the source systems 1102 in the association table, so that the efficiency of determining the association source system 1105 can be improved. Meanwhile, the association table configuration is stored in the blockchain network 1101, so that the accuracy of the association between database tables of the source system 1102 can be ensured.
Fig. 8 shows another functional module of the blockchain-based database table processing device according to the embodiment of the present invention, and for convenience of explanation, only the portion relevant to the embodiment of the present invention is shown in detail as follows:
in an embodiment of the present invention, in order to improve accuracy of the association table, referring to fig. 8, each module or unit included in the blockchain-based database table processing device is configured to execute each step in the corresponding embodiment of fig. 3, and specifically please refer to fig. 3 and the related description in the corresponding embodiment of fig. 3, which are not repeated herein. In the embodiment of the present invention, based on the above module structure, the database table processing device based on the blockchain further includes a consensus obtaining module 801 and an association table configuration module 802.
The consensus obtaining module 801 is configured to obtain a consensus result of the source system 1102 in the blockchain network 1101 when receiving a configuration request of the association table.
The association table configuration module 802 is configured to configure the association table to the blockchain network 1101 after the configuration request of the source system 1102 for the association table is commonly known.
In the embodiment of the present invention, when the consensus obtaining module 801 receives a configuration request of an association table, it obtains a consensus result of the source system 1102 in the blockchain network 1101, and after the source system 1102 commonly recognizes the configuration request of the association table, the association table configuration module 802 configures the association table in the blockchain network 1101, so that accuracy of the association table can be improved, and meanwhile, flexibility of adjusting association between database tables of the source system 1102 can be improved.
In an embodiment of the present invention, in order to improve the accuracy of the database table of the source system 1102, as shown in fig. 8, the block chain-based database table processing apparatus further includes a write rejection module 803 based on the above module structure.
The write rejection module 803 is configured to, if the database table change request sent by the associated source system 1105 and the data management platform 1103 to the current source system 1104 fails to pass the consensus, disable writing of the database table change into the blockchain network 1101.
In the embodiment of the present invention, if the association source system 1105 and the data management platform 1103 do not pass the common knowledge of the database table change request sent by the current source system 1104, the refusal writing module 803 cannot write the change of the database table of the current source system 1104 into the blockchain network 1101, so that the accuracy of the database table of the source system 1102 can be improved.
Fig. 9 shows a schematic structure of a synchronization update module 603 in a blockchain-based database table processing device according to an embodiment of the present invention, and for convenience of explanation, only a portion related to the embodiment of the present invention is shown, which is described in detail below:
in an embodiment of the present invention, in order to improve the accuracy of the synchronized database table, referring to fig. 9, each unit included in the synchronization updating module 603 is configured to execute each step in the corresponding embodiment of fig. 4, and detailed descriptions of the corresponding embodiments of fig. 4 are omitted herein. In the embodiment of the present invention, the synchronization update module 603 includes a change write unit 901 and a synchronization update unit 902.
A change writing unit 901, configured to write a change of the database table into the blockchain network 1101 if the database table change request sent by the associated source system 1105 and the data management platform 1103 passes through the database table change request.
A synchronization updating unit 902, configured to synchronously update, through the blockchain network 1101, a change of a database table of a current source system 1104 to an associated source system 1105 and a data administration platform 1103.
In the embodiment of the present invention, if the association source system 1105 and the data management platform 1103 pass the database table change request sent by the current source system 1104, the change writing unit 901 writes the change of the database table into the blockchain network 1101, and the synchronization updating unit 902 synchronously updates the change of the database table of the current source system 1104 to the association source system 1105 and the data management platform 1103, so that the accuracy of the synchronized database table can be improved.
FIG. 10 illustrates a portion of functional blocks of yet another blockchain-based database table processing device according to an embodiment of the present invention, and for convenience of explanation, only the portions related to the embodiment of the present invention are shown in detail as follows:
in an embodiment of the present invention, in order to improve the accuracy of the database tables issued by the current source system 1104 to the data management platform 1103, referring to fig. 10, each module included in the blockchain-based database table processing device is configured to execute each step in the corresponding embodiment of fig. 5, and specifically please refer to fig. 5 and the related description in the corresponding embodiment of fig. 5, which will not be repeated herein. In the embodiment of the present invention, based on the above module structure, the database table processing device based on the blockchain further includes a comparison module 1001, a database table update module 1002, and a issuing module 1003.
The comparison module 1001 is configured to, when receiving a data issuing request sent by the current source system 1104, compare a database table of the current source system 1104 with a database table in the blockchain network 1101, where the database table has an association relationship with a database table of the current source system 1104, where the database table is associated with the source system 1105 in the blockchain network 1101.
The database table updating module 1002 is configured to update the database table of the current source system 1104 according to the database table of the associated source system 1105, which has an association relationship with the database table of the current source system 1104, in the blockchain network 1101 if the database table of the associated source system 1105, which has an association relationship with the database table of the current source system 1104, is inconsistent with the database table of the current source system 1104.
And the issuing module 1003 is configured to issue, according to a data issuing request sent by the current source system 1104, the updated database table of the current source system 1104 to the data management platform 1103 through the blockchain network 1101.
In the embodiment of the present invention, when receiving a data issuing request sent by the current source system 1104, the comparison module 1001 compares a database table of the current source system 1104 with a database table of an association source system 1105 in the blockchain network 1101, where the database table has an association relationship with a database table of the current source system 1104, and if the database table of the association source system 1105 in the blockchain network 1101 is inconsistent with the database table of the current source system 1104, the database table of the current source system 1104 is updated according to the database table of the association source system 1105, and the issuing module 1003 issues the updated database table of the current source system 1104 to the data administration platform 1103 through the blockchain network 1101 according to the data issuing request sent by the current source system 1104, so that the accuracy of the database table of the current source system 1104 issued to the data administration platform 1103 can be improved.
FIG. 11 is a schematic diagram of a blockchain-based database table processing system according to an embodiment of the present invention, and for convenience of explanation, only the portions relevant to the embodiment of the present invention are shown in detail below:
referring to fig. 11, each module or unit included in the blockchain-based database table processing system is configured to perform each step in the corresponding embodiment of fig. 1, and detailed descriptions thereof are omitted herein with reference to fig. 1 and the related descriptions in the corresponding embodiment of fig. 1. In the embodiment of the present invention, the blockchain-based database table processing system includes a blockchain network 1101, a source system 1102 accessing the blockchain network 1101, and a data management platform 1103.
A current source system 1104 for sending a database table change request to the blockchain network 1101;
the blockchain network 1101 is configured to determine, when receiving a database table change request sent by the current source system 1104, an associated source system 1105 of the current source system 1104 according to an association relationship between database tables of the source system 1102; an association exists between the database table of the association source system 1105 and the database table of the current source system 1104;
the associated source system 1105 and the data management platform 1103 are used for consensus the database table change request sent by the current source system 1104;
The current source system 1104 is further configured to synchronously update the database table change of the current source system 1104 to the associated source system 1105 and the data management platform 1103 through the blockchain network 1101 if the database table change request sent by the associated source system 1105 and the data management platform 1103 passes through the database table change request.
In the embodiment of the present invention, when the blockchain network 1101 receives a database table change request sent by the current source system 1104, the associated source system 1105 of the current source system 1104 is determined according to the association relationship between database tables of the source system 1102; further, the associated source system 1105 and the data management platform 1103 perform consensus on the database table change request sent by the current source system 1104; if the consensus passes, then the changes to the database tables of the current source system 1104 are synchronously updated to the associated source system 1105 and the data administration platform 1103 via the blockchain network 1101. According to the embodiment of the invention, the association source system 1105 is determined based on the association relationship, when the association source system 1105 and the data management platform 1103 pass through the consensus, the current source system 1104 can perform database table change, and meanwhile, the database table change of the current source system 1104 can be effectively and synchronously updated to the association source system 1105 and the data management platform 1103 through the blockchain network 1101, so that the database table change synchronization among the current source system 1104, the association source system 1105 and the data management platform 1103 is realized.
In one embodiment of the present invention, as shown in FIG. 11, the blockchain network 1101 also includes a management module that can enable management of the source system 1102 as well as management of database tables of the source system 1102. Meanwhile, the blockchain network 1101 further includes a query module, which can implement functions of querying the source system 1102, querying a database table of the source system 1102, and the like. In addition, blockchain network 1101 also includes interface services, smart contracts, blockchain platforms, and the like.
The embodiment of the invention also provides computer equipment, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the block chain-based database table processing method when executing the computer program.
The embodiment of the invention also provides a computer readable storage medium which stores a computer program for executing the block chain-based database table processing method.
In summary, when receiving the database table change request sent by the current source system 1104, the embodiment of the present invention determines the associated source system 1105 of the current source system 1104 according to the association relationship between the database tables of the source system 1102; further, the associated source system 1105 and the data management platform 1103 perform consensus on the database table change request sent by the current source system 1104; if the consensus passes, then the changes to the database tables of the current source system 1104 are synchronously updated to the associated source system 1105 and the data administration platform 1103 via the blockchain network 1101. According to the embodiment of the invention, the association source system 1105 is determined based on the association relationship, when the association source system 1105 and the data management platform 1103 pass through the consensus, the current source system 1104 can perform database table change, and meanwhile, the database table change of the current source system 1104 can be effectively and synchronously updated to the association source system 1105 and the data management platform 1103 through the blockchain network 1101, so that the database table change synchronization among the current source system 1104, the association source system 1105 and the data management platform 1103 is realized.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (10)
1. A blockchain-based database table processing method, comprising:
when receiving a database table change request sent by a current source system, determining an associated source system of the current source system according to the association relationship between database tables of the source system; an association relation exists between the database table of the association source system and the database table of the current source system; a source system, which is a system for providing metadata to a data governance platform, and comprises a database table; the association relation between the source system database tables is preconfigured and stored in a block chain network;
the associated source system and the data management platform perform consensus on a database table change request sent by the current source system; the source system comprising a current source system and an associated source system and the data management platform are connected into a blockchain network; the data management platform is a data full life cycle management platform for realizing a data processing link based on metadata provided by a source system;
if the database table change request sent by the associated source system and the data management platform pass through the common knowledge, the database table change request of the current source system is synchronously updated to the associated source system and the data management platform through the block chain network.
2. The blockchain-based database table processing method of claim 1, wherein determining the associated source system of the current source system based on the association between the source system database tables upon receiving the database table change request sent by the current source system, comprises:
when receiving a database table change request sent by a current source system, acquiring an association relation table from a block chain network; the association relation table comprises association relations among source system database tables;
and determining the associated source system of the current source system according to the association relation between the source system database tables in the association relation table.
3. The blockchain-based database table processing method of claim 2, further comprising:
when a configuration request of an association relation table is received, a consensus result of a source system in a blockchain network is obtained;
after the configuration request of the source system for the association relation table passes the consensus, the association relation table is configured into the blockchain network.
4. The blockchain-based database table processing method of claim 1, further comprising:
if the database table change request sent by the associated source system and the data management platform to the current source system fails to pass the consensus, the change of the database table of the current source system cannot be written into the blockchain network.
5. The blockchain-based database table processing method of claim 1, wherein if the associated source system and the data governance platform agree that the database table change request sent by the current source system passes, synchronously updating the change of the database table of the current source system to the associated source system and the data governance platform through a blockchain network, comprising:
if the database table change request sent by the associated source system and the data management platform passes through the consensus, the current source system writes the change of the database table into the blockchain network;
and the blockchain network synchronously updates the change of the database table of the current source system to the associated source system and the data management platform.
6. The blockchain-based database table processing method of claim 1, further comprising:
when a data issuing request sent by a current source system is received, comparing a database table of the current source system with a database table of an association source system in a blockchain network, wherein the database table has an association relationship with the database table of the current source system;
if the database table of the associated source system in the blockchain network, which has an association relation with the database table of the current source system, is inconsistent with the database table of the current source system, updating the database table of the current source system according to the database table of the associated source system, which has an association relation with the database table of the current source system;
And according to the data issuing request sent by the current source system, issuing the updated database table of the current source system to the data management platform through the blockchain network.
7. A blockchain-based database table processing device, comprising:
the association source system determining module is used for determining an association source system of the current source system according to association relations among database tables of the source system when receiving a database table change request sent by the current source system; an association relation exists between the database table of the association source system and the database table of the current source system; a source system, which is a system for providing metadata to a data governance platform, and comprises a database table; the association relation between the source system database tables is preconfigured and stored in a block chain network;
the change consensus module is used for consensus the database table change request sent by the current source system by the associated source system and the data management platform which have an association relationship with the current source system; the source system comprising a current source system and an associated source system and the data management platform are connected into a blockchain network; the data management platform is a data full life cycle management platform for realizing a data processing link based on metadata provided by a source system;
And the synchronous updating module is used for synchronously updating the change of the database table of the current source system to the associated source system and the data management platform through the blockchain network if the database table change request sent by the associated source system and the data management platform passes through the common recognition.
8. A blockchain-based database table processing system, comprising:
the system comprises a blockchain network, a source system connected to the blockchain network and a data management platform; a source system, which is a system for providing metadata to a data governance platform, and comprises a database table; the data management platform is a data full life cycle management platform for realizing a data processing link based on metadata provided by a source system;
the current source system is used for sending a database table change request to the blockchain network;
the block chain network is used for determining an associated source system of the current source system according to the association relation between the database tables of the source system when receiving a database table change request sent by the current source system; an association relation exists between the database table of the association source system and the database table of the current source system; the association relation between the source system database tables is preconfigured and stored in a block chain network;
The associated source system and the data management platform are used for consensus on a database table change request sent by the current source system;
and the current source system is also used for synchronously updating the change of the database table of the current source system to the associated source system and the data management platform through the blockchain network if the associated source system and the data management platform commonly pass through the database table change request sent by the current source system.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the blockchain-based database table processing method of any of claims 1 to 6 when the computer program is executed by the processor.
10. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for executing the blockchain-based database table processing method of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010859199.9A CN112000671B (en) | 2020-08-24 | 2020-08-24 | Database table processing method, device and system based on block chain |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010859199.9A CN112000671B (en) | 2020-08-24 | 2020-08-24 | Database table processing method, device and system based on block chain |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112000671A CN112000671A (en) | 2020-11-27 |
| CN112000671B true CN112000671B (en) | 2023-09-19 |
Family
ID=73470744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010859199.9A Active CN112000671B (en) | 2020-08-24 | 2020-08-24 | Database table processing method, device and system based on block chain |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112000671B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113486024B (en) * | 2021-07-27 | 2024-04-09 | 中国银行股份有限公司 | Data dictionary information transmission method and device, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10296764B1 (en) * | 2016-11-18 | 2019-05-21 | Amazon Technologies, Inc. | Verifiable cryptographically secured ledgers for human resource systems |
| CN110008216A (en) * | 2019-04-02 | 2019-07-12 | 北京众享比特科技有限公司 | Database table operating method, device, equipment and storage medium based on block chain |
| CN111279329A (en) * | 2017-11-01 | 2020-06-12 | 斯沃尔德斯股份有限公司 | Method and apparatus for efficiently implementing a fast-replicating database |
| CN111373402A (en) * | 2019-11-08 | 2020-07-03 | 支付宝(杭州)信息技术有限公司 | Lightweight decentralized application platform |
-
2020
- 2020-08-24 CN CN202010859199.9A patent/CN112000671B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10296764B1 (en) * | 2016-11-18 | 2019-05-21 | Amazon Technologies, Inc. | Verifiable cryptographically secured ledgers for human resource systems |
| CN111279329A (en) * | 2017-11-01 | 2020-06-12 | 斯沃尔德斯股份有限公司 | Method and apparatus for efficiently implementing a fast-replicating database |
| CN110008216A (en) * | 2019-04-02 | 2019-07-12 | 北京众享比特科技有限公司 | Database table operating method, device, equipment and storage medium based on block chain |
| CN111373402A (en) * | 2019-11-08 | 2020-07-03 | 支付宝(杭州)信息技术有限公司 | Lightweight decentralized application platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112000671A (en) | 2020-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110908997B (en) | Data blood relationship construction method and device, server and readable storage medium | |
| US10237295B2 (en) | Automated event ID field analysis on heterogeneous logs | |
| US10007585B2 (en) | Fault-tolerant methods, systems and architectures for data storage, retrieval and distribution | |
| US10467192B2 (en) | Method and apparatus for updating data table in keyvalue database | |
| CN112487083B (en) | Data verification method and device | |
| CN105824849A (en) | Data import method and adapter | |
| CN111427951A (en) | Data synchronization method and device, computer equipment and storage medium | |
| RU2674886C2 (en) | Method and device for determining sql execution plan | |
| CN113626416A (en) | Data verification method and device, computing equipment and storage medium | |
| CN111651424B (en) | Data processing method, device, data node and storage medium | |
| CN112000671B (en) | Database table processing method, device and system based on block chain | |
| US10387887B2 (en) | Bloom filter driven data synchronization | |
| CN112148713B (en) | Method and device for data migration between heterogeneous databases | |
| CN107861958B (en) | Metadata synchronization method and device | |
| CN111639087A (en) | Data updating method and device in database and electronic equipment | |
| CN116842244A (en) | Search engine data synchronization method, system, device and storage medium | |
| CN115658815A (en) | CDC (control data center) -based data synchronization method | |
| CN118503319B (en) | Database operation method, device, equipment, storage medium and product | |
| CN114547184A (en) | Personnel information synchronization method, terminal device and storage medium | |
| CN112783954A (en) | Data access method and device and server | |
| CN114297221A (en) | Data access method and device and electronic equipment | |
| CN112527765B (en) | Data migration method and device | |
| CN113076273B (en) | Component access method, device, electronic equipment, storage medium and program product | |
| CN109522132A (en) | A kind of method and device that mark generates | |
| CN118410105A (en) | Data reading method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |