CN116074192B - Distributed data center configuration and data acquisition component configuration method and device - Google Patents
Distributed data center configuration and data acquisition component configuration method and device Download PDFInfo
- Publication number
- CN116074192B CN116074192B CN202310121564.XA CN202310121564A CN116074192B CN 116074192 B CN116074192 B CN 116074192B CN 202310121564 A CN202310121564 A CN 202310121564A CN 116074192 B CN116074192 B CN 116074192B
- Authority
- CN
- China
- Prior art keywords
- data
- data acquisition
- information
- relation
- distributed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000004048 modification Effects 0.000 claims abstract description 103
- 238000012986 modification Methods 0.000 claims abstract description 103
- 238000004891 communication Methods 0.000 claims abstract description 77
- 230000008569 process Effects 0.000 abstract description 8
- 238000013480 data collection Methods 0.000 description 10
- 238000007726 management method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method and a device for configuring a distributed data center and configuring a data acquisition assembly, wherein the method for configuring the data acquisition assembly is applied to a designated data acquisition assembly, the designated data acquisition assembly configures a first data communication link according to first data communication link information, the first data communication link information is determined by first data acquisition relation information, and the method specifically comprises the following steps: if the distributed data center configuration acquires data acquisition relation modification information, when the preset condition is met: stopping configuring the first data communication link and acquiring second data acquisition relation information sent by the distributed data center; determining second data communication link information based on the second data acquisition relationship information; the second communication link is configured according to the second data communication link information. The invention can relieve the technical problems of complex configuration process and low configuration efficiency of the data acquisition component in the prior art.
Description
[ Field of technology ]
The embodiment of the invention relates to the technical field of data acquisition, in particular to a distributed data center configuration method and a data acquisition component configuration method and device.
[ Background Art ]
In the process of data acquisition and data management, the data acquisition assembly is configured, so that the data acquisition assembly executes data operation, and in the process, a static configuration method, namely a configuration file, is adopted in the configuration mode of the data acquisition assembly. The static configuration method is to extract and write the data of the configuration file.
However, the data acquisition component cannot dynamically acquire data acquisition relationship information, and at the same time, when the nodes are dynamically expanded, a static configuration file needs to be established at each node. Therefore, the configuration process of the data acquisition component is complex, the configuration efficiency is low, and the operation and maintenance cost is high.
[ Invention ]
The embodiment of the invention provides a method and a device for configuring a distributed data center and configuring a data acquisition component, which are used for solving the technical problems of complex configuration process and low configuration efficiency of the data acquisition component in the prior art.
The invention provides a data acquisition component configuration method, which is applied to a designated data acquisition component, wherein the designated data acquisition component configures a first data communication link according to first data communication link information, the first data communication link information is determined by first data acquisition relation information, and the method specifically comprises the following steps:
If the distributed data center configuration acquires data acquisition relation modification information, when the preset condition is met:
Stopping configuring the first data communication link and acquiring second data acquisition relation information sent by the distributed data center;
determining second data communication link information based on the second data acquisition relationship information;
configuring a second communication link according to the second data communication link information;
The first data acquisition relation information is modified according to the data acquisition relation modification information to generate second data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
In one possible manner, the first data communication link information includes a data source determined by the first data acquisition relationship information, a data target source, and a data path between the data source and the data target source;
The second data communication link information includes a data source, a data target source, and a data path between the data source and the data target source determined by the second data acquisition relationship information.
A possible way is that a distributed database is subject to the management of the distributed data center, the distributed database is provided with a plurality of nodes, the data source comprises a first node and operations performed on data acquired by the first node, and the data target source comprises a second node and operations performed on data output by the second node;
the first node is a node for acquiring data by the data acquisition component;
the second node is a node of the data acquisition component outputting data,
The first node and the second node are nodes arranged for a distributed database.
In one possible manner, the preset condition includes: and more than half of nodes of the database managed by the distributed data center are modified according to the acquired acquisition relation modification information acquired by the distributed data center.
One possible way is that the first data acquisition relationship information comprises a first Host, a first configuration set, a first namespace, and a first user group;
The data acquisition relation modification information comprises modification information of a Host, a configuration set, a naming space and a user group;
the second data acquisition relationship information comprises a second Host, a second configuration set, a second naming space and a second user;
The second Host is a first Host modified according to the data acquisition relation modification information;
the second configuration set is a first configuration set modified according to the data acquisition relation modification information;
the second naming space is a first naming space modified according to the data acquisition relation modification information.
In a second aspect, the present invention provides a distributed data center configuration method, applied to a distributed data center, where the distributed data center configures a data acquisition relationship according to first data acquisition relationship information, and the distributed data center manages at least one distributed database, and specifically includes the following steps:
If the data acquisition relation modification information is acquired, modifying the first data acquisition relation information by the managed distributed database according to the data acquisition relation modification information;
when the preset condition is satisfied:
Determining second data acquisition relationship information;
Transmitting the second data acquisition related information to a designated data acquisition component;
the second data acquisition relation information is first data acquisition relation information modified according to the data acquisition relation modification information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
A possible way is that the distributed database managed by the distributed data center is provided with a plurality of nodes, and the preset condition includes: the step of modifying the first data acquisition relation information by the distributed database managed by the distributed data center according to the data acquisition relation modification information comprises the following steps:
generating a data acquisition relationship modification request based on the data acquisition relationship modification information;
transmitting a data acquisition relation modification request to all nodes of a distributed database managed by the data acquisition relation modification request;
Wherein the data acquisition relationship modification request: and the nodes for receiving the data acquisition relation modification requests in the distributed database are modified according to the data acquisition relation modification information.
One possible way is that the first data acquisition relationship information comprises a first Host, a first configuration set, a first namespace, and a first user group;
The data acquisition relation modification information comprises modification information of a Host, a configuration set, a naming space and a user group;
the second data collection relationship comprises a second Host, a second configuration set, a second namespace, and a second user;
Determining a designated data acquisition component by using the Host value, the configuration set value, the namespace value and the user group value;
The second Host is a first Host modified according to the data acquisition relation modification information;
the second configuration set is a first configuration set modified according to the data acquisition relation modification information;
the second naming space is a first naming space modified according to the data acquisition relation modification information;
the second user group is a first user group modified according to the data acquisition relation modification information.
In a third aspect, the present invention provides a data acquisition component configuration apparatus, applied to a designated data acquisition component, where the designated data acquisition component configures a plurality of first data communication links according to first data communication link information, where the first data communication link information is determined by first data acquisition relationship information, and if the distributed data center configuration obtains data acquisition relationship modification information, the data acquisition component configuration apparatus includes:
and a receiving module: the data acquisition method comprises the steps of stopping configuring a first data communication link and acquiring second data acquisition relation information sent by a distributed data center;
A communication link information determining module: for determining second data communication link information based on the second data acquisition relationship information;
And (3) a configuration module: for configuring a second communication link according to the second data communication link information;
The first data acquisition relation information is modified according to the data acquisition relation modification information to generate second data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
In a fourth aspect, the present invention provides a distributed data center configuration device, applied to a distributed data center, where the distributed data center configures a data relationship according to first data acquisition relationship information, and the distributed data center manages at least one distributed database, and specifically includes the following steps:
and the acquisition relation modification module is used for: if the data acquisition relation modification information is acquired, modifying the first data acquisition relation information by the distributed database according to the data acquisition relation modification information;
the generation module is used for: for, when a preset condition is satisfied:
Determining second data acquisition relationship information;
and a sending module: the second data acquisition related information is used for sending the second data acquisition related information to a designated data acquisition component;
The second data acquisition relation information is first data acquisition relation information modified according to the data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
It should be understood that, in the third aspect and the fourth aspect of the embodiment of the present invention, the technical solutions of the first aspect and the second aspect of the embodiment of the present invention are consistent, and the beneficial effects obtained by each aspect and the corresponding possible implementation manner are similar, and are not repeated.
[ Description of the drawings ]
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a block diagram of a distributed data acquisition system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for configuring a distributed data center and configuring data collection components according to an exemplary embodiment of the present invention;
FIG. 3 is a flow chart illustrating a modification of data acquisition relationship information according to an exemplary embodiment of the present invention;
FIG. 4 is a flowchart illustrating a method for starting up a data acquisition component according to an exemplary embodiment of the present invention;
FIG. 5 is a block diagram of a data acquisition component according to an exemplary embodiment of the present invention;
FIG. 6 is a block diagram of a distributed data center according to an exemplary embodiment of the present invention.
[ Detailed description ] of the invention
For a better understanding of the technical solutions of the embodiments of the present invention, the following describes the embodiments of the present invention in detail with reference to the accompanying drawings.
It should be understood that the described embodiments are merely some, but not all embodiments of the present invention. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the invention, are intended to be within the scope of the embodiments of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of embodiments of the invention. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Referring to fig. 1, a schematic diagram of a distributed data acquisition system according to the present application is first described:
The distributed data acquisition system structure related to the application comprises: the distributed data center, the data acquisition assembly and the distributed database have the following functions:
Distributed data center: the distributed data is configured with a data acquisition relationship according to the data acquisition relationship information, and is used for managing the data acquisition component and the distributed database, for example: transmitting an instruction to the data acquisition component and the distributed database;
and a data acquisition component: performing operations of the distributed data center on the distributed database it manages, including but not limited to: acquiring source data, converting, encrypting, decrypting and storing the source data in a target storage area,
It should be understood that the operation may be performed on the distributed database by configuring the data acquisition component, where the data acquisition component is configured according to the distributed data center, and configured according to a data acquisition relationship of the distributed data center, and where the source data is data acquired by the data acquisition component from a data source of the data acquisition component;
Distributed database: the distributed data center is provided with a plurality of nodes, each node can interact with the distributed data center in information, can respond to the instruction of the distributed data center, generate a data acquisition relationship according to the data acquisition relationship configured by the distributed data center, and is subject to the change of the data acquisition relationship by the distributed data center;
One possible way is that the data acquisition relationship information comprises: host, configuration set (DataID), namespace (Namespace), and user group (GroupID);
it should be understood that the distributed data center, the distributed database and the data acquisition component can perform information interaction two by two;
Embodiment one:
As shown in fig. 2, the embodiment of the present invention provides a distributed data center configuration and data acquisition component configuration method shown in an exemplary embodiment;
First, a scenario of a method for configuring a distributed data center and configuring a data collection component is described:
Under the scene, the distributed data center configures a first data acquisition relationship according to the first data acquisition relationship information;
The designated data acquisition component configures a first data communication link according to first data communication link information, wherein the first data communication link information is determined by first data acquisition relation information;
the first data acquisition relation information comprises a first Host, a first configuration set, a first naming space and a first user group;
in combination with the foregoing, the distributed data center may perform the first data collection information according to the first Host, the first configuration set, the first namespace, and the first user group;
it should be appreciated that the designated data acquisition component may obtain the first data communication link information by parsing the first data acquisition information;
if the distributed data center configuration acquires the data acquisition relationship modification information, the following steps are executed:
s201: if the distributed data center acquires the data acquisition relation modification information, the distributed database modifies the first data acquisition relation information according to the data acquisition relation modification information;
The data acquisition relation modification information is used for modifying the first data acquisition relation information;
one possible way is that the user sets the acquisition relationship modification information through the interactive interface;
s202: when the preset condition is met, the distributed data center determines second data acquisition relation information;
Specifically, the first data acquisition relation information is modified according to the data acquisition relation modification information to generate second data acquisition relation information
One possible way is that the second data collection relationship comprises a second Host, a second configuration set, a second namespace, and a second user;
specifically, the second Host is a first Host modified according to the data acquisition relation modification information;
the second configuration set is a first configuration set modified according to the data acquisition relation modification information;
the second naming space is a first naming space modified according to the data acquisition relation modification information;
the second user group is a first user group modified according to the data acquisition relation modification information;
s203: the distributed data center sends the second data acquisition related information to a designated data acquisition component;
one possible way is that the distributed data center is communicatively coupled to the data acquisition component via a protocol,
In this embodiment, the Host value, the configuration set value, the namespace value, and the user group value may be utilized to determine the designated data collection component;
S204: the designated data acquisition component stops configuring the first data communication link and acquires second data acquisition relation information sent by the distributed data center;
Based on the foregoing, whereas the distributed data center has been configured in accordance with the first data collection relationship information, it should be appreciated that the designated data collection component is configured with a first data communication link;
One possible way is to configure the first communication link in the following way:
the designated data acquisition component acquires first data acquisition relation information, and determines first data communication link information after analysis;
the designated data acquisition component configures a first data communication link according to the first data communication link information;
s205: the designated data acquisition component configures a second data communication link configuration communication link according to the second data communication link information;
one possible way is to determine second data communication link information based on the second data acquisition relationship information, configure the second data communication link to configure the communication link in accordance with the second data communication link information;
It should be noted that, the first data communication link information includes a data source, a data target source, and a data channel between the data source and the data target source, which are determined by the first data acquisition relationship information;
the second data communication link information comprises a data source, a data target source and a data channel between the data source and the data target source, which are determined by second data acquisition relation information;
Further, the data source comprises a first node and an operation executed on data acquired by the first node, and the data target source comprises a second node and an operation executed on data output by the second node;
the first node is a node for acquiring data from the data acquisition component;
the second node is a node for outputting data by the data acquisition component.
Here, the operations performed on the data acquired by the first node include, but are not limited to: deleting fields, adding fields, converting fields, modifying, encrypting and decrypting;
It should be understood that the nodes of the data acquisition component for acquiring data and the nodes of the data output by the data acquisition component are nodes of a distributed database, and the distributed database is subject to the management of a distributed data center;
Dynamic configuration of the data acquisition component is achieved without restarting (only self-starting) the data acquisition component through S201 to S205;
On the basis of the embodiment, a sensing module can be added to the data acquisition component, and the sensing module is used for sensing the acquisition relation change of the distributed data center;
specifically, when a preset condition is met, the data acquisition component sends a second data acquisition relation information acquisition request to the distributed data center, wherein the second data acquisition relation information acquisition request is used for enabling the distributed data center to determine second data acquisition relation information;
The distributed data center receives a second data acquisition relation information acquisition request sent by the data acquisition component and determines second data acquisition relation information;
Steps S201 to S205 have the following technical effects:
1) The data acquisition component is subject to the management of a distributed data center and dynamically perceives the change of the data acquisition relationship;
2) After the data acquisition component perceives the data acquisition relationship, the data acquisition link is regenerated, so that self-updating is realized, capacity expansion efficiency is improved, and operation and maintenance cost is greatly reduced.
On the basis of the foregoing embodiment, the node modification completion degree of the distributed database is utilized as a preset condition, that is:
The preset conditions include: more than half nodes of the distributed database are modified according to the acquisition relation modification information acquired by the data distributed data center;
in this scenario, on the basis of fig. 2, fig. 3 provides a data acquisition relationship information modification flowchart according to an exemplary embodiment, which specifically includes
S301: generating a data acquisition relationship modification request based on the data acquisition relationship modification information;
s302: transmitting the data acquisition relation modification request to all nodes of the distributed database;
Wherein the data acquisition relationship modification request: the nodes for receiving the data acquisition relation modification requests in the distributed database are modified according to the data acquisition relation modification information;
It should be noted that, the distributed data center may send a data acquisition relationship modification request to any node of the distributed database;
The node receiving the data acquisition relation modification request forwards the data acquisition relation modification request to other nodes of the distributed database;
it should be appreciated that the distributed database is subject to distributed data center management;
On the basis, the data acquisition relationship can be modified by utilizing the nodes of the distributed database through S301 and S302;
It should be appreciated that modifications to Host, configuration set, namespaces, and user groups are made to the distributed database nodes.
Embodiment two:
FIG. 4 provides a flowchart of a method for starting a data collection component, which is subject to management by a distributed data center configured with data collection relationships, in accordance with an exemplary embodiment, and specifically includes:
The data acquisition relation configuration method is consistent with the embodiment, and is not repeated;
s401: generating a starting instruction by the distributed data center;
Specifically, the starting instruction is used for starting the data acquisition component;
S402: the distributed data center sends the starting instruction and the data acquisition relation information to a designated data acquisition component;
Further, the distributed data center determines a designated data acquisition component by using the Host value, the configuration set value, the namespace value and the user group value;
here, the designated data acquisition component is subject to management of a unique distributed data center, and the designated data acquisition component acquires unique data acquisition relationship information;
s403: the designated data acquisition component is started in response to the starting instruction, and acquires data acquisition relation information;
Further, the data acquisition relation information comprises a Host, a configuration set, a naming space and a user group;
S404: the designated data acquisition component determines a data acquisition relationship by utilizing the data acquisition relationship information;
Further, the data acquisition relation information comprises a Host, a configuration set, a naming space and a user group;
S405: the designated data acquisition component configures a data communication link using the data acquisition relationship;
Further, the data communication link information includes a data source, a data target source, and a data path between the data source and the data target source, as determined by the data acquisition relationship information.
The designated data acquisition component can be started through S401 to S405.
Embodiment III:
As shown in fig. 5, a third embodiment provides a data acquisition component configuration apparatus according to an exemplary embodiment, which is applied to a designated data acquisition component, where the designated data acquisition component configures a plurality of first data communication links according to first data communication link information, where the first data communication link information is determined by first data acquisition relationship information, and if the distributed data center configuration acquires data acquisition relationship modification information, the data acquisition component configuration apparatus includes:
and a receiving module: the data acquisition method comprises the steps of stopping configuring a first data communication link and acquiring second data acquisition relation information sent by a distributed data center;
A communication link information determining module: for determining second data communication link information based on the second data acquisition relationship information;
And (3) a configuration module: for configuring a second communication link according to the second data communication link information;
The first data acquisition relation information is modified according to the data acquisition relation modification information to generate second data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
The data acquisition component configuration apparatus provided in the embodiment shown in fig. 5 may be used to implement the technical solution of the method embodiment shown in fig. 2 according to the embodiment of the present invention, and the implementation principle and technical effects may be further referred to the related description in the method embodiment.
Embodiment four:
As shown in fig. 6, a fourth embodiment provides a distributed data center configuration apparatus shown in an exemplary embodiment, which is applied to a distributed data center, where the distributed data center configures a data acquisition relationship according to first data acquisition relationship information, and a distributed database obeys the distributed data center, and is applied to the distributed data center, and includes:
and the acquisition relation modification module is used for: if the data acquisition relation modification information is acquired, modifying the first data acquisition relation information by the distributed database according to the data acquisition relation modification information;
the generation module is used for: for, when a preset condition is satisfied:
Determining second data acquisition relationship information;
and a sending module: the second data acquisition related information is used for sending the second data acquisition related information to a designated data acquisition component;
The second data acquisition relation information is first data acquisition relation information modified according to the data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
The first data communication link information is determined by first data acquisition relationship information.
The distributed data center configuration device provided in the embodiment shown in fig. 6 may be used to implement the technical solution of the method embodiment shown in fig. 2 according to the embodiment of the present invention, and the implementation principle and technical effects may be further referred to the related description in the method embodiment.
The foregoing description of specific embodiments of the present invention has been presented for purposes of illustration and description. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
In the description of embodiments of the present invention, a description of reference to the terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of embodiments of the present invention. In embodiments of the invention, the schematic representations of the above terms are not necessarily for the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the various embodiments or examples described in the embodiments of the invention and the features of the various embodiments or examples may be combined and combined by persons skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the embodiments of the present invention, the meaning of "plurality" is at least two, for example, two, three, etc., unless explicitly defined otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiment of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the elements is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
In addition, each functional unit in each embodiment of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.
The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a Processor (Processor) to perform part of the steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a Read-Only Memory (hereinafter referred to as ROM), a random access Memory (Random Access Memory hereinafter referred to as RAM), a magnetic disk, or an optical disk, etc., which can store program codes.
The foregoing description of the preferred embodiments of the present invention is not intended to limit the embodiments of the present invention, but rather, the present invention should be limited to the following claims.
Claims (9)
1. The data acquisition component configuration method is characterized by being applied to a designated data acquisition component, wherein the designated data acquisition component configures a first data communication link according to first data communication link information, the first data communication link information is determined by first data acquisition relation information, the first data acquisition relation information comprises a first Host, a first configuration set, a first naming space and a first user group, and the first data communication link information comprises a data source determined by the first data acquisition relation information, a data target source and a data channel between the data source and the data target source; the method specifically comprises the following steps:
If the distributed data center is configured to acquire the data acquisition relation modification information, and the preset condition is that more than half of nodes of a database managed by the distributed data center are modified according to the acquisition relation modification information acquired by the distributed data center when the preset condition is satisfied,
Stopping configuring the first data communication link and acquiring second data acquisition relation information sent by the distributed data center;
Determining second data communication link information based on second data acquisition relationship information, the second data acquisition relationship information comprising a second Host, a second configuration set, a second namespace, and a second user, the second data communication link information comprising a data source, a data target source, and a data channel between the data source and the data target source determined by the second data acquisition relationship information;
Configuring a second communication link according to the second data communication link information;
The first data acquisition relation information is modified according to the data acquisition relation modification information to generate second data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
2. The method of claim 1, wherein the first data communication link information comprises a data source, a data target source, and a data path between the data source and the data target source determined by the first data acquisition relationship information;
The second data communication link information includes a data source, a data target source, and a data path between the data source and the data target source determined by the second data acquisition relationship information.
3. The method according to claim 2, wherein a distributed database is subject to management of the distributed data center, the distributed database being provided with a plurality of nodes, the data source comprising a first node and operations performed on data acquired by the first node, the data target source comprising a second node and operations performed on data output by the second node;
the first node is a node for acquiring data by the data acquisition component;
the second node is a node of the data acquisition component outputting data,
The first node and the second node are nodes arranged for a distributed database.
4. A method according to any one of claim 1 to 3, wherein,
The data acquisition relation modification information comprises modification information of a Host, a configuration set, a naming space and a user group;
The second Host is a first Host modified according to the data acquisition relation modification information;
the second configuration set is a first configuration set modified according to the data acquisition relation modification information;
the second naming space is a first naming space modified according to the data acquisition relation modification information.
5. The distributed data center configuration method is applied to a distributed data center, and is characterized in that the distributed data center configures data acquisition relations according to first data acquisition relation information, the first data acquisition relation information comprises a first Host, a first configuration set, a first naming space and a first user group, a distributed database obeys the distributed data center and is applied to the distributed data center, and the method specifically comprises the following steps:
if the data acquisition relation modification information is acquired, modifying the first data acquisition relation information by the distributed database according to the data acquisition relation modification information;
when the preset condition is met, the preset condition package is that more than half of nodes of the distributed database are modified according to the acquisition relation modification information acquired by the data distributed data center,
Determining second data acquisition relationship information, wherein the second data acquisition relationship information comprises a second Host, a second configuration set, a second naming space and a second user;
transmitting the second data acquisition relationship information to a designated data acquisition component;
the second data acquisition relation information is first data acquisition relation information modified according to the data acquisition relation modification information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
6. The method of claim 5, wherein the distributed database is provided with a plurality of nodes, and wherein the step of modifying the first data acquisition relationship information to the distributed database according to the data acquisition relationship modification information comprises:
generating a data acquisition relationship modification request based on the data acquisition relationship modification information;
transmitting a data acquisition relation modification request to all nodes of the distributed database;
wherein the data acquisition relationship modification request: and the nodes for receiving the data acquisition relation modification requests in the distributed database are modified according to the data acquisition relation modification information.
7. The method according to any one of claim 5 to 6, wherein,
The data acquisition relation modification information comprises modification information of a Host, a configuration set, a naming space and a user group;
Determining a designated data acquisition component by using the Host value, the configuration set value, the namespace value and the user group value;
The second Host is a first Host modified according to the data acquisition relation modification information;
the second configuration set is a first configuration set modified according to the data acquisition relation modification information;
the second naming space is a first naming space modified according to the data acquisition relation modification information;
the second user group is a first user group modified according to the data acquisition relation modification information.
8. The data acquisition component configuration device is characterized by being applied to a designated data acquisition component, wherein the designated data acquisition component configures a first data communication link according to first data communication link information, the first data communication link information is determined by first data acquisition relation information, the first data acquisition relation information comprises a first Host, a first configuration set, a first naming space and a first user group, the first data communication link information comprises a data source determined by the first data acquisition relation information, a data target source and a data channel between the data source and the data target source, and if a distributed data center configures acquisition data acquisition relation modification information, the preset condition is that more than half of nodes of the distributed database are modified according to the acquisition relation modification information acquired by the data distributed data center when the preset condition is met, the data acquisition component configuration device comprises:
and a receiving module: the data acquisition method comprises the steps of stopping configuring a first data communication link and acquiring second data acquisition relation information sent by a distributed data center;
A communication link information determining module: determining second data communication link information based on second data acquisition relationship information, the second data acquisition relationship information comprising a second Host, a second configuration set, a second namespace, and a second user, the second data communication link information comprising a data source, a data target source, and a data channel between the data source and the data target source determined by the second data acquisition relationship information;
And (3) a configuration module: for configuring a second communication link according to the second data communication link information;
The first data acquisition relation information is modified according to the data acquisition relation modification information to generate second data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
9. A distributed data center configuration device applied to a distributed data center, wherein the distributed data center configures a data acquisition relationship according to first data acquisition relationship information, the first data acquisition relationship information comprises a first Host, a first configuration set, a first naming space and a first user group, a distributed database obeys the distributed data center, and the distributed data center is applied to the distributed data center, and the distributed data center configuration device comprises:
and the acquisition relation modification module is used for: if the data acquisition relation modification information is acquired, modifying the first data acquisition relation information by the distributed database according to the data acquisition relation modification information;
the generation module is used for: is used for completing the modification of the nodes of more than half of the distributed database according to the acquired acquisition relation modification information acquired by the data distributed data center when the preset condition is met,
Determining second data acquisition relationship information, wherein the second data acquisition relationship information comprises a second Host, a second configuration set, a second naming space and a second user;
and a sending module: the second data acquisition relation information is used for sending the second data acquisition relation information to a designated data acquisition component;
The second data acquisition relation information is first data acquisition relation information modified according to the data acquisition relation information;
The data acquisition relationship modification information is used for modifying the first data acquisition relationship information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310121564.XA CN116074192B (en) | 2023-02-14 | 2023-02-14 | Distributed data center configuration and data acquisition component configuration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310121564.XA CN116074192B (en) | 2023-02-14 | 2023-02-14 | Distributed data center configuration and data acquisition component configuration method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116074192A CN116074192A (en) | 2023-05-05 |
| CN116074192B true CN116074192B (en) | 2024-09-10 |
Family
ID=86174747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310121564.XA Active CN116074192B (en) | 2023-02-14 | 2023-02-14 | Distributed data center configuration and data acquisition component configuration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116074192B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104580456A (en) * | 2014-12-31 | 2015-04-29 | 深圳市兰丁科技有限公司 | Dynamic message distribution method and system used for distributed system |
| CN114356712A (en) * | 2022-01-04 | 2022-04-15 | 腾讯科技(成都)有限公司 | Data processing method, device, equipment, readable storage medium and program product |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| MX2016007529A (en) * | 2013-12-11 | 2016-09-13 | Sca Hygiene Prod Ab | Configuration of distributed data acquisition equipment. |
| CN113055297B (en) * | 2019-12-26 | 2022-09-27 | 中国移动通信集团天津有限公司 | Network topology discovery method and device |
| CN113485934A (en) * | 2021-07-23 | 2021-10-08 | 掌阅科技股份有限公司 | Distributed index data acquisition method, electronic device and storage medium |
-
2023
- 2023-02-14 CN CN202310121564.XA patent/CN116074192B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104580456A (en) * | 2014-12-31 | 2015-04-29 | 深圳市兰丁科技有限公司 | Dynamic message distribution method and system used for distributed system |
| CN114356712A (en) * | 2022-01-04 | 2022-04-15 | 腾讯科技(成都)有限公司 | Data processing method, device, equipment, readable storage medium and program product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116074192A (en) | 2023-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101316226B (en) | Method, device and system for acquiring resources | |
| US10824372B2 (en) | Data recovery method and device, and cloud storage system | |
| CN112532415B (en) | Configuration change method and related device | |
| CN113204598B (en) | Data synchronization method, system and storage medium | |
| CN112363845A (en) | Data synchronization method of system integration middling station and integration middling station system | |
| CN110287041A (en) | A kind of business datum sending method, device, equipment and storage medium | |
| CN113051102B (en) | File backup method, device, system, storage medium and computer equipment | |
| CN116737130A (en) | Method, system, equipment and storage medium for compiling modal-oriented intermediate representation | |
| CN114900570B (en) | Standardized data acquisition and transmission method and system | |
| CN116074192B (en) | Distributed data center configuration and data acquisition component configuration method and device | |
| CN108243207A (en) | A kind of date storage method of network cloud disk | |
| CN109683916A (en) | A kind of method of cloud mirrored host computer of the autonomous creation comprising application software | |
| CN112035413B (en) | Metadata information query method, device and storage medium | |
| CN102638569B (en) | File distribution synchronizing method and system | |
| CN111552715A (en) | User query method and device | |
| CN113626099B (en) | Application program starting method and device and electronic equipment | |
| CN112231405B (en) | Data storage device | |
| CN115328679A (en) | Automatic integration method of heterogeneous function library, computing equipment and system thereof | |
| CN104954823B (en) | A kind of figure calculates the device of pretreatment, method and system | |
| CN113590348A (en) | Parameter transmission method, device, equipment and medium based on tree structure | |
| CN107332679B (en) | Centerless information synchronization method and device | |
| CN114490517A (en) | Data processing method, device, computing node and computer readable storage medium | |
| CN112148795B (en) | Data processing method, device, equipment and medium | |
| CN112672180B (en) | Live interface element configuration method, device and storage medium | |
| CN113504896B (en) | Service data processing method and device of application program and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240115 Address after: No. 13 Xingxiang Road, Zengjia Town, High tech Zone, Shapingba District, Chongqing, 400039 Applicant after: Chongqing Selis Phoenix Intelligent Innovation Technology Co.,Ltd. Address before: Room 2901, Floor 29, Unit 1, Building 1, No. 151, Tianfu Second Street, Chengdu Hi tech Zone, Chengdu Free Trade Pilot Zone, 610,000, Sichuan Applicant before: Chengdu Thalys Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |