CN206164759U - A cross-network multi-source heterogeneous data acquisition device - Google Patents

Abstract

The utility model discloses a cross-network multi-source heterogeneous data collection device, comprising: a plurality of network interfaces, single-pole double-throw switches corresponding to the network interfaces one by one, an internal network data collection and processing module, and an external network data collection and processing module. module, a network isolation and data integration module, and a data storage module, the network interface is respectively connected to the internal network data collection and processing module and the external network data collection and processing module through the two fixed ends of the single-pole double-throw switch; The internal network data collection and processing module and the external network data collection and processing module are respectively connected to the data storage module through the network isolation and data exchange module; this device solves the problem of interaction and storage of heterogeneous data between physically isolated networks , On the basis of ensuring the security of the internal network, the data interaction performance is improved; the expansion performance is high; the free configuration of the network interface corresponding to the external network or the internal network is realized.

Description

A cross-network multi-source heterogeneous data acquisition device

technical field

The utility model relates to the technical field of data exchange, in particular to a cross-network multi-source heterogeneous data acquisition device.

Background technique

At present, many large-scale enterprise networks are divided into internal and external networks that are physically isolated. The internal network is used for internal production and operation management of the enterprise, and the external network is used to provide Internet services. Business application system data are deployed in databases on the internal and external networks according to needs. middle. With the development of Internet applications, more and more business applications are deployed on the external network. Enterprise management decisions usually need to collect data from different business systems on the internal and external networks for correlation analysis and comprehensive evaluation. Due to the physical isolation of the internal and external networks, storage media such as U disks are generally used for data exchange between the internal and external networks, and there are problems such as limited data formats and poor real-time data exchange between internal and external networks. The network interfaces of common data acquisition devices are respectively provided with internal network interfaces and external network interfaces. After the device is assembled, the ratio of the number is fixed. When the number of business application systems in the internal network or external network increases, the number of network interfaces not enough.

Utility model content

The technical problem to be solved by the utility model is to provide a cross-network multi-source heterogeneous data acquisition device to solve the problems of limited transmission data format and poor real-time data exchange between internal and external networks; it can flexibly match internal and external networks according to actual needs The network interface of the net.

In order to solve the above technical problems, the utility model provides a cross-network multi-source heterogeneous data acquisition device, including: a plurality of network interfaces, single-pole double-throw switches corresponding to the network interfaces one by one, used to collect intranet data Intranet data collection and processing module for processing, external network data collection and processing module for collecting and processing external network data, network isolation and data collection for one-way transmission of external network data to internal network and data merging an integration module, a data storage module for storing merged data,

Wherein, the network interface is respectively connected to the internal network data collection and processing module and the external network data collection and processing module through the two fixed ends of the single pole double throw switch;

The internal network data collection and processing module and the external network data collection and processing module are respectively connected to the data storage module through the network isolation and data exchange module.

Further, the intranet data collection and processing module includes an intranet data collection unit for collecting intranet data and an intranet data processing unit for standardizing the format of the collected intranet data.

Further, the external network data collection and processing module includes an external network data collection unit for collecting external network data and an external network data processing unit for format-standardizing the collected external network data.

Further, the network isolation and data integration module includes a network isolation unit and a data integration unit,

The network isolation unit is used to unidirectionally transmit data from the external network to the internal network according to a dedicated communication protocol;

The data integration unit is used to integrate external network data and internal network data and send them to the data storage module.

Further, it also includes a mainboard, the network isolation and data merging module, and the data storage module are connected through circuits on the mainboard, and the external network data collection and processing module and the internal network data collection and processing module are connected to the mainboard through slots .

Further, the motherboard is also provided with a plurality of reserved slots.

Further, a storage terminal interface is also included, and the storage terminal interface is connected to the data storage module.

Further, the storage terminal interface is an RJ-45 interface.

Further, the network interface is an RJ-45 interface.

Further, four RJ-45 interfaces are provided.

The cross-network multi-source heterogeneous data acquisition device of the utility model has the following beneficial effects:

1. This device integrates data collection, internal and external network data transmission, and data processing, which can effectively reduce the workload of system deployment and shorten the cycle of equipment design, installation and commissioning;

2. This device integrates a one-way transmission module of physically isolated network data, which solves the problem of heterogeneous data interaction between physically isolated networks, and improves data interaction performance on the basis of ensuring intranet security;

3. The data acquisition and processing module of this device adopts the slot mode, which has high expansion performance;

4. The network interface of this device can be freely switched to the data acquisition and processing module or the data acquisition and processing module, so as to realize the flexible configuration of the network interface of the internal network or the external network.

Description of drawings

Fig. 1 is the structural representation of an embodiment of the cross-network multi-source heterogeneous data acquisition device of the utility model;

Fig. 2 is a structural schematic diagram of the intranet data collection and processing module of the utility model;

Fig. 3 is a schematic structural diagram of the external network data acquisition and processing module of the utility model;

Fig. 4 is a schematic structural diagram of the network isolation and data integration module of the utility model.

In the figure, 1 network interface, 2 SPDT switch, 3 internal network data collection and processing module, 31 internal network data collection unit, 32 internal network data processing unit, 4 external network data collection and processing module, 41 external network data collection unit, 42 external network data processing unit, 5 network isolation and data integration module, 51 data integration unit, 52 network isolation unit, 6 data storage module, 7 storage terminal interface.

detailed description

The utility model will be further described below in conjunction with the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the utility model and implement it, but the examples given are not intended to limit the utility model.

Embodiment one:

As shown in Fig. 1, Fig. 2 and Fig. 3, a cross-network multi-source heterogeneous data collection device includes: a plurality of network interfaces 1, single-pole double-throw switches 2 corresponding to the network interfaces 1 one-to-one, Intranet data collection and processing module for collecting and processing intranet data 3, external network data collection and processing module for collecting and processing external network data 4, for one-way transmission of external network data to internal network and data processing A network isolation and data integration module 5 for merging, a data storage module 6 for storing the merged data,

Wherein, the network interface 1 is respectively connected to the internal network data collection and processing module 3 and the external network data collection and processing module 4 through the two fixed ends of the SPDT switch 2;

The internal network data collection and processing module 3 and the external network data collection and processing module 4 are respectively connected to the data storage module 6 through the network isolation and data exchange module 5 .

The intranet data collection and processing module 3 includes an intranet data collection unit 31 for collecting intranet data and an intranet data processing unit 32 for standardizing the format of the collected intranet data.

The external network data collection and processing module 4 includes an external network data collection unit 41 for collecting external network data and an external network data processing unit 42 for format-standardizing the collected external network data.

The intranet data collection unit 31 is connected to the intranet device through the SPDT switch 2 and the network interface 1, collects the first data of the intranet device and sends it to the intranet data processing unit 32, and the intranet The data processing unit 32 converts the first data into third data by marking, cleaning, and normalizing the format, and sends the third data to the network isolation and data integration module 5;

The external network data acquisition unit 41 is connected to the external network device through the single pole double throw switch 2 and the network interface 1, collects the second data of the external network device and sends it to the external network data processing unit 42, and the external network The data processing unit 42 converts the second data into fourth data by marking, cleaning, and normalizing the format, and sends the fourth data to the network isolation and data integration module 5;

The network isolation and data integration module 5 includes a network isolation unit 52 and a data integration unit 51,

The network isolation unit 52 is configured to unidirectionally transmit the fourth data to the data integration unit 51 according to a dedicated communication protocol;

The data integration unit 51 is configured to integrate the fourth data and the third data into a fifth and send it to the data storage module 6 .

Intranet data collection unit 31 and external network data collection unit 41 automatically extract data from internal network equipment and external network equipment by configuring relevant strategies, defining parameters such as relevant interfaces, cycles, calling frequency and objects, and data collection strategies can be based on Different business systems, application scenarios, and requirements are defined separately; the collected data comes from various sources, is huge in quantity, has various structures, and has various attributes, and requires preprocessing such as data labeling, cleaning, and format standardization conversion. Data labeling and cleaning is mainly based on the business system, type, structure, size, etc. to which the data belongs, and is marked with a unified standard to identify the source, type and other attributes of the data. At the same time, combined with the data rule base, according to the data mark, the corresponding rules and data are encapsulated, and the encapsulated data can be identified, controlled and have corresponding cleaning rules. Data format normalization conversion mainly improves the accuracy and performance of data mining or data stream mining through operations such as data generalization, normalization, and data attribute construction. Data generalization uses concept hierarchy to replace low-level "raw" data with high-level concepts, and generalizes the original data in the database into conceptual level, aggregated, and statistically significant metadata that users are interested in. Provides a good data environment. The main strategies of generalization include generalization on the smallest decomposition unit, attribute removal, concept tree climbing, and attribute addition. Related generalization algorithms include generalization algorithms for attribute induction and generalization algorithms based on data cubes.

After the internal and external network data are processed, standardized third data and fourth data in a unified format are formed. The network isolation unit 52 adopts a dedicated communication protocol between the internal network and the external network, and only allows one-way data transmission between the data integration unit 51 and the data processing unit 42 of the external network. After the external network data processing unit 42 completes the processing, it sends a data transmission request message to the data integration unit 51. After the data integration unit 51 verifies the request message, it extracts data from the external network data processing unit 42 according to the predefined data transmission rules. After validity and safety verification, the data is integrated into fifth data and stored in the data storage module 6 . Data transmission rules can be defined according to different business systems, application scenarios and requirements.

The data storage module 6 is configured to store the fifth data.

The fifth data stored in the data storage module 6 can be provided to external devices through the storage terminal interface 7, and the storage terminal interface is an RJ-45 interface.

The cross-network multi-source heterogeneous data acquisition device also includes a main board, the network isolation and data merging module 5, and the data storage module 6 are connected by circuits on the main board, and the internal network data collection and processing module 3 and the external network data The acquisition processing module 4 is connected with the main board through a slot.

The motherboard is also provided with a plurality of reserved slots, which can be used to expand the quantity of the internal network data collection and processing module 3 and the external network data collection and processing module 4 .

In this embodiment, four network interfaces 1 are provided, and the network interfaces are RJ-45 interfaces, and different numbers of network interfaces 1 can also be set according to needs.

During the use of the cross-network multi-source heterogeneous data acquisition device, the network interface 1 can be selected to be connected to the internal network data acquisition and processing module 3 or the external network data acquisition and processing module 4 by switching the different states of the single-pole double-throw switch 6, That is, when the number of network interfaces is fixed, the proportion of network interface 1 connecting external network devices and internal network devices can be freely selected.

The above-mentioned embodiments are only preferred embodiments for fully illustrating the utility model, and the protection scope of the utility model is not limited thereto. Equivalent substitutions or transformations made by those skilled in the art on the basis of the present utility model are all within the protection scope of the present utility model. The scope of protection of the utility model shall be determined by the claims.

Claims (10)

1. the multi-source heterogeneous data acquisition unit of a kind of across a network, it is characterised in that include：Multiple network interfaces and the network The one-to-one single-pole double-throw switch (SPDT) of interface, for gather intranet data and processed intranet data acquisition processing module, For gather outer network data and processed outer net digital sampling and processing, for outer net data to be one-way transmitted into Intranet And the Network Isolation that merges data and Data Integration module, merge for storage after data data memory module,

Wherein, the network interface by two of the single-pole double-throw switch (SPDT) not moved end be respectively connecting to the intranet data and adopt Collection processing module and outer net digital sampling and processing；

The intranet data acquisition processing module and outer net digital sampling and processing are respectively by the Network Isolation and data Switching Module is connected to the data memory module.

2. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 1, it is characterised in that the intranet data collection Processing module, including for gathering the intranet data collecting unit of intranet data and for the intranet data for being collected to be carried out The intranet data processing unit of format specificationization process.

3. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 1, it is characterised in that the outer net data acquisition Processing module, including for gathering the outer net data acquisition unit of outer network data and for the outer network data for being collected to be carried out The outer net data processing unit of format specificationization process.

4. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 1, it is characterised in that the Network Isolation sum Include Network Isolation unit and data integral unit according to module is integrated,

The Network Isolation unit, for outer network data to be one-way transmitted into Intranet according to private communication protocol；

The Data Integration unit, for integrating and sending to the data memory module outer network data and intranet data.

5. the multi-source heterogeneous data acquisition unit of across a network as described in Claims 1-4 is arbitrary, it is characterised in that also including master Plate, the Network Isolation and data combiners block, data memory module are connected by the main on-board circuitry, the outer network data Acquisition processing module and intranet data acquisition processing module are connected by slot with the mainboard.

6. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 5, it is characterised in that the mainboard is additionally provided with Multiple reserved slots.

7. the multi-source heterogeneous data acquisition unit of across a network as described in Claims 1-4 is arbitrary, it is characterised in that also including depositing Storage end interface, the storage end interface is connected with the data memory module.

8. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 7, it is characterised in that the storage end interface is RJ-45 interfaces.

9. the multi-source heterogeneous data acquisition unit of across a network as described in Claims 1-4 is arbitrary, it is characterised in that the network Interface is RJ-45 interfaces.

10. the multi-source heterogeneous data acquisition unit of across a network as claimed in claim 9, it is characterised in that be provided with four RJ-45 Interface.