CN114827140A - Real-time data centralized management and control system for wind tunnel site - Google Patents
Real-time data centralized management and control system for wind tunnel site Download PDFInfo
- Publication number
- CN114827140A CN114827140A CN202210355416.XA CN202210355416A CN114827140A CN 114827140 A CN114827140 A CN 114827140A CN 202210355416 A CN202210355416 A CN 202210355416A CN 114827140 A CN114827140 A CN 114827140A
- Authority
- CN
- China
- Prior art keywords
- data
- management
- real
- database
- wind tunnel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000012360 testing method Methods 0.000 claims abstract description 60
- 238000003860 storage Methods 0.000 claims abstract description 44
- 238000012545 processing Methods 0.000 claims abstract description 31
- 230000036541 health Effects 0.000 claims abstract description 29
- 238000005259 measurement Methods 0.000 claims abstract description 20
- 238000012544 monitoring process Methods 0.000 claims abstract description 9
- 238000007726 management method Methods 0.000 claims description 93
- 238000000034 method Methods 0.000 claims description 24
- 238000013523 data management Methods 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 17
- 238000004458 analytical method Methods 0.000 claims description 16
- 238000011084 recovery Methods 0.000 claims description 11
- 238000013480 data collection Methods 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 10
- 239000008186 active pharmaceutical agent Substances 0.000 claims description 6
- 238000004422 calculation algorithm Methods 0.000 claims description 6
- 238000013507 mapping Methods 0.000 claims description 6
- 238000011160 research Methods 0.000 claims description 6
- 241001640558 Cotoneaster horizontalis Species 0.000 claims description 3
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000004140 cleaning Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000013479 data entry Methods 0.000 claims description 3
- 238000009826 distribution Methods 0.000 claims description 3
- 230000010354 integration Effects 0.000 claims description 3
- 230000008520 organization Effects 0.000 claims description 3
- 229910052760 oxygen Inorganic materials 0.000 claims description 3
- 239000001301 oxygen Substances 0.000 claims description 3
- 239000007921 spray Substances 0.000 claims description 3
- 230000003068 static effect Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 abstract description 19
- 230000002776 aggregation Effects 0.000 abstract description 5
- 238000004220 aggregation Methods 0.000 abstract description 5
- 238000013461 design Methods 0.000 abstract description 5
- 230000003993 interaction Effects 0.000 abstract description 4
- 230000035515 penetration Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 14
- 238000005457 optimization Methods 0.000 description 9
- 238000007619 statistical method Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000012795 verification Methods 0.000 description 4
- 238000009825 accumulation Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 210000001503 joint Anatomy 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000012550 audit Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 241000932075 Priacanthus hamrur Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000007711 solidification Methods 0.000 description 1
- 230000008023 solidification Effects 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
- H04L63/0227—Filtering policies
- H04L63/0236—Filtering by address, protocol, port number or service, e.g. IP-address or URL
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/083—Network architectures or network communication protocols for network security for authentication of entities using passwords
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0876—Network architectures or network communication protocols for network security for authentication of entities based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/20—Network architectures or network communication protocols for network security for managing network security; network security policies in general
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Power Engineering (AREA)
- Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a real-time data centralized management and control system for a wind tunnel site, which carries out data aggregation of multiple dimensions on a control system, a measurement system, a health management system and a wind tunnel auxiliary system of a wind tunnel test site through a data acquisition and storage middleware and a database cluster, realizes the full data link penetration of data from acquisition, transmission, storage, processing, utilization and backup, can trace full-granularity information and carries out unified management on system management software through the database cluster, the system management software and a database system safety management system; the database cluster is provided with a master database and a slave database (backup database) design, so that all data in the system can be backed up and restored conveniently; the key points of the real-time data transmission process are monitored by combining the acquisition network health monitoring of system management software, the data loss caused by wind tunnel field power failure, infrastructure faults and performance problems is eliminated or reduced as much as possible, and the data interaction is perfected for other service systems.
Description
Technical Field
The invention relates to the technical field of data management, in particular to a real-time data centralized management and control system for a wind tunnel site.
Background
The wind tunnel test data management is used as the core of the model test and is an important support for optimizing a test scheme, adjusting model design, improving test and model quality, solving the problem of the model test and carrying out integrated test identification and evaluation.
With the improvement of the technical level of new-generation information and the leap of data processing capability, the wind tunnel equipment is taken as a basic strategic resource for aerodynamic research and the development of advanced weaponry such as aerospace and the like, and the digital wind tunnel tends to be developed in the aspects of upgrading, reconstruction, new construction and future development; however, the existing wind tunnel test capability has not been adapted to the requirements of rapid development of aerospace: firstly, in recent years, key model research tasks are more and more, more rigorous requirements are provided for wind tunnel test efficiency, test quality, data management and the like, test data of each device are stored in a file form, the format is various, the randomness is large, and direct structural storage is difficult; the system for field control measurement and the like has strong closure and complexity, the data formats and interface protocols of different equipment and systems are different, and the data cannot realize information sharing, cooperative work, decentralized operation and centralized management due to the difference of heterogeneous data source interfaces and protocols; thirdly, a large amount of reliable wind tunnel test data are needed as a basis for higher-level aerodynamic analysis and evaluation research, and although a large amount of test data are accumulated at a high speed, data parameters are missing, versions are unclear, and deep application of the data is very difficult.
The existing data acquisition and storage is mainly a traditional relational database, and the data is displayed and analyzed by receiving real-time sensor data uploaded by a PLC (programmable logic controller), and then accessing the relational database by using an intranet through an analysis query display system self-built by a related analysis platform to call related data; because the data acquisition frequency of the wind tunnel field test is high, the traditional relational database system runs in overload along with the continuous expansion of real-time data scale and the continuous accumulation of storage time, and the data reading efficiency and speed are directly influenced; and the breakpoint resume mode has a slow transmission speed, and when the transmission network is interrupted, data is easily and frequently lost.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: because the data acquisition frequency of the wind tunnel field test is high, the traditional relational database system runs in an overload mode along with the continuous expansion of real-time data scale and the continuous accumulation of storage time, and the data reading efficiency and speed are directly influenced; and the transmission speed of the breakpoint continuous transmission mode is low, and when the transmission network is interrupted, data is easy to lose frequently. The invention aims to provide a real-time data centralized management and control system for a wind tunnel site, which carries out multidimensional data aggregation on a control system, a measurement system, a health management system and a wind tunnel auxiliary system of a wind tunnel test through a data acquisition and storage middleware, and carries out centralized classified storage through a database cluster, so that data calling, display and analysis of system management software are facilitated; and the backup database is independently arranged to backup the plurality of kinds of databases so as to avoid the data loss phenomenon caused by the interruption of the transmission network.
The invention is realized by the following technical scheme:
this scheme provides a real-time data concentrates management and control system for wind-tunnel is on-spot, includes: the system comprises data acquisition and storage middleware, a database cluster, system management software and a database system security management system;
the data acquisition and storage middleware acquires real-time data from a control system, a measurement system, a health management system and a wind tunnel auxiliary system of a wind tunnel site and pushes the real-time data to a database cluster;
the database cluster comprises a backup database and a plurality of kinds of databases, the database cluster analyzes and stores the real-time data, and the backup database completes the complete backup of the various kinds of databases;
the database system safety management system completes the safety access and control on the data in the database cluster;
the system management software completes data management, collection network health monitoring, data alarming, historical data retrieval and analysis on the basis of a database and data collection and storage middleware.
The working principle of the scheme is as follows: when the existing database system is applied to a wind tunnel field test, the problems of scattered data management, no connectivity with a wind tunnel field external service system, serious data loss and no effective data safety protection mechanism exist; the invention aims to provide a real-time data centralized management and control system for a wind tunnel field, which carries out data aggregation of multiple dimensions on a control system, a measurement system, a health management system and a wind tunnel auxiliary system of a wind tunnel field test through a data acquisition and storage middleware and a database cluster, realizes the full data link penetration of data from acquisition, transmission, storage, processing, utilization and backup through the database cluster, system management software and a database system safety management system, can trace back full-granularity information, and carries out unified management through the system management software; centralized classified storage is carried out through a database cluster, so that data calling, displaying and analyzing are conveniently carried out by system management software; and the backup database is independently arranged to backup the plurality of kinds of databases so as to avoid the data loss phenomenon caused by the interruption of the transmission network.
The database cluster is provided with a master database and a slave database (backup database), so that the database cluster has the management functions of the master database and the backup database, and the database cluster is in butt joint with a basic data backup control system (a database system safety management system or system management software), so that all data in the system can be backed up and restored more conveniently; the key points of the real-time data transmission process are monitored by combining the acquisition network health monitoring of system management software, the data loss caused by wind tunnel field power failure, infrastructure faults and performance problems is eliminated or reduced as much as possible, and the data interaction is perfected for other service systems.
The data acquisition middleware acquires data from a control system, a measurement system, a health management system and other related wind tunnel auxiliary systems serving the wind tunnel and applying wind tunnel data of the wind tunnel site, and acquires or receives the data from equipment, configuration software and user data acquisition and processing software; the wind tunnel field data acquisition equipment can be divided into two categories, one category is PLC, the other category is various professional data acquisition equipment, so that the wind tunnel field data acquisition equipment also comprises data acquisition middleware and statistical analysis middleware, and the statistical analysis middleware is divided into a database cluster.
The further optimization scheme is that the system further comprises a data service system, the data service system is used for finishing the treatment of original data, statistical data and algorithm data, and the original data, the statistical data and the algorithm data are data of system management software in the data management process.
The method comprises the steps of integrating, standardizing, labeling, assembling data services, providing the data services for an application system passing authentication and certification through a data call interface, and supporting functions of data statistical analysis, historical data retrieval, reporting and the like.
The further optimization scheme is that the data service system issues real-time data to other downstream service systems in a Web API, MQTT or NI shared variable (PSP) mode, and the data service system supports two modes of overall issuing of a single device signal and independent issuing of a single device signal.
The relational data and the real-time data are unified to provide data services by adopting a WebAPI service interface, and are communicated by adopting a standard JSON data format. The service-requiring interface provides equipment information acquisition, driving task list information acquisition and equipment health state acquisition, and signal information of a single piece of equipment is released, signal information of the single piece of equipment is released, and the like to be acquired through the service-requiring interface; the video data provides data service by adopting streaming media service, supports real-time video stream viewing and historical video playback, can inquire and play back videos of specified time, specified place, specified camera and specified test train number, and can simultaneously display multiple paths of videos according to configuration; the unstructured data provides data services by adopting an HTTP service interface, and all resources such as texts, pictures, drawings and the like can be accessed through the HTTP service interface.
The further optimization scheme is that the data acquisition and storage middleware comprises an OPCDA/UA server and a Modbus industrial protocol, and supports PC-Base, field configuration software, a TCP/IP protocol and a Socket protocol.
The system can realize the access, acquisition and storage of real-time data in control systems of different manufacturers, different protocols and different versions, and supports the connection of PLC, DCS and SCAD database system interfaces such as PC-Base/WinCC/Labview and the like, thereby realizing the low-delay transmission of the real-time data.
The further optimization scheme is that the control system comprises: a flexible wall spray pipe control system, a full model car control system and a tunnel body state control system;
the measurement system includes: a total pressure measuring system, a total temperature measuring system, a static pressure measuring system, a dew point measuring system, an oxygen content measuring system, a noise measuring system and a turbulence measuring system of the wind tunnel field PXI and the pressure scanning valve;
the health management system includes: the device comprises a spray pipe section management system, a test section management system, a two-throat temperature management system, a strain sensor management system and a vibration sensor management system.
The method designs a software and hardware topology structure with distributed acquisition and centralized storage, supports the real-time acquisition, processing, storage and management of each system data of the wind tunnel, the solidification and storage of the operation flow of the wind tunnel test, the tracing of the wind tunnel fault, the support of the analysis data and the like
The further optimization scheme is that the real-time data acquisition process of the control system comprises the following steps: the method comprises the steps that PLC/PC-Base mapping is used for obtaining, field configuration software serves as an OPC UA Server, a data collection and storage middleware serves as an OPC UA Client, and after the data collection and storage middleware is connected to a Server, a value corresponding to a designated node and PLC data is obtained in an active reading or subscribing mode;
the real-time data acquisition process of the measurement system comprises the following steps: the data acquisition and storage middleware defines an NI Labview data interface and acquires real-time data through a TCP/IP protocol or an NI-PSP;
the real-time data acquisition process of the health management system comprises the following steps: and the data acquisition and storage middleware defines a WebAPI interface and performs read-write access on the real-time data through HTTPS to obtain the real-time data.
The further optimization scheme is that the category database comprises: unstructured databases, video databases, relational databases, and real-time databases;
the unstructured database is used for storing data in wind tunnel test management, equipment management and scientific research management, and the data comprises text data, picture data and drawing data;
the video database is used for storing wind tunnel test section video data and field video data;
the relational database is used for storing wind tunnel test organization, wind tunnel test operation, wind tunnel test results, wind tunnel test result processing data and wind tunnel test comprehensive data;
the real-time database is used for storing real-time data of the control system, the measurement system and the health management system.
The master database and the slave database are designed to have the management functions of the master database and the backup database, have the capability of being in butt joint with a common data backup system, and can realize backup and recovery of all data in the system.
The further optimization scheme is that the database cluster analyzes and stores the real-time data in the following processes:
the data acquisition and storage middleware pushes acquired real-time data to a database cluster, and the statistical analysis middleware in the database cluster takes Kafka as a unified data entry and realizes data distribution by Kafka; a stream processing engine Storm is connected behind the Kafka to perform real-time processing on data in the message queue, the stream processing engine Storm reads the data from the Kafka, data cleaning and conversion processing are performed, and redis is used as a global data sharing tool to realize a statistical function;
the streaming processing engine Storm directly acquires data from Kafka by using mapreduce, stores the data into the Hive offline cluster, performs offline analysis on the data in the Hive offline cluster, and then periodically classifies and loads the data into various kinds of databases.
In order to conveniently realize heterogeneous data retrieval, mapreduce is used for taking out data from Kafka, the data is converted into an Hfile (data file format of an HBase bottom layer), HBase bulkload is used for loading the data into HBase, and a real-time query function at a millisecond level is realized by utilizing rowkey.
The further optimization scheme is that the system management software is a C/S and B/S mixed architecture of the SOA, and the system management software comprises: the system comprises a system interface service layer, a core function layer, a data resource layer and a data acquisition layer;
the data acquisition layer acquires the full-scale global data of each system of the wind tunnel site in a mapping, shared data variable or Web API mode;
the system interface service layer acquires basic data, test information and equipment information of system operation and provides data service for other external application systems;
the core function layer is used for completing system management, test data management, data exchange, data integration and standardization, data analysis, safety control, backup and recovery;
and the data resource layer is used for completing data acquisition of the database group and managing each database system.
The data management platform is mainly used for effectively managing measurement data, control data, health management data, test process data and documents, test result data, wind tunnel technical modification data, drawings, video data and various text data;
the collection network health monitoring eliminates or reduces data loss caused by power failure, infrastructure faults and performance problems by monitoring key points in a real-time data transmission process, and realizes the perfect data interaction to other service systems. The acquisition network health monitoring mainly detects the state of acquisition and transmission equipment in the real-time data transmission process through a technical means, displays the state graphically, helps maintenance personnel to find the current and potential problems of the acquisition network, and takes necessary measures in time;
in the data alarming process, alarming is implemented when an event exceeding a normal parameter range is found through customizing an alarming condition by a user;
the historical data retrieval and analysis process is to retrieve data from the historical data according to a mode set by a user, perform statistical analysis and generate an analysis report;
the system management software also carries out data and interface standardization processing, mainly including data label standardization, data architecture standardization, data flow and interface standardization, software standardization and related data service standardization.
The further optimization scheme is that when the database system safety management system carries out database safety access, the IP address verification and the user name password verification are used as authority authentication, the server access is verified by the IP address, and the individual user access is verified in a mode of combining the IP address and the user name password. The database system safety management system also supports functions including database access authority authentication, data security policies, sensitive data security protection and data backup and recovery.
The data security strategy is used for realizing role level authority control based on the security management system of the database system by classifying various data of the security management system of the database system in a view mode, and carrying out encryption processing on sensitive data of the system, such as user data, authority control data, sensitive model information and the like, by adopting a kernel layer encryption method; the security protection of the sensitive data adopts three modes of encryption, fine-grained authority and audit to strengthen management; database backup and recovery mainly adopt database-level recovery, table space and data file recovery; and adding a firewall in the data center for protecting the boundary of the data center containing the equipment database system. The data standardization processing realizes the unified processing of different wind tunnels and different types of data, comprises the reading interfaces compatible with the originally acquired data of the wind tunnels, the unified calculation parameter configuration, the standardized calculation formula, the custom calculation formula, the visual output file format configuration and the like, and meets the data processing of all conventional test types and part special test types.
Compared with the prior art, the invention has the following advantages and beneficial effects:
the invention provides a real-time data centralized management and control system for a wind tunnel site, which carries out data aggregation of multiple dimensions on a control system, a measurement system, a health management system and a wind tunnel auxiliary system through a data acquisition and storage middleware and a database cluster, realizes the data link communication from acquisition, transmission, storage, processing, utilization and backup through the database cluster, system management software and a database system safety management system, and realizes the traceability of full-granularity information and unified management of the system management software; the database cluster is provided with a master database and a slave database (backup database), so that the database cluster has the management functions of the master database and the backup database, and the database cluster is in butt joint with a basic data backup control system (a database system safety management system or system management software), so that all data in the system can be backed up and restored more conveniently; the key points of the real-time data transmission process are monitored by combining the acquisition network health monitoring of system management software, the data loss caused by wind tunnel field power failure, infrastructure faults and performance problems is eliminated or reduced as much as possible, and the data interaction is perfected for other service systems.
Drawings
In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and that for those skilled in the art, other related drawings can be obtained from these drawings without inventive effort.
In the drawings:
FIG. 1 is a structural diagram of a real-time data centralized management and control system for wind tunnel site;
FIG. 2 is a topological architecture diagram of the hardware components of the real-time data centralized management and control system for wind tunnel sites;
FIG. 3 is a schematic diagram of a data collection middleware operating architecture;
FIG. 4 is a schematic diagram illustrating a database cluster analyzing and storing real-time data;
FIG. 5 is a diagram of a system management software architecture;
FIG. 6 is a diagram of a data service system interface.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to examples and accompanying drawings, and the exemplary embodiments and descriptions thereof are only used for explaining the present invention and are not meant to limit the present invention.
The traditional industrial data acquisition system mainly comprises an IOT platform, a registration server and a plurality of network closers, wherein the IOT platform is provided with a task allocation module and a data acquisition module, and the registration server is provided with a plurality of registration centers; node numbering is carried out on data acquisition nodes participating in data receiving through a task allocation module, routing numbering is carried out on a network shutdown machine, the data acquisition nodes and the network shutdown machine corresponding to the data acquisition nodes are bound together, a registration center in a registration server is informed to monitor the data acquisition nodes participating in data receiving, and data management of an IOT platform is achieved; or the test system comprises 5 types of test modules, a master control module, a database module, a server module and a checking module, wherein the master control module receives data collected from the test modules and controls each execution action of the mechanical arm, the database module is mainly used for storing test results and related logs, and the checking module realizes the graph display of the data and the query uploading, downloading and exporting of the data and the logs.
The traditional industrial data acquisition system receives real-time sensor data uploaded by a PLC (programmable logic controller), and then, the analysis query display system built by a relevant analysis platform calls relevant data by utilizing an intranet to access a relational database to display and analyze the data. Due to the fact that the data acquisition frequency is high, the traditional relational database system runs in an overload mode, and the data reading efficiency and speed are directly influenced. Because the real-time data is stored in the relational database, along with the continuous expansion of the scale of the real-time data and the continuous accumulation of the storage time, the problems of the prior database system in the following aspects are that: firstly, a uniform data service interface is not provided, and the data acquisition communication protocols of various field system devices and the like do not support wide compatibility, so that the data management is dispersed, and efficient data aggregation cannot be realized; secondly, the existing data storage mode has no connectivity with an external service system, so that the data utilization rate is not high; thirdly, due to the fact that the design mechanism of the breakpoint resume function of the relational database is not suitable, when the transmission site network and the headquarters network of a large amount of high-frequency real-time data are interrupted, the data are frequently lost, and the breakpoint resume speed is low; fourthly, the real-time data is rapidly increased, and the current system has no effective data security protection mechanism, so that the investment cost of hardware storage is continuously increased. The present invention provides the following embodiments to solve the above technical problems:
example 1
The embodiment provides a real-time data centralized management and control system for wind tunnel site, as shown in fig. 1 and 2, including: the system comprises data acquisition and storage middleware, a database cluster, system management software and a database system security management system;
the data acquisition and storage middleware acquires real-time data from a control system, a measurement system, a health management system and a wind tunnel auxiliary system of a wind tunnel site and pushes the real-time data to a database cluster;
the database cluster comprises a backup database and a plurality of kinds of databases, the database cluster analyzes and stores the real-time data, and the backup database completes the complete backup of the various kinds of databases;
the database system safety management system completes the safety access and control on the data in the database cluster;
the system management software completes data management, collection network health monitoring, data alarming, historical data retrieval and analysis on the basis of a database and data collection and storage middleware.
As shown in FIG. 3, the data acquisition and storage middleware comprises an encapsulated OPCDA/UA server and a Modbus industrial protocol, and supports PC-Base, field configuration software, a TCP/IP protocol and a Socket protocol.
The control system includes: a flexible wall spray pipe control system, a full model car control system and a tunnel body state control system;
the measurement system includes: the system comprises a total pressure measuring system, a total temperature measuring system, a static pressure measuring system, a dew point measuring system, an oxygen content measuring system, a noise measuring system and a turbulence measuring system of a wind tunnel field PXI and pressure scanning valve;
the health management system includes: the device comprises a spray pipe section management system, a test section management system, a two-throat temperature management system, a strain sensor management system and a vibration sensor management system.
The real-time data acquisition process of the control system comprises the following steps: the method comprises the steps that PLC/PC-Base mapping is used for obtaining, field configuration software serves as an OPC UA Server, a data collection and storage middleware serves as an OPC UA Client, and after the data collection and storage middleware is connected to a Server, a value corresponding to a designated node and PLC data is obtained in an active reading or subscribing mode;
the real-time data acquisition process of the measurement system comprises the following steps: the data acquisition and storage middleware defines an NI Labview data interface and acquires real-time data through a TCP/IP protocol or an NI-PSP;
the real-time data acquisition process of the health management system comprises the following steps: and the data acquisition and storage middleware defines a WebAPI interface and performs read-write access on the real-time data through HTTPS to obtain the real-time data.
The species database includes: unstructured databases, video databases, relational databases, and real-time databases;
the unstructured database is used for storing data in wind tunnel test management, equipment management and scientific research management, and the data comprises text data, picture data and drawing data;
the video database is used for storing wind tunnel test section video data and field video data;
the relational database is used for storing wind tunnel test organization, wind tunnel test operation, wind tunnel test results, wind tunnel test result processing data and wind tunnel test comprehensive data;
the real-time database is used for storing real-time data of the control system, the measurement system and the health management system.
The data acquisition middleware acquires data from a control system, a measurement system, a health management system and other related wind tunnel auxiliary systems serving the wind tunnel and applying wind tunnel data of the wind tunnel site, and acquires or receives the data from equipment, configuration software and user data acquisition and processing software; the wind tunnel field data acquisition equipment can be divided into two categories, one category is PLC, the other category is various professional data acquisition equipment, so that the wind tunnel field data acquisition equipment also comprises data acquisition middleware and statistical analysis middleware, and the statistical analysis middleware is divided into a database cluster.
As shown in fig. 4, the database cluster analyzes and stores the real-time data as follows:
the data acquisition and storage middleware pushes acquired real-time data to a database cluster, the database cluster takes Kafka as a unified data entry, and distribution of the data is realized by the Kafka; a stream processing engine Storm is connected behind the Kafka to perform real-time processing on data in the message queue, the stream processing engine Storm reads the data from the Kafka, data cleaning and conversion processing are performed, and redis is used as a global data sharing tool to realize a statistical function;
the streaming processing engine Storm directly acquires data from Kafka by using mapreduce, stores the data into the Hive offline cluster, performs offline analysis on the data in the Hive offline cluster, and then periodically classifies and loads the data into various kinds of databases.
In order to conveniently realize heterogeneous data retrieval, mapreduce is used for taking out data from Kafka, the data is converted into an Hfile (data file format of an HBase bottom layer), HBase bulkload is used for loading the data into HBase, and a real-time query function at a millisecond level is realized by utilizing rowkey.
As shown in fig. 5, the system management software is a C/S, B/S hybrid architecture of SOA, and the system management software includes: the system comprises a system interface service layer, a core function layer, a data resource layer and a data acquisition layer;
the data acquisition layer acquires the full-scale global data of each system of the wind tunnel site in a mapping, shared data variable or Web API mode;
the system interface service layer acquires basic data, test information and equipment information of system operation and provides data service for other application systems;
the core function layer is used for completing system management, test data management, data exchange, data integration and standardization, data analysis, safety control, backup and recovery;
and the data resource layer is used for completing data acquisition of the database group and managing each database system.
When the database system safety management system carries out database safety access, the IP address verification and the user name password verification are used as authority authentication, the server access is verified by the IP address, and the individual user access is verified in a mode of combining the IP address and the user name password; the data security strategy is used for realizing role level authority control based on system setting by classifying various types of data of the system in a view mode, and carrying out encryption processing on sensitive data of the system, such as user data, authority control data, sensitive model information and the like, by adopting a kernel layer encryption method; the security protection of the sensitive data adopts three modes of encryption, fine-grained authority and audit to strengthen management; database backup and recovery mainly adopt database-level recovery, table space and data file recovery; and adding a firewall in the data center for protecting the boundary of the data center containing the equipment database system.
The system also comprises a data service system, wherein the data service system is used for finishing the treatment of original data, statistical data and algorithm data, and the original data, the statistical data and the algorithm data are data of system management software in the data management process.
As shown in fig. 6, the data service system issues real-time data to other downstream service systems in a Web API, MQTT or NI shared variable (PSP) manner, and the data service system supports two forms, namely, overall issuing of a single device signal and independent issuing of a single device signal; the relational data and the real-time data are unified to provide data services by adopting a WebAPI service interface, and are communicated by adopting a standard JSON data format. The service-requiring interface provides equipment information acquisition, driving task list information acquisition and equipment health state acquisition, and signal information of a single piece of equipment is released, signal information of the single piece of equipment is released, and the like to be acquired through the service-requiring interface; the video data provides data service by adopting streaming media service, supports real-time video stream viewing and historical video playback, can inquire and play back videos of specified time, specified place, specified camera and specified test train number, and can simultaneously display multiple paths of videos according to configuration; the unstructured data provides data services by adopting an HTTP service interface, and all resources such as texts, pictures, drawings and the like can be accessed through the HTTP service interface.
The system integrally considers the information requirements of wind tunnel universe data acquisition, storage, processing, management and maintenance, comprises five components of a data acquisition and storage middleware, a database cluster, system management software, a data service system and a database system safety management system, designs a software and hardware topological architecture with distributed acquisition and centralized storage, supports the real-time acquisition/acquisition, processing, storage and management of each system data of the wind tunnel, solidifies and stores the operation flow of the wind tunnel test, supports the wind tunnel fault tracing and analysis data and the like, and meets the requirements of the wind tunnel field on the data management of the heterogeneous data acquisition and storage of various system devices with high expansibility, high reliability, sustainable operation and safety.
The system has a high-expansibility, high-reliability, sustainable operation and safe infrastructure, and realizes the integrated management of data acquisition, transmission, storage, processing and application and the communication of an integrated maintenance full data link.
The system further meets the requirement of wind tunnel universe full-scale heterogeneous data management through a designed middleware, a data interface and the like on a software/hardware architecture, has an expansion condition meeting the existing service access, and realizes cross-equipment, cross-application and cross-means data sharing.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. The utility model provides a centralized management and control system of real-time data for wind tunnel scene which characterized in that includes: the system comprises data acquisition and storage middleware, a database cluster, system management software and a database system security management system;
the data acquisition and storage middleware acquires real-time data from a control system, a measurement system, a health management system and a wind tunnel auxiliary system of a wind tunnel site and pushes the real-time data to a database cluster;
the database cluster comprises a backup database and a plurality of kinds of databases, the database cluster analyzes and stores the real-time data, and the backup database completes the complete backup of the various kinds of databases;
the database system safety management system completes the safety access and control on the data in the database cluster;
the system management software completes data management, collected network health monitoring, data alarming and historical data retrieval and analysis on the basis of the database and the data collection and storage middleware.
2. The real-time data centralized management and control system for the wind tunnel site according to claim 1, further comprising a data service system, wherein the data service system completes the management of original data, statistical data and algorithm data, and the original data, the statistical data and the algorithm data are data of system management software in a data management process.
3. The real-time data centralized management and control system for the wind tunnel site according to claim 2, wherein the data service system issues real-time data to the downstream service system in a variable sharing manner of Web API, MQTT or NI, and the data service system supports two forms of overall issuing of a single device signal and independent issuing of a single device signal.
4. The real-time data centralized management and control system for wind tunnel sites of claim 1, wherein the data acquisition and storage middleware comprises an encapsulated OPCDA/UA server and a Modbus industrial protocol, and supports PC-Base, site configuration software, TCP/IP protocol and Socket protocol.
5. The real-time data centralized management and control system for wind tunnel scene as claimed in claim 4, wherein,
the control system includes: a flexible wall spray pipe control system, a full model car control system and a tunnel body state control system;
the measurement system includes: the system comprises a total pressure measuring system, a total temperature measuring system, a static pressure measuring system, a dew point measuring system, an oxygen content measuring system, a noise measuring system and a turbulence measuring system of a wind tunnel field PXI and pressure scanning valve;
the health management system includes: the device comprises a spray pipe section management system, a test section management system, a two-throat temperature management system, a strain sensor management system and a vibration sensor management system.
6. The real-time data concentration management and control system for wind tunnel field according to claim 5,
the real-time data acquisition process of the control system comprises the following steps: the method comprises the steps that PLC/PC-Base mapping is used for obtaining, field configuration software serves as an OPC UA Server, a data collection and storage middleware serves as an OPC UA Client, and after the data collection and storage middleware is connected to a Server, a value corresponding to a designated node and PLC data is obtained in an active reading or subscribing mode;
the real-time data acquisition process of the measurement system comprises the following steps: the data acquisition and storage middleware defines an NI Labview data interface and acquires real-time data through a TCP/IP protocol or an NI-PSP;
the real-time data acquisition process of the health management system comprises the following steps: and the data acquisition and storage middleware defines a WebAPI interface and performs read-write access on the real-time data through HTTPS to obtain the real-time data.
7. The system according to claim 1, wherein the category database comprises: unstructured databases, video databases, relational databases, and real-time databases;
the unstructured database is used for storing data in wind tunnel test management, equipment management and scientific research management, and the data comprises text data, picture data and drawing data;
the video database is used for storing wind tunnel test section video data and field video data;
the relational database is used for storing wind tunnel test organization, wind tunnel test operation, wind tunnel test results, wind tunnel test result processing data and wind tunnel test comprehensive data;
the real-time database is used for storing real-time data of the control system, the measurement system and the health management system.
8. The real-time data centralized management and control system for the wind tunnel field according to claim 1, wherein the database cluster analyzes and stores the real-time data in the process of:
the data acquisition and storage middleware pushes real-time data to a database cluster, the database cluster takes Kafka as a unified data entry, and distribution of the data is realized by the Kafka; a stream processing engine Storm is connected behind the Kafka to perform real-time processing on data in the message queue, the stream processing engine Storm reads the data from the Kafka and performs data cleaning and conversion, and redis is used as a global data sharing tool to realize a statistical function;
the streaming processing engine Storm directly acquires data from Kafka by using mapreduce, stores the data into the Hive offline cluster, performs offline analysis on the data in the Hive offline cluster, and then periodically classifies and loads the data into various kinds of databases for storage.
9. The real-time data centralized management and control system for wind tunnel sites according to claim 1, wherein the system management software is a C/S, B/S hybrid architecture of SOA, and the system management software comprises: the system comprises a system interface service layer, a core function layer, a data resource layer and a data acquisition layer;
the data acquisition layer acquires the full-scale global data of each system of the wind tunnel site in a mapping, shared data variable or Web API mode;
the system interface service layer acquires basic data, test information and equipment information of system operation and provides data service for an external application system;
the core function layer is used for completing system management, test data management, data exchange, data integration and standardization, data analysis, safety control and backup and recovery;
and the data resource layer is used for completing data acquisition of the database group and managing each database system.
10. The real-time data centralized management and control system for the wind tunnel site according to claim 1, wherein when the database system security management system performs database security access, the authentication of the IP address and the authentication of the user name and the password are taken as authority authentication, the authentication of the server is taken as the authentication of the IP address, and the authentication of the individual user is taken as the authentication of the combination of the IP address and the user name and the password.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210355416.XA CN114827140A (en) | 2022-04-02 | 2022-04-02 | Real-time data centralized management and control system for wind tunnel site |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210355416.XA CN114827140A (en) | 2022-04-02 | 2022-04-02 | Real-time data centralized management and control system for wind tunnel site |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114827140A true CN114827140A (en) | 2022-07-29 |
Family
ID=82531808
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210355416.XA Withdrawn CN114827140A (en) | 2022-04-02 | 2022-04-02 | Real-time data centralized management and control system for wind tunnel site |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114827140A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115203213A (en) * | 2022-09-15 | 2022-10-18 | 中国空气动力研究与发展中心高速空气动力研究所 | Wind tunnel real-time data efficient acquisition and storage system |
| CN115290286A (en) * | 2022-10-10 | 2022-11-04 | 中国空气动力研究与发展中心高速空气动力研究所 | Integrated learning evaluation system for flow field stability of sub-span supersonic wind tunnel |
| CN115348487A (en) * | 2022-08-10 | 2022-11-15 | 中国兵器装备集团自动化研究所有限公司 | Real-time database system |
| CN116743860A (en) * | 2023-08-08 | 2023-09-12 | 中国空气动力研究与发展中心高速空气动力研究所 | Wind tunnel field real-time data distributed multi-line Cheng Caiji architecture |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108763234A (en) * | 2018-02-01 | 2018-11-06 | 宝付网络科技（上海）有限公司 | A kind of real time data synchronization method and system |
| CN109977158A (en) * | 2019-02-28 | 2019-07-05 | 武汉烽火众智智慧之星科技有限公司 | Public security big data analysis processing system and method |
| CN111639114A (en) * | 2020-04-07 | 2020-09-08 | 北京邮电大学 | Distributed data fusion management system based on Internet of things platform |
| CN111915135A (en) * | 2020-07-01 | 2020-11-10 | 河北建投能源投资股份有限公司 | Production operation supervisory systems |
| CN112099948A (en) * | 2020-09-10 | 2020-12-18 | 西安交通大学 | Method for standardizing digital twin manufacturing unit protocol and integrating industrial big data in real time |
| US20210216411A1 (en) * | 2020-01-09 | 2021-07-15 | Salesforce.Com, Inc. | Cluster backup management |
| CN113849483A (en) * | 2021-09-29 | 2021-12-28 | 中国兵器装备集团自动化研究所有限公司 | Real-time database system architecture for intelligent factory |
-
2022
- 2022-04-02 CN CN202210355416.XA patent/CN114827140A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108763234A (en) * | 2018-02-01 | 2018-11-06 | 宝付网络科技（上海）有限公司 | A kind of real time data synchronization method and system |
| CN109977158A (en) * | 2019-02-28 | 2019-07-05 | 武汉烽火众智智慧之星科技有限公司 | Public security big data analysis processing system and method |
| US20210216411A1 (en) * | 2020-01-09 | 2021-07-15 | Salesforce.Com, Inc. | Cluster backup management |
| CN111639114A (en) * | 2020-04-07 | 2020-09-08 | 北京邮电大学 | Distributed data fusion management system based on Internet of things platform |
| CN111915135A (en) * | 2020-07-01 | 2020-11-10 | 河北建投能源投资股份有限公司 | Production operation supervisory systems |
| CN112099948A (en) * | 2020-09-10 | 2020-12-18 | 西安交通大学 | Method for standardizing digital twin manufacturing unit protocol and integrating industrial big data in real time |
| CN113849483A (en) * | 2021-09-29 | 2021-12-28 | 中国兵器装备集团自动化研究所有限公司 | Real-time database system architecture for intelligent factory |
Non-Patent Citations (1)
| Title |
|---|
| 邓章林等: "基于ＥｔｈｅｒＣＡＴ和ＬａｂＶＩＥＷ的风洞安全联锁及状态监测系统设计", 《计算机测量与控制》, no. 02, 25 February 2020 (2020-02-25), pages 14 - 27 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115348487A (en) * | 2022-08-10 | 2022-11-15 | 中国兵器装备集团自动化研究所有限公司 | Real-time database system |
| CN115203213A (en) * | 2022-09-15 | 2022-10-18 | 中国空气动力研究与发展中心高速空气动力研究所 | Wind tunnel real-time data efficient acquisition and storage system |
| CN115290286A (en) * | 2022-10-10 | 2022-11-04 | 中国空气动力研究与发展中心高速空气动力研究所 | Integrated learning evaluation system for flow field stability of sub-span supersonic wind tunnel |
| CN116743860A (en) * | 2023-08-08 | 2023-09-12 | 中国空气动力研究与发展中心高速空气动力研究所 | Wind tunnel field real-time data distributed multi-line Cheng Caiji architecture |
| CN116743860B (en) * | 2023-08-08 | 2023-10-27 | 中国空气动力研究与发展中心高速空气动力研究所 | Wind tunnel field real-time data distributed multi-line Cheng Caiji architecture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114827140A (en) | Real-time data centralized management and control system for wind tunnel site | |
| CN109144014B (en) | System and method for detecting operation condition of industrial equipment | |
| CN113112086B (en) | Intelligent production system based on edge calculation and identification analysis | |
| CN106815115A (en) | A kind of operation condition of server monitoring system | |
| CN208754331U (en) | A kind of textile machine novel maintenance system based on Internet of Things and industrial cloud | |
| CN111591778A (en) | Remote monitoring management system and method for stacker-reclaimer based on Internet technology | |
| CN110764834B (en) | Automatic safety monitoring platform, management method and storage medium | |
| CN108871434A (en) | A kind of on-line monitoring system and method for slewing | |
| CN106774220A (en) | A kind of thermal power plant's dcs on-line operation status monitoring platform | |
| CN103973815A (en) | Method for unified monitoring of storage environment across data centers | |
| CN113849553A (en) | Substation data acquisition and processing method and system based on Internet of things equipment data acquisition | |
| CN110995859A (en) | Intelligent transformer substation supporting platform system based on ubiquitous Internet of things | |
| CN101893510A (en) | Device-based one-machine-one-file on-line monitoring and fault diagnosis system | |
| CN112132538A (en) | Photovoltaic power generation management system based on NB-IoT | |
| CN107910956A (en) | A kind of integrated power network schedule automation operation comprehensive supervision method of main plant stand | |
| CN109309733A (en) | A kind of Internet of Things energy monitoring system | |
| CN112506097A (en) | Jig frame remote monitoring system and method based on industrial internet | |
| CN115480542A (en) | Production line running state and related process data acquisition system | |
| CN111083047B (en) | Gateway based on internet of things multi-protocol communication | |
| CN209400916U (en) | A kind of job Shop Management System based on Ethernet | |
| CN115865889A (en) | Thermal power plant fuel area inspection method and system | |
| CN114727166A (en) | Remote online metering instrument state monitoring method and system based on Internet of things | |
| CN205647545U (en) | Intelligent network operation and maintenance management system | |
| CN108892038A (en) | A kind of hoisting machinery long distance wireless security monitoring management system | |
| CN115604013B (en) | Industrial data interaction platform and interaction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220729 |