CN106373356A - Big data technology-based sewage pipe network monitoring system - Google Patents

Abstract

The invention provides a big data technology-based sewage pipe network monitoring system which comprises a big data processor, a wireless network processing module and a monitoring point acquiring module, wherein the wireless network processing module is distributed according to a sewage pipe network area; the monitoring point acquiring module is arranged in a sewage pipeline; the big data processor is connected with the monitoring point acquiring module through the wireless network processing module; the big data processor comprises a big data processing unit, as well as a big data receiving unit, a big data storage unit and a graph data displaying unit which are connected with the big data processing unit respectively; the big data receiving unit is in wireless connection with the wireless network processing module. The big data technology-based sewage pipe network monitoring system has the beneficial effects that based on a big data processing technology, data acquired by many sewage pipe network monitoring points are gathered and are subjected to uniform analysis processing, so that macroscopic and microcosmic monitoring can be realized and the monitoring ability on the sewage pipe network is improved; data transmission is conducted by the wireless network processing module, so that high data acquisition and feedback timeliness is realized.

Description

A kind of sewage network monitoring system based on big data technology

Technical field

The present invention relates to sewage network monitors field and in particular to a kind of sewage network monitoring based on big data technology is System.

Background technology

Waste pipe network system is urban construction, environmental conservation, the fundamental equipments in the municipal project such as control flood and drain flooded fields, and builds The monitoring system of vertical municipal sewage pipe network, provides environmental information, the analysis of Real Time Observation sewage network for municipal drainage manager The monitoring management function of sewage network dynamic operation situation, has had become as the urgent needss of modern city drainage management.Another Aspect, by the way of setting monitoring point is monitored, because underground sewage pipe network monitoring point is numerous and distributed pole wide, the number of collection Big, difficult according to measuring, monitoring effect is poor.

Content of the invention

For solving the above problems, the present invention is intended to provide a kind of sewage network monitoring system based on big data technology.

The purpose of the present invention employs the following technical solutions to realize:

A kind of sewage network monitoring system based on big data technology, including big data processor, presses sewage network region The wireless network processing module of distribution and the monitoring point acquisition module being arranged in sewage conduct, big data processor passes through wireless Network process module connects monitoring point acquisition module；Described big data processor include big data processing unit and respectively with several greatly According to the big data receiving unit of processing unit connection, big data memory element, chart data display unit, big data receiving unit It is connected with wireless network processing module long distance wireless.

The invention has the benefit that being based on big data treatment technology, by the data of numerous sewage network monitoring points collection Carry out collecting and unified Analysis are processed, can achieve macroscopic view, the multiple monitoring of microcosmic, improve the monitoring capability to sewage network；Using Wireless network processing module carries out data transmission, data acquisition, feedback ageing good, thus solve above-mentioned technology asking Topic.

Brief description

Using accompanying drawing, the invention will be further described, but the embodiment in accompanying drawing does not constitute any limit to the present invention System, for those of ordinary skill in the art, on the premise of not paying creative work, can also obtain according to the following drawings Other accompanying drawings.

Fig. 1 is present configuration connection diagram；

Fig. 2 is the structural representation of wireless network processing module of the present invention.

Reference:

Big data processor 1, monitoring point acquisition module 2, alarm module 3, wireless network processing module 4, big data are processed Unit 11, big data receiving unit 12, big data memory element 13, chart data display unit 14, main control unit 21, power supply list Unit 22, sensor cluster 23, transducer position unit 41, sensor network optimize unit 42, data monitoring unit 43, at data Reason unit 44, data receipt unit 45, data transfer unit 46.

Specific embodiment

The invention will be further described with the following Examples.

Application scenarios 1

Referring to Fig. 1, Fig. 2, the sewage network monitoring system based on big data technology of an embodiment of this application scene, Including big data processor 1, the wireless network processing module 4 by sewage network area distribution be arranged on the prison in sewage conduct Measuring point acquisition module 2, big data processor 1 connects monitoring point acquisition module 2 by wireless network processing module 4；Described big number According to processor 1 include big data processing unit 11 and the big data receiving unit 12 being connected with big data processing unit 11 respectively, Big data memory element 13, chart data display unit 14, big data receiving unit 12 and the long-range nothing of wireless network processing module 4 Line connects.

Preferably, described monitoring point acquisition module 2 includes main control unit 21 and the power supply being connected respectively with main control unit 21 Unit 22, sensor cluster 23；Described main control unit 21 is connected with described wireless network processing module 4；Described power subsystem 22 Powered for sensor cluster 23 by main control unit 21.

The above embodiment of the present invention is based on big data treatment technology, and the data of numerous sewage network monitoring points collection is carried out Collect and unified Analysis are processed, can achieve macroscopic view, the multiple monitoring of microcosmic, improve the monitoring capability to sewage network；Using wireless Network process module carries out data transmission, data acquisition, feedback ageing good, thus solving above-mentioned technical problem.

Preferably, described sensor cluster 23 includes temperature sensor, humidity sensor, level sensor, flow sensing Device, carbon monoxide transducer, transversal switch sensor.

The sensor cluster 23 of this preferred embodiment setting is it is achieved that the collection of relevant information, intelligent convenient.

Preferably, described sewage network monitoring system also includes alarm module 3, and described alarm module 3 and big data are processed Device 1 connects, and implements when Monitoring Data is abnormal to report to the police.

Preferably, described wireless network processing module 4 includes transducer position unit 41, sensor network optimizes unit 42nd, data monitoring unit 43, data processing unit 44, data receipt unit 45 data delivery unit 46.

This preferred embodiment constructs the framework of wireless network processing module 4.

Preferably, described transducer position unit 41 is used for unknown sensor network nodes are positioned, positioning side Method is as follows:

(1) integrated gps positioning chip on minority sensor node, these sensor nodes are obtained by receiving gps signal Self-position is taken to become known location node, as the location base of other unknown position nodes；

(2) ask for four mutual distances of known location node and jumping figure, calculate the distance averagely often jumped；

(3) for unknown position node x, averagely often jumped in the jumping figure of four known location nodes and (2) using it Distance is multiplied and obtains unknown position node to the distance of four known location nodes；

(4) choose wherein three known location nodes by way of combination in any, for each combination, surveyed according to three sides Mensuration its position of acquisition, then produce four result of calculations, ask for mean place as unknown position node final position.

This preferred embodiment arranges transducer position unit 41, is easy to obtain the position source of Monitoring Data, fixed using gps Position chip and the method for three side positioning combination, had both saved cost, and can obtain good locating effect.

Preferably, described sensor network is optimized unit 42 and using heredity-ant colony optimization algorithm, sensor network is route Algorithm is optimized, and concrete grammar is as follows:

(1) generate network topology structure of wireless sensor at random；

(2) set the parameter of genetic algorithm, sensor network is simplified using genetic algorithm, form new network topology knot Structure；

(3) ant group algorithm pheromone is initialized according to genetic algorithm result；

(4) set ant group algorithm parameter, using ant group algorithm, optimal path is scanned for and update.

This preferred embodiment is optimized to sensor network, limited ensureing that whole wireless sensor network performance declines In the case of, improve network energy-saving effect, extend the life-span of network.

Preferably, described data monitoring unit 43 be used for by by the sensor node that each sensor builds cooperate into The monitoring in certain region of row, and export the perception data of each sensor node monitoring；

Described data processing unit 44 is used for the perception data of each sensor node monitoring being compressed process, comprising:

If the data sequence of described perception data unit interval is x={ x (t₁),x(t₂),…,x(t_n), its Middle t_i(1≤i≤n) express time stabs, x (t_i) represent in t_iThe monitor value that (1≤i≤n) certain node of moment produces, sets by mistake Difference boundary is ε, and limit of error is the span of ε is [0.4,0.8], from first data point [t₁, x (t₁)] start, to data Sequence x={ x (t₁),x(t₂),…,x(t_n) in data point sequentially carry out scanning for the first time, when the scanning reaching setting stops During condition, stop primary scanning, the data subsequence of first time scanning approximately, is scanned from first time with a line segment Data subsequence after first data point proceed by similar secondary scanning, until scan through the whole unit interval The data sequence of section；By the initial time of first line segment, afterwards the slope of the end time of every line segment and every line segment with Intercept as the corresponding compressed data of data sequence of unit interval and exports；

Wherein, the described scanning stop condition setting as: when scanning a data point [t_k, x (t_k)], in this data Point [t_k, x (t_k)] before all data points approximate description can be come by a line segment, and meet error precision requirement, and add number Strong point [t_k, x (t_k)] after, do not exist a line segment energy approximate description currently all not by approximate description data point when, stop Scanning；

Described error precision requires:

$|x\left(t_j\right)-\[x\left(t_{\mathrm{\α}}\right)+\frac{x\left(t_{k-1}\right)-x\left(t_{\mathrm{\α}}\right)}{t_{k-1}-t_{\mathrm{\α}}}(t_j-t_{\mathrm{\α}})\]|\≤\mathrm{\ϵ}$

Wherein, if described data point [t_k, x (t_k)] before subsequence be x={ x (t_α),x(t_α+1),…,x(t_k-1), X (t in formula_j) it is in t_jThe actual value in (α≤j≤k-1) moment.

This preferred embodiment arranges data processing unit 44, carries out data scanning, energy by the scanning stop condition setting Enough in linear session, carry out the data sequence of a unit interval of approximate description perception data using the line segment number of minimal number Row and ensure that error precision requires, then by the initial time of first line segment, the afterwards end time of every line segment and every The slope of line segment and is exported as the corresponding compressed data of data sequence of unit interval with intercept, thus decrease to need to pass The data volume sent, reduces the energy expenditure of data transmission, thus the communication relatively reducing wireless sensor network node is opened Pin；Propose formula that error precision requires it is ensured that the precision of data compression, and improve the speed of data scanning.

Preferably, described data receipt unit 45 is built by wireless sensor network sink node, described wireless biography Sensor network aggregation node is received after the corresponding compression of each sensor node based on the Data Transport Protocol ensureing weighted-fair Perception data, and by corresponding for the sensor node of reception compression after perception data be sent at high-performance computer Reason and analysis, realize the collection of wireless data；

Wherein, the Data Transport Protocol of described guarantee weighted-fair is:

It is right from sensor node i that described wireless sensor network sink node receives in certain unit interval [0, t] Quantity s of the perception data after the compression answered_i,tNeed to meet following fairness metric condition:

$\frac{{({\σ}_{i=1}^n{s}_{i,t}/w_i)}^2}{n{\σ}_{i=1}^n{(s_{i,t}/w_i)}^2}\&greaterequal;1-{(10\mathrm{\γ}/9)}^2$

In formula, w_iThe weights characterizing its data significance level of the sensor node i for setting, n is sensor node Sum, γ is constant, and its span is (0,0.2).

This preferred embodiment wireless sensor network sink node is connect based on the Data Transport Protocol ensureing weighted-fair Receive the perception data after the corresponding compression of each sensor node, enable wireless sensor network sink node from important sensing Device node receives more perception data it is ensured that while the efficiency of data transfer, improve the fairness of data transfer.

Preferably, described data transfer unit 46 transfers data to user by network, single including closely transmitting son Unit, telecommunication subelement and switching subelement, described short-range communication subelement adopts zigbee agreement to communicate, described remote Distance communication subelement adopts wireless communication, and under normal circumstances, user passes through short-range communication submodule from computer control End processed obtains monitoring information, and when user goes out, switching subelement starts telecommunication subelement, to user mobile phone control end Long Distant Transmit monitoring information.

This preferred embodiment arranges data transfer unit 46, can select communication mode it is achieved that reality according to user distance When monitoring.

In this application scenarios, limit of error takes 0.4 for ε, and monitoring velocity improves 10% relatively, and monitoring accuracy carries relatively High by 12%.

Application scenarios 2

Referring to Fig. 1, Fig. 2, the sewage network monitoring system based on big data technology of an embodiment of this application scene, Including big data processor 1, the wireless network processing module 4 by sewage network area distribution be arranged on the prison in sewage conduct Measuring point acquisition module 2, big data processor 1 connects monitoring point acquisition module 2 by wireless network processing module 4；Described big number According to processor 1 include big data processing unit 11 and the big data receiving unit 12 being connected with big data processing unit 11 respectively, Big data memory element 13, chart data display unit 14, big data receiving unit 12 and the long-range nothing of wireless network processing module 4 Line connects.

Preferably, described monitoring point acquisition module 2 includes main control unit 21 and the power supply being connected respectively with main control unit 21 Unit 22, sensor cluster 23；Described main control unit 21 is connected with described wireless network processing module 4；Described power subsystem 22 Powered for sensor cluster 23 by main control unit 21.

The above embodiment of the present invention is based on big data treatment technology, and the data of numerous sewage network monitoring points collection is carried out Collect and unified Analysis are processed, can achieve macroscopic view, the multiple monitoring of microcosmic, improve the monitoring capability to sewage network；Using wireless Network process module carries out data transmission, data acquisition, feedback ageing good, thus solving above-mentioned technical problem.

Preferably, described sensor cluster 23 includes temperature sensor, humidity sensor, level sensor, flow sensing Device, carbon monoxide transducer, transversal switch sensor.

The sensor cluster 23 of this preferred embodiment setting is it is achieved that the collection of relevant information, intelligent convenient.

Preferably, described sewage network monitoring system also includes alarm module 3, and described alarm module 3 and big data are processed Device 1 connects, and implements when Monitoring Data is abnormal to report to the police.

Preferably, described wireless network processing module 4 includes transducer position unit 41, sensor network optimizes unit 42nd, data monitoring unit 43, data processing unit 44, data receipt unit 45 data delivery unit 46.

This preferred embodiment constructs the framework of wireless network processing module 4.

Preferably, described transducer position unit 41 is used for unknown sensor network nodes are positioned, positioning side Method is as follows:

(1) integrated gps positioning chip on minority sensor node, these sensor nodes are obtained by receiving gps signal Self-position is taken to become known location node, as the location base of other unknown position nodes；

(2) ask for four mutual distances of known location node and jumping figure, calculate the distance averagely often jumped；

(3) for unknown position node x, averagely often jumped in the jumping figure of four known location nodes and (2) using it Distance is multiplied and obtains unknown position node to the distance of four known location nodes；

(4) choose wherein three known location nodes by way of combination in any, for each combination, surveyed according to three sides Mensuration its position of acquisition, then produce four result of calculations, ask for mean place as unknown position node final position.

This preferred embodiment arranges transducer position unit 41, is easy to obtain the position source of Monitoring Data, fixed using gps Position chip and the method for three side positioning combination, had both saved cost, and can obtain good locating effect.

Preferably, described sensor network is optimized unit 42 and using heredity-ant colony optimization algorithm, sensor network is route Algorithm is optimized, and concrete grammar is as follows:

(1) generate network topology structure of wireless sensor at random；

(2) set the parameter of genetic algorithm, sensor network is simplified using genetic algorithm, form new network topology knot Structure；

(3) ant group algorithm pheromone is initialized according to genetic algorithm result；

(4) set ant group algorithm parameter, using ant group algorithm, optimal path is scanned for and update.

This preferred embodiment is optimized to sensor network, limited ensureing that whole wireless sensor network performance declines In the case of, improve network energy-saving effect, extend the life-span of network.

Preferably, described data monitoring unit 43 be used for by by the sensor node that each sensor builds cooperate into The monitoring in certain region of row, and export the perception data of each sensor node monitoring；

Described data processing unit 44 is used for the perception data of each sensor node monitoring being compressed process, comprising:

If the data sequence of described perception data unit interval is x={ x (t₁),x(t₂),…,x(t_n), its Middle t_i(1≤i≤n) express time stabs, x (t_i) represent in t_iThe monitor value that (1≤i≤n) certain node of moment produces, sets by mistake Difference boundary is ε, and limit of error is the span of ε is [0.4,0.8], from first data point [t₁, x (t₁)] start, to data Sequence x={ x (t₁),x(t₂),…,x(t_n) in data point sequentially carry out scanning for the first time, when the scanning reaching setting stops During condition, stop primary scanning, the data subsequence of first time scanning approximately, is scanned from first time with a line segment Data subsequence after first data point proceed by similar secondary scanning, until scan through the whole unit interval The data sequence of section；By the initial time of first line segment, afterwards the slope of the end time of every line segment and every line segment with Intercept as the corresponding compressed data of data sequence of unit interval and exports；

Wherein, the described scanning stop condition setting as: when scanning a data point [t_k, x (t_k)], in this data Point [t_k, x (t_k)] before all data points approximate description can be come by a line segment, and meet error precision requirement, and add number Strong point [t_k, x (t_k)] after, do not exist a line segment energy approximate description currently all not by approximate description data point when, stop Scanning；

Described error precision requires:

$|x\left(t_j\right)-\[x\left(t_{\mathrm{\α}}\right)+\frac{x\left(t_{k-1}\right)-x\left(t_{\mathrm{\α}}\right)}{t_{k-1}-t_{\mathrm{\α}}}(t_j-t_{\mathrm{\α}})\]|\≤\mathrm{\ϵ}$

Wherein, if described data point [t_k, x (t_k)] before subsequence be x={ x (t_α),x(t_α+1),…,x(t_k-1), X (t in formula_j) it is in t_jThe actual value in (α≤j≤k-1) moment.

This preferred embodiment arranges data processing unit 44, carries out data scanning, energy by the scanning stop condition setting Enough in linear session, carry out the data sequence of a unit interval of approximate description perception data using the line segment number of minimal number Row and ensure that error precision requires, then by the initial time of first line segment, the afterwards end time of every line segment and every The slope of line segment and is exported as the corresponding compressed data of data sequence of unit interval with intercept, thus decrease to need to pass The data volume sent, reduces the energy expenditure of data transmission, thus the communication relatively reducing wireless sensor network node is opened Pin；Propose formula that error precision requires it is ensured that the precision of data compression, and improve the speed of data scanning.

Preferably, described data receipt unit 45 is built by wireless sensor network sink node, described wireless biography Sensor network aggregation node is received after the corresponding compression of each sensor node based on the Data Transport Protocol ensureing weighted-fair Perception data, and by corresponding for the sensor node of reception compression after perception data be sent at high-performance computer Reason and analysis, realize the collection of wireless data；

Wherein, the Data Transport Protocol of described guarantee weighted-fair is:

It is right from sensor node i that described wireless sensor network sink node receives in certain unit interval [0, t] Quantity s of the perception data after the compression answered_i,tNeed to meet following fairness metric condition:

$\frac{{({\σ}_{i=1}^n{s}_{i,t}/w_i)}^2}{n{\σ}_{i=1}^n{(s_{i,t}/w_i)}^2}\&greaterequal;1-{(10\mathrm{\γ}/9)}^2$

In formula, w_iThe weights characterizing its data significance level of the sensor node i for setting, n is sensor node Sum, γ is constant, and its span is (0,0.2).

This preferred embodiment wireless sensor network sink node is connect based on the Data Transport Protocol ensureing weighted-fair Receive the perception data after the corresponding compression of each sensor node, enable wireless sensor network sink node from important sensing Device node receives more perception data it is ensured that while the efficiency of data transfer, improve the fairness of data transfer.

Preferably, described data transfer unit 46 transfers data to user by network, single including closely transmitting son Unit, telecommunication subelement and switching subelement, described short-range communication subelement adopts zigbee agreement to communicate, described remote Distance communication subelement adopts wireless communication, and under normal circumstances, user passes through short-range communication submodule from computer control End processed obtains monitoring information, and when user goes out, switching subelement starts telecommunication subelement, to user mobile phone control end Long Distant Transmit monitoring information.

This preferred embodiment arranges data transfer unit 46, can select communication mode it is achieved that reality according to user distance When monitoring.

In this application scenarios, limit of error takes 0.5 for ε, and monitoring velocity improves 11% relatively, and monitoring accuracy carries relatively High by 11%.

Application scenarios 3

Referring to Fig. 1, Fig. 2, the sewage network monitoring system based on big data technology of an embodiment of this application scene, Including big data processor 1, the wireless network processing module 4 by sewage network area distribution be arranged on the prison in sewage conduct Measuring point acquisition module 2, big data processor 1 connects monitoring point acquisition module 2 by wireless network processing module 4；Described big number According to processor 1 include big data processing unit 11 and the big data receiving unit 12 being connected with big data processing unit 11 respectively, Big data memory element 13, chart data display unit 14, big data receiving unit 12 and the long-range nothing of wireless network processing module 4 Line connects.

Preferably, described monitoring point acquisition module 2 includes main control unit 21 and the power supply being connected respectively with main control unit 21 Unit 22, sensor cluster 23；Described main control unit 21 is connected with described wireless network processing module 4；Described power subsystem 22 Powered for sensor cluster 23 by main control unit 21.

The above embodiment of the present invention is based on big data treatment technology, and the data of numerous sewage network monitoring points collection is carried out Collect and unified Analysis are processed, can achieve macroscopic view, the multiple monitoring of microcosmic, improve the monitoring capability to sewage network；Using wireless Network process module carries out data transmission, data acquisition, feedback ageing good, thus solving above-mentioned technical problem.

Preferably, described sensor cluster 23 includes temperature sensor, humidity sensor, level sensor, flow sensing Device, carbon monoxide transducer, transversal switch sensor.

The sensor cluster 23 of this preferred embodiment setting is it is achieved that the collection of relevant information, intelligent convenient.

Preferably, described sewage network monitoring system also includes alarm module 3, and described alarm module 3 and big data are processed Device 1 connects, and implements when Monitoring Data is abnormal to report to the police.

Preferably, described wireless network processing module 4 includes transducer position unit 41, sensor network optimizes unit 42nd, data monitoring unit 43, data processing unit 44, data receipt unit 45 data delivery unit 46.

This preferred embodiment constructs the framework of wireless network processing module 4.

Preferably, described transducer position unit 41 is used for unknown sensor network nodes are positioned, positioning side Method is as follows:

(1) integrated gps positioning chip on minority sensor node, these sensor nodes are obtained by receiving gps signal Self-position is taken to become known location node, as the location base of other unknown position nodes；

(2) ask for four mutual distances of known location node and jumping figure, calculate the distance averagely often jumped；

(3) for unknown position node x, averagely often jumped in the jumping figure of four known location nodes and (2) using it Distance is multiplied and obtains unknown position node to the distance of four known location nodes；

(4) choose wherein three known location nodes by way of combination in any, for each combination, surveyed according to three sides Mensuration its position of acquisition, then produce four result of calculations, ask for mean place as unknown position node final position.

This preferred embodiment arranges transducer position unit 41, is easy to obtain the position source of Monitoring Data, fixed using gps Position chip and the method for three side positioning combination, had both saved cost, and can obtain good locating effect.

Preferably, described sensor network is optimized unit 42 and using heredity-ant colony optimization algorithm, sensor network is route Algorithm is optimized, and concrete grammar is as follows:

(1) generate network topology structure of wireless sensor at random；

(2) set the parameter of genetic algorithm, sensor network is simplified using genetic algorithm, form new network topology knot Structure；

(3) ant group algorithm pheromone is initialized according to genetic algorithm result；

(4) set ant group algorithm parameter, using ant group algorithm, optimal path is scanned for and update.

This preferred embodiment is optimized to sensor network, limited ensureing that whole wireless sensor network performance declines In the case of, improve network energy-saving effect, extend the life-span of network.

Preferably, described data monitoring unit 43 be used for by by the sensor node that each sensor builds cooperate into The monitoring in certain region of row, and export the perception data of each sensor node monitoring；

Described data processing unit 44 is used for the perception data of each sensor node monitoring being compressed process, comprising:

If the data sequence of described perception data unit interval is x={ x (t₁),x(t₂),…,x(t_n), its Middle t_i(1≤i≤n) express time stabs, x (t_i) represent in t_iThe monitor value that (1≤i≤n) certain node of moment produces, sets by mistake Difference boundary is ε, and limit of error is the span of ε is [0.4,0.8], from first data point [t₁, x (t₁)] start, to data Sequence x={ x (t₁),x(t₂),…,x(t_n) in data point sequentially carry out scanning for the first time, when the scanning reaching setting stops During condition, stop primary scanning, the data subsequence of first time scanning approximately, is scanned from first time with a line segment Data subsequence after first data point proceed by similar secondary scanning, until scan through the whole unit interval The data sequence of section；By the initial time of first line segment, afterwards the slope of the end time of every line segment and every line segment with Intercept as the corresponding compressed data of data sequence of unit interval and exports；

Wherein, the described scanning stop condition setting as: when scanning a data point [t_k, x (t_k)], in this data Point [t_k, x (t_k)] before all data points approximate description can be come by a line segment, and meet error precision requirement, and add number Strong point [t_k, x (t_k)] after, do not exist a line segment energy approximate description currently all not by approximate description data point when, stop Scanning；

Described error precision requires:

$|x\left(t_j\right)-\[x\left(t_{\mathrm{\α}}\right)+\frac{x\left(t_{k-1}\right)-x\left(t_{\mathrm{\α}}\right)}{t_{k-1}-t_{\mathrm{\α}}}(t_j-t_{\mathrm{\α}})\]|\≤\mathrm{\ϵ}$

Wherein, if described data point [t_k, x (t_k)] before subsequence be x={ x (t_α),x(t_α+1),…,x(t_k-1), X (t in formula_j) it is in t_jThe actual value in (α≤j≤k-1) moment.

This preferred embodiment arranges data processing unit 44, carries out data scanning, energy by the scanning stop condition setting Enough in linear session, carry out the data sequence of a unit interval of approximate description perception data using the line segment number of minimal number Row and ensure that error precision requires, then by the initial time of first line segment, the afterwards end time of every line segment and every The slope of line segment and is exported as the corresponding compressed data of data sequence of unit interval with intercept, thus decrease to need to pass The data volume sent, reduces the energy expenditure of data transmission, thus the communication relatively reducing wireless sensor network node is opened Pin；Propose formula that error precision requires it is ensured that the precision of data compression, and improve the speed of data scanning.

Preferably, described data receipt unit 45 is built by wireless sensor network sink node, described wireless biography Sensor network aggregation node is received after the corresponding compression of each sensor node based on the Data Transport Protocol ensureing weighted-fair Perception data, and by corresponding for the sensor node of reception compression after perception data be sent at high-performance computer Reason and analysis, realize the collection of wireless data；

Wherein, the Data Transport Protocol of described guarantee weighted-fair is:

It is right from sensor node i that described wireless sensor network sink node receives in certain unit interval [0, t] Quantity s of the perception data after the compression answered_i,tNeed to meet following fairness metric condition:

$\frac{{({\σ}_{i=1}^n{s}_{i,t}/w_i)}^2}{n{\σ}_{i=1}^n{(s_{i,t}/w_i)}^2}\&greaterequal;1-{(10\mathrm{\γ}/9)}^2$

In formula, w_iThe weights characterizing its data significance level of the sensor node i for setting, n is sensor node Sum, γ is constant, and its span is (0,0.2).

This preferred embodiment wireless sensor network sink node is connect based on the Data Transport Protocol ensureing weighted-fair Receive the perception data after the corresponding compression of each sensor node, enable wireless sensor network sink node from important sensing Device node receives more perception data it is ensured that while the efficiency of data transfer, improve the fairness of data transfer.

Preferably, described data transfer unit 46 transfers data to user by network, single including closely transmitting son Unit, telecommunication subelement and switching subelement, described short-range communication subelement adopts zigbee agreement to communicate, described remote Distance communication subelement adopts wireless communication, and under normal circumstances, user passes through short-range communication submodule from computer control End processed obtains monitoring information, and when user goes out, switching subelement starts telecommunication subelement, to user mobile phone control end Long Distant Transmit monitoring information.

This preferred embodiment arranges data transfer unit 46, can select communication mode it is achieved that reality according to user distance When monitoring.

In this application scenarios, limit of error takes 0.4 for ε, and monitoring velocity improves 10% relatively, and monitoring accuracy carries relatively High by 12%.

Application scenarios 4

Referring to Fig. 1, Fig. 2, the sewage network monitoring system based on big data technology of an embodiment of this application scene, Including big data processor 1, the wireless network processing module 4 by sewage network area distribution be arranged on the prison in sewage conduct Measuring point acquisition module 2, big data processor 1 connects monitoring point acquisition module 2 by wireless network processing module 4；Described big number According to processor 1 include big data processing unit 11 and the big data receiving unit 12 being connected with big data processing unit 11 respectively, Big data memory element 13, chart data display unit 14, big data receiving unit 12 and the long-range nothing of wireless network processing module 4 Line connects.

Preferably, described monitoring point acquisition module 2 includes main control unit 21 and the power supply being connected respectively with main control unit 21 Unit 22, sensor cluster 23；Described main control unit 21 is connected with described wireless network processing module 4；Described power subsystem 22 Powered for sensor cluster 23 by main control unit 21.

The above embodiment of the present invention is based on big data treatment technology, and the data of numerous sewage network monitoring points collection is carried out Collect and unified Analysis are processed, can achieve macroscopic view, the multiple monitoring of microcosmic, improve the monitoring capability to sewage network；Using wireless Network process module carries out data transmission, data acquisition, feedback ageing good, thus solving above-mentioned technical problem.

Preferably, described sensor cluster 23 includes temperature sensor, humidity sensor, level sensor, flow sensing Device, carbon monoxide transducer, transversal switch sensor.

The sensor cluster 23 of this preferred embodiment setting is it is achieved that the collection of relevant information, intelligent convenient.

Preferably, described sewage network monitoring system also includes alarm module 3, and described alarm module 3 and big data are processed Device 1 connects, and implements when Monitoring Data is abnormal to report to the police.

Preferably, described wireless network processing module 4 includes transducer position unit 41, sensor network optimizes unit 42nd, data monitoring unit 43, data processing unit 44, data receipt unit 45 data delivery unit 46.

This preferred embodiment constructs the framework of wireless network processing module 4.

Preferably, described transducer position unit 41 is used for unknown sensor network nodes are positioned, positioning side Method is as follows:

(1) integrated gps positioning chip on minority sensor node, these sensor nodes are obtained by receiving gps signal Self-position is taken to become known location node, as the location base of other unknown position nodes；

(2) ask for four mutual distances of known location node and jumping figure, calculate the distance averagely often jumped；

(3) for unknown position node x, averagely often jumped in the jumping figure of four known location nodes and (2) using it Distance is multiplied and obtains unknown position node to the distance of four known location nodes；

(4) choose wherein three known location nodes by way of combination in any, for each combination, surveyed according to three sides Mensuration its position of acquisition, then produce four result of calculations, ask for mean place as unknown position node final position.

This preferred embodiment arranges transducer position unit 41, is easy to obtain the position source of Monitoring Data, fixed using gps Position chip and the method for three side positioning combination, had both saved cost, and can obtain good locating effect.

Preferably, described sensor network is optimized unit 42 and using heredity-ant colony optimization algorithm, sensor network is route Algorithm is optimized, and concrete grammar is as follows:

(1) generate network topology structure of wireless sensor at random；

(2) set the parameter of genetic algorithm, sensor network is simplified using genetic algorithm, form new network topology knot Structure；

(3) ant group algorithm pheromone is initialized according to genetic algorithm result；

(4) set ant group algorithm parameter, using ant group algorithm, optimal path is scanned for and update.

This preferred embodiment is optimized to sensor network, limited ensureing that whole wireless sensor network performance declines In the case of, improve network energy-saving effect, extend the life-span of network.

Preferably, described data monitoring unit 43 be used for by by the sensor node that each sensor builds cooperate into The monitoring in certain region of row, and export the perception data of each sensor node monitoring；

Described data processing unit 44 is used for the perception data of each sensor node monitoring being compressed process, comprising:

If the data sequence of described perception data unit interval is x={ x (t₁),x(t₂),…,x(t_n), its Middle t_i(1≤i≤n) express time stabs, x (t_i) represent in t_iThe monitor value that (1≤i≤n) certain node of moment produces, sets by mistake Difference boundary is ε, and limit of error is the span of ε is [0.4,0.8], from first data point [t₁, x (t₁)] start, to data Sequence x={ x (t₁),x(t₂),…,x(t_n) in data point sequentially carry out scanning for the first time, when the scanning reaching setting stops During condition, stop primary scanning, the data subsequence of first time scanning approximately, is scanned from first time with a line segment Data subsequence after first data point proceed by similar secondary scanning, until scan through the whole unit interval The data sequence of section；By the initial time of first line segment, afterwards the slope of the end time of every line segment and every line segment with Intercept as the corresponding compressed data of data sequence of unit interval and exports；

Wherein, the described scanning stop condition setting as: when scanning a data point [t_k, x (t_k)], in this data Point [t_k, x (t_k)] before all data points approximate description can be come by a line segment, and meet error precision requirement, and add number Strong point [t_k, x (t_k)] after, do not exist a line segment energy approximate description currently all not by approximate description data point when, stop Scanning；

Described error precision requires:

$|x\left(t_j\right)-\[x\left(t_{\mathrm{\α}}\right)+\frac{x\left(t_{k-1}\right)-x\left(t_{\mathrm{\α}}\right)}{t_{k-1}-t_{\mathrm{\α}}}(t_j-t_{\mathrm{\α}})\]|\≤\mathrm{\ϵ}$

Wherein, if described data point [t_k, x (t_k)] before subsequence be x={ x (t_α),x(t_α+1),…,x(t_k-1), X (t in formula_j) it is in t_jThe actual value in (α≤j≤k-1) moment.

This preferred embodiment arranges data processing unit 44, carries out data scanning, energy by the scanning stop condition setting Enough in linear session, carry out the data sequence of a unit interval of approximate description perception data using the line segment number of minimal number Row and ensure that error precision requires, then by the initial time of first line segment, the afterwards end time of every line segment and every The slope of line segment and is exported as the corresponding compressed data of data sequence of unit interval with intercept, thus decrease to need to pass The data volume sent, reduces the energy expenditure of data transmission, thus the communication relatively reducing wireless sensor network node is opened Pin；Propose formula that error precision requires it is ensured that the precision of data compression, and improve the speed of data scanning.

Preferably, described data receipt unit 45 is built by wireless sensor network sink node, described wireless biography Sensor network aggregation node is received after the corresponding compression of each sensor node based on the Data Transport Protocol ensureing weighted-fair Perception data, and by corresponding for the sensor node of reception compression after perception data be sent at high-performance computer Reason and analysis, realize the collection of wireless data；

Wherein, the Data Transport Protocol of described guarantee weighted-fair is:

It is right from sensor node i that described wireless sensor network sink node receives in certain unit interval [0, t] Quantity s of the perception data after the compression answered_i,tNeed to meet following fairness metric condition:

$\frac{{({\σ}_{i=1}^n{s}_{i,t}/w_i)}^2}{n{\σ}_{i=1}^n{(s_{i,t}/w_i)}^2}\&greaterequal;1-{(10\mathrm{\γ}/9)}^2$

In formula, w_iThe weights characterizing its data significance level of the sensor node i for setting, n is sensor node Sum, γ is constant, and its span is (0,0.2).

This preferred embodiment wireless sensor network sink node is connect based on the Data Transport Protocol ensureing weighted-fair Receive the perception data after the corresponding compression of each sensor node, enable wireless sensor network sink node from important sensing Device node receives more perception data it is ensured that while the efficiency of data transfer, improve the fairness of data transfer.

Preferably, described data transfer unit 46 transfers data to user by network, single including closely transmitting son Unit, telecommunication subelement and switching subelement, described short-range communication subelement adopts zigbee agreement to communicate, described remote Distance communication subelement adopts wireless communication, and under normal circumstances, user passes through short-range communication submodule from computer control End processed obtains monitoring information, and when user goes out, switching subelement starts telecommunication subelement, to user mobile phone control end Long Distant Transmit monitoring information.

This preferred embodiment arranges data transfer unit 46, can select communication mode it is achieved that reality according to user distance When monitoring.

In this application scenarios, limit of error takes 0.4 for ε, and monitoring velocity improves 10% relatively, and monitoring accuracy carries relatively High by 12%.

Application scenarios 5

Referring to Fig. 1, Fig. 2, the sewage network monitoring system based on big data technology of an embodiment of this application scene, Including big data processor 1, the wireless network processing module 4 by sewage network area distribution be arranged on the prison in sewage conduct Measuring point acquisition module 2, big data processor 1 connects monitoring point acquisition module 2 by wireless network processing module 4；Described big number According to processor 1 include big data processing unit 11 and the big data receiving unit 12 being connected with big data processing unit 11 respectively, Big data memory element 13, chart data display unit 14, big data receiving unit 12 and the long-range nothing of wireless network processing module 4 Line connects.

Preferably, described monitoring point acquisition module 2 includes main control unit 21 and the power supply being connected respectively with main control unit 21 Unit 22, sensor cluster 23；Described main control unit 21 is connected with described wireless network processing module 4；Described power subsystem 22 Powered for sensor cluster 23 by main control unit 21.

The above embodiment of the present invention is based on big data treatment technology, and the data of numerous sewage network monitoring points collection is carried out Collect and unified Analysis are processed, can achieve macroscopic view, the multiple monitoring of microcosmic, improve the monitoring capability to sewage network；Using wireless Network process module carries out data transmission, data acquisition, feedback ageing good, thus solving above-mentioned technical problem.

Preferably, described sensor cluster 23 includes temperature sensor, humidity sensor, level sensor, flow sensing Device, carbon monoxide transducer, transversal switch sensor.

The sensor cluster 23 of this preferred embodiment setting is it is achieved that the collection of relevant information, intelligent convenient.

Preferably, described sewage network monitoring system also includes alarm module 3, and described alarm module 3 and big data are processed Device 1 connects, and implements when Monitoring Data is abnormal to report to the police.

Preferably, described wireless network processing module 4 includes transducer position unit 41, sensor network optimizes unit 42nd, data monitoring unit 43, data processing unit 44, data receipt unit 45 data delivery unit 46.

This preferred embodiment constructs the framework of wireless network processing module 4.

Preferably, described transducer position unit 41 is used for unknown sensor network nodes are positioned, positioning side Method is as follows:

(1) integrated gps positioning chip on minority sensor node, these sensor nodes are obtained by receiving gps signal Self-position is taken to become known location node, as the location base of other unknown position nodes；

(2) ask for four mutual distances of known location node and jumping figure, calculate the distance averagely often jumped；

(3) for unknown position node x, averagely often jumped in the jumping figure of four known location nodes and (2) using it Distance is multiplied and obtains unknown position node to the distance of four known location nodes；

(4) choose wherein three known location nodes by way of combination in any, for each combination, surveyed according to three sides Mensuration its position of acquisition, then produce four result of calculations, ask for mean place as unknown position node final position.

This preferred embodiment arranges transducer position unit 41, is easy to obtain the position source of Monitoring Data, fixed using gps Position chip and the method for three side positioning combination, had both saved cost, and can obtain good locating effect.

Preferably, described sensor network is optimized unit 42 and using heredity-ant colony optimization algorithm, sensor network is route Algorithm is optimized, and concrete grammar is as follows:

(1) generate network topology structure of wireless sensor at random；

(2) set the parameter of genetic algorithm, sensor network is simplified using genetic algorithm, form new network topology knot Structure；

(3) ant group algorithm pheromone is initialized according to genetic algorithm result；

(4) set ant group algorithm parameter, using ant group algorithm, optimal path is scanned for and update.

This preferred embodiment is optimized to sensor network, limited ensureing that whole wireless sensor network performance declines In the case of, improve network energy-saving effect, extend the life-span of network.

Preferably, described data monitoring unit 43 be used for by by the sensor node that each sensor builds cooperate into The monitoring in certain region of row, and export the perception data of each sensor node monitoring；

Described data processing unit 44 is used for the perception data of each sensor node monitoring being compressed process, comprising:

If the data sequence of described perception data unit interval is x={ x (t₁),x(t₂),…,x(t_n), its Middle t_i(1≤i≤n) express time stabs, x (t_i) represent in t_iThe monitor value that (1≤i≤n) certain node of moment produces, sets by mistake Difference boundary is ε, and limit of error is the span of ε is [0.4,0.8], from first data point [t₁, x (t₁)] start, to data Sequence x={ x (t₁),x(t₂),…,x(t_n) in data point sequentially carry out scanning for the first time, when the scanning reaching setting stops During condition, stop primary scanning, the data subsequence of first time scanning approximately, is scanned from first time with a line segment Data subsequence after first data point proceed by similar secondary scanning, until scan through the whole unit interval The data sequence of section；By the initial time of first line segment, afterwards the slope of the end time of every line segment and every line segment with Intercept as the corresponding compressed data of data sequence of unit interval and exports；

Wherein, the described scanning stop condition setting as: when scanning a data point [t_k, x (t_k)], in this data Point [t_k, x (t_k)] before all data points approximate description can be come by a line segment, and meet error precision requirement, and add number Strong point [t_k, x (t_k)] after, do not exist a line segment energy approximate description currently all not by approximate description data point when, stop Scanning；

Described error precision requires:

$|x\left(t_j\right)-\[x\left(t_{\mathrm{\α}}\right)+\frac{x\left(t_{k-1}\right)-x\left(t_{\mathrm{\α}}\right)}{t_{k-1}-t_{\mathrm{\α}}}(t_j-t_{\mathrm{\α}})\]|\≤\mathrm{\ϵ}$

Wherein, if described data point [t_k, x (t_k)] before subsequence be x={ x (t_α),x(t_α+1),…,x(t_k-1), X (t in formula_j) it is in t_jThe actual value in (α≤j≤k-1) moment.

This preferred embodiment arranges data processing unit 44, carries out data scanning, energy by the scanning stop condition setting Enough in linear session, carry out the data sequence of a unit interval of approximate description perception data using the line segment number of minimal number Row and ensure that error precision requires, then by the initial time of first line segment, the afterwards end time of every line segment and every The slope of line segment and is exported as the corresponding compressed data of data sequence of unit interval with intercept, thus decrease to need to pass The data volume sent, reduces the energy expenditure of data transmission, thus the communication relatively reducing wireless sensor network node is opened Pin；Propose formula that error precision requires it is ensured that the precision of data compression, and improve the speed of data scanning.

Preferably, described data receipt unit 45 is built by wireless sensor network sink node, described wireless biography Sensor network aggregation node is received after the corresponding compression of each sensor node based on the Data Transport Protocol ensureing weighted-fair Perception data, and by corresponding for the sensor node of reception compression after perception data be sent at high-performance computer Reason and analysis, realize the collection of wireless data；

Wherein, the Data Transport Protocol of described guarantee weighted-fair is:

It is right from sensor node i that described wireless sensor network sink node receives in certain unit interval [0, t] Quantity s of the perception data after the compression answered_i,tNeed to meet following fairness metric condition:

$\frac{{({\σ}_{i=1}^n{s}_{i,t}/w_i)}^2}{n{\σ}_{i=1}^n{(s_{i,t}/w_i)}^2}\&greaterequal;1-{(10\mathrm{\γ}/9)}^2$

In formula, w_iThe weights characterizing its data significance level of the sensor node i for setting, n is sensor node Sum, γ is constant, and its span is (0,0.2).

This preferred embodiment wireless sensor network sink node is connect based on the Data Transport Protocol ensureing weighted-fair Receive the perception data after the corresponding compression of each sensor node, enable wireless sensor network sink node from important sensing Device node receives more perception data it is ensured that while the efficiency of data transfer, improve the fairness of data transfer.

Preferably, described data transfer unit 46 transfers data to user by network, single including closely transmitting son Unit, telecommunication subelement and switching subelement, described short-range communication subelement adopts zigbee agreement to communicate, described remote Distance communication subelement adopts wireless communication, and under normal circumstances, user passes through short-range communication submodule from computer control End processed obtains monitoring information, and when user goes out, switching subelement starts telecommunication subelement, to user mobile phone control end Long Distant Transmit monitoring information.

This preferred embodiment arranges data transfer unit 46, can select communication mode it is achieved that reality according to user distance When monitoring.

In this application scenarios, limit of error takes 0.8 for ε, and monitoring velocity improves 14% relatively, and monitoring accuracy carries relatively High by 8%.

Finally it should be noted that above example is only in order to illustrating technical scheme, rather than the present invention is protected The restriction of shield scope, although having made to explain to the present invention with reference to preferred embodiment, those of ordinary skill in the art should Work as understanding, technical scheme can be modified or equivalent, without deviating from the reality of technical solution of the present invention Matter and scope.

Claims (3)

1. a kind of sewage network monitoring system based on big data technology is it is characterised in that including big data processor, pressing sewage The wireless network processing module of pipe network area distribution and the monitoring point acquisition module being arranged in sewage conduct, big data processor Monitoring point acquisition module is connected by wireless network processing module；Described big data processor includes big data processing unit and divides The big data receiving unit that is not connected with big data processing unit, big data memory element, chart data display unit, big data Receiving unit is connected with wireless network processing module long distance wireless.

2. a kind of sewage network monitoring system based on big data technology according to claim 1 is it is characterised in that described Monitoring point acquisition module includes main control unit and the power subsystem being connected respectively, sensor cluster with main control unit；Described master control Unit is connected with described wireless network processing module；Described power subsystem is powered for sensor cluster by main control unit.

3. a kind of sewage network monitoring system based on big data technology according to claim 2 is it is characterised in that described Sensor cluster includes temperature sensor, humidity sensor, level sensor, flow transducer, carbon monoxide transducer, level Switch sensor.