CN114138731A - Smart city data sharing method and system based on big data - Google Patents
Smart city data sharing method and system based on big data Download PDFInfo
- Publication number
- CN114138731A CN114138731A CN202111511974.2A CN202111511974A CN114138731A CN 114138731 A CN114138731 A CN 114138731A CN 202111511974 A CN202111511974 A CN 202111511974A CN 114138731 A CN114138731 A CN 114138731A
- Authority
- CN
- China
- Prior art keywords
- data
- sharing
- user
- big
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 20
- 238000006243 chemical reaction Methods 0.000 claims abstract description 8
- 238000013079 data visualisation Methods 0.000 claims abstract description 8
- 238000011156 evaluation Methods 0.000 claims abstract description 6
- 238000012795 verification Methods 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 9
- 238000013480 data collection Methods 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims 2
- 238000003672 processing method Methods 0.000 claims 1
- 238000013523 data management Methods 0.000 abstract description 2
- 238000007726 management method Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- -1 electricity Substances 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000000739 chaotic effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/904—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/906—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/50—Safety; Security of things, users, data or systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Business, Economics & Management (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Tourism & Hospitality (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Bioethics (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a smart city data sharing method and system based on big data, which realize smart city data sharing and data visualization through the steps of data acquisition, data processing, data response and data sharing by a big data server; the data is acquired through automatic collection, association and updating of big data, and then classification, data value degree evaluation, format conversion and encryption processing are carried out on the data, so that convenience and practicability of data management are improved on the basis of ensuring data security; meanwhile, when data are shared, corresponding sharing operation is executed according to the contribution degree of the user and the fine granularity of the data, so that the enthusiasm of the user for sharing the data is improved, and the data provision of the smart city and the establishment of a data sharing ecology are promoted.
Description
Technical Field
The invention relates to the technical field of smart city construction based on big data, in particular to a smart city data sharing method and system based on big data.
Background
The smart city is a product combining the Internet of things and the digital city, and the intelligent city management system utilizes a new generation of information technology, provides intelligent analysis and intelligent service on the basis of city big data, collects, stores and analyzes a large amount of data of the smart city, and manages city operation in an integrated and systematic mode. With the combination and continuous development of smart cities and big data, big data sharing becomes a key link for building a high-quality smart city management system.
In the current city management system, data of all departments in each field are independent and often dispersed on different platforms, which causes difficulty in acquiring the data; in addition, the data structure of each department in each field is chaotic, has no uniform classification standard, and has various data formats, thereby causing the difficulty of data sharing and recycling, and being not beneficial to the popularization and application of data sharing.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a smart city data sharing method and system based on big data.
In a first aspect, the invention provides a smart city data sharing method based on big data, which comprises the following steps:
and a data acquisition step, wherein the data acquisition step is to automatically collect big data, associate the big data and update the big data based on a big data server.
And data processing, wherein the data processing comprises the steps of classifying the acquired data, evaluating the data value degree, converting the format and storing the encrypted data.
And a step of data response, namely, according to the sharing request of the user, carrying out user authentication and establishing a sharing interface.
And a data sharing step, wherein based on the data response result, corresponding sharing operation is executed according to the user contribution degree and the data fine granularity, so that the smart city data sharing and data visualization are realized, and the sharing operation is marked and stored.
Further, the step of data acquisition includes, from each channel based on a big data server: network platform, government data platform, mobile device, data sensor and satellite communication equipment automatic acquisition data specifically include:
and a step of big data collection, wherein open data are collected based on the constructed data information collection module to form a first big data set.
And a step of big data association, which is to associate the big data with a user side and an equipment side which sign a data sharing protocol based on the information association module, collect private data and form a second big data set.
And updating big data, namely setting a fixed time interval to update the data of the first big data set and/or the second big data set. Or updating data of the first big data set and/or the second big data set in real time.
Further, the step of data processing includes:
and a data classification step, namely classifying the data in the big data set according to the data type and the data field according to the data collected in the data acquisition step.
And evaluating the data value degree, namely judging and marking the data value degree of the classified data according to a preset value degree judgment rule.
And a step of data format conversion, which is to convert the classified data into structural data with a uniform format.
And the safety encryption module judges the safety level of the classified data according to a preset safety level judgment rule, and encrypts and stores the data after selecting an encryption scheme based on different safety levels.
Further, the step of data response, according to the sharing request of the user, performs user authentication and establishes a sharing interface, and specifically includes:
the big data server receives a sharing request of a user, the authority verification module calls the unified authentication service to realize the identity verification of the user, and the data access authority of the user is determined according to the user identification and the sharing request.
And if the user passes the identity authentication, acquiring corresponding pre-shared data according to the request and the instruction content.
The big data server determines the contribution level of the user based on the user identification.
And distributing corresponding data use permission to the user according to the contribution degree level of the user, and determining final shared data in the pre-shared data based on the use permission.
And constructing fine granularity of the pre-shared data according to the data sharing requirement of the user.
Constructing a data sharing interface, wherein the data sharing interface adopts the following steps: SPARQL endpoint or REST web service.
Further, the step of data response further comprises a step of data sharing:
and the big data server sends the shared receipt to the user passing the identity authentication, and when the user accepts the shared receipt, the sharing operation is executed.
Storing the shared data in a cloud server.
And visually displaying the shared data stored in the cloud server through a display device.
And marking and storing the sharing operation.
In a second aspect, the present application provides a smart city data sharing system based on big data, the system includes:
the device comprises a data acquisition module, a data processing module, a data response module and a data sharing module, wherein the modules are in communication connection.
The data acquisition module automatically performs big data collection, big data association and big data update based on the big data server.
And the data processing module is used for classifying, evaluating the data value degree, converting the format and encrypting the data acquired by the data acquisition module and then storing the data.
And the data response module carries out user authentication and establishes a sharing interface according to the sharing request of the user.
And the data sharing module executes corresponding sharing operation according to the user contribution degree and the data fine granularity based on the user verification result of the data response module, so that the smart city data sharing and data visualization are realized, and the sharing operation is marked and stored.
Further, the data acquisition module comprises, from each channel based on a big data server: network platform, government data platform, mobile device, data sensor and satellite communication equipment automatic acquisition data specifically include:
and the big data collection unit is used for collecting open data based on the constructed data information collection module to form a first big data set.
And the big data association unit is associated with the user side and the equipment side which sign the data sharing protocol based on the information association module, collects private data and forms a second big data set.
And a big data updating unit which sets a fixed time interval to perform data updating on the first big data set and/or the second big data set. Or updating data of the first big data set and/or the second big data set in real time.
Further, the data processing module specifically includes:
and the data classification unit classifies the data in the big data set according to the data collected in the data acquisition step and the data type and the data field.
And the data value degree evaluation unit is used for judging and marking the data value degree of the classified data according to a preset value degree judgment rule.
And the data format conversion unit is used for converting the classified data into structural data with a uniform format.
And the safety encryption module judges the safety level of the classified data according to a preset safety level judgment rule, and encrypts and stores the data after selecting an encryption scheme based on different safety levels.
Further, the data response module performs user authentication and establishes a sharing interface according to a sharing request of a user, and specifically includes:
the big data server receives a sharing request of a user, the authority verification module calls the unified authentication service to realize the identity verification of the user, and the data access authority of the user is determined according to the user identification and the sharing request.
And if the user passes the identity authentication, acquiring corresponding pre-shared data according to the request and the instruction content.
The big data server determines the contribution level of the user based on the user identification.
And distributing corresponding data use permission to the user according to the contribution degree level of the user, and determining final shared data in the pre-shared data based on the use permission.
And constructing fine granularity of the pre-shared data according to the data sharing requirement of the user.
Constructing a data sharing interface, wherein the data sharing interface adopts the following steps: SPARQL endpoint or REST web service.
Further, the data sharing module sends a sharing receipt to the user who passes the identity authentication through the big data server, and when the user accepts the sharing receipt, the sharing operation is executed.
Storing the shared data in a cloud server.
And visually displaying the shared data stored in the cloud server through a display device.
And marking and storing the sharing operation.
The invention has the beneficial effects that: the smart city data sharing and data visualization are realized through the steps of data acquisition, data processing, data response and data sharing by the big data server. The data are acquired through automatic collection, association and updating of big data, and then classification, data value degree evaluation, format conversion and encryption processing are carried out on the data, so that convenience and practicability of data management are improved on the basis of ensuring data security. Meanwhile, when data are shared, corresponding sharing operation is executed according to the contribution degree of the user and the fine granularity of the data, so that the enthusiasm of the user for sharing the data is improved, and the data provision of the smart city and the establishment of a data sharing ecology are promoted.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below.
FIG. 1 is a flow chart of a smart city data sharing method based on big data in one embodiment.
FIG. 2 is a diagram of a smart city data sharing system based on big data according to an embodiment.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Detailed description of the preferred embodiment
As shown in fig. 1, an embodiment of the present invention provides a smart city data sharing method based on big data, including the following steps:
s101, a step of data acquisition, which is to automatically collect big data, associate the big data and update the big data based on a big data server.
And S102, data processing, wherein the data processing comprises the steps of classifying the acquired data, evaluating the data value degree, converting the format and storing the encrypted data.
S103, data response, namely, user authentication and shared interface establishment are carried out according to the sharing request of the user.
And S104, a data sharing step, namely executing corresponding sharing operation according to the user contribution degree and the data fine granularity based on the data response result, realizing smart city data sharing and data visualization, and marking and storing the sharing operation.
Further, in S101, the step of acquiring data includes, from each channel based on the big data server: network platform, government data platform, mobile device, data sensor and satellite communication equipment automatic acquisition data specifically include:
and a step of big data collection, wherein open data are collected based on the constructed data information collection module to form a first big data set.
And a step of big data association, which is to associate the big data with a user side and an equipment side which sign a data sharing protocol based on the information association module, collect private data and form a second big data set.
And updating big data, namely setting a fixed time interval to update the data of the first big data set and/or the second big data set. Or updating data of the first big data set and/or the second big data set in real time.
Further, in S102, the data processing step includes:
and a data classification step, namely classifying the data in the big data set according to the data type and the data field according to the data collected in the data acquisition step.
Furthermore, the large data information can be cleared and corrected, the open data information and the normal data information are merged and classified, and the open data information and the normal data information are classified and stored according to the data format.
For example: the data can be divided into: the system comprises statistical data, spatial data, policy data and other types of data, wherein the statistical data comprises a text form and a number form, the spatial data comprises a geographic coordinate information data form and an attribute information data form corresponding to geographic coordinate information, the policy data comprises a text form, and the rest data is divided into other types.
Further, the data may be classified according to a domain corresponding to the data, and the domain may include: water, electricity, gas, heat, environment, traffic data, medical, educational, environmental, entertainment, travel, housing, community, economic, financial, health, scientific, municipal, public safety, employment, or the like.
And evaluating the data value degree, namely judging and marking the data value degree of the classified data according to a preset value degree judgment rule.
Further, the data worth degree determination rule may set different weights to the data according to different application scenarios. For example: the value degree of the data can be judged from the aspects of the variety of the data, the depth of the data, the time span, the integrity of the data, the real-time performance of the data and the like.
The preset value degree determination rule includes, for example: different weights are distributed to the collected big data based on the variety, the data depth, the time span, the data integrity and the data real-time property of the data, so that the value degree of the data is calculated, and the data can be divided into grades. The above-described determination rule of the preset worth degree is merely an example, and is not a limitation to this, and the worth degree determination rule may be set as needed.
And a step of data format conversion, which is to convert the classified data into structural data with a uniform format.
The data is converted into the structural data with a uniform format, the unification of the data format is realized, different data formats are converted into the uniform format for sharing and publishing, and different types of data are provided for users to the maximum extent
And data are shared, so that the wide use of the data is promoted.
And the safety encryption module judges the safety level of the classified data according to a preset safety level judgment rule, and encrypts and stores the data after selecting an encryption scheme based on different safety levels.
Further, the security encryption and decryption module is used for selecting an encryption scheme for encryption according to the data encryption level set by the user, and comprises an encryption level judgment module and an encryption and decryption module. For example: the encryption grade judging module judges the encryption grade of the data stream according to the digital check sequence, if the encryption grade is first-grade encryption, the data stream is encrypted by adopting an MD5 encryption algorithm, if the encryption grade is second-grade encryption, the data stream is encrypted by adopting a block chain asymmetric encryption algorithm, and if the encryption grade is third-grade encryption, the data stream is encrypted by adopting a quantum encryption mode.
Further, in step S103, the data response step, according to the sharing request of the user, performs user authentication and establishes a sharing interface, and specifically includes:
the big data server receives a sharing request of a user, the authority verification module calls the unified authentication service to realize the identity verification of the user, and the data access authority of the user is determined according to the user identification and the sharing request.
And if the user passes the identity authentication, acquiring corresponding pre-shared data according to the request and the instruction content.
The big data server determines the contribution level of the user based on the user identification.
For example: the big data server can verify account information carried in a data request based on the data request of the user, so that the contribution degree level of the user is determined, and the corresponding data use permission function is allocated to the user according to the contribution degree level of the user.
Or, the authority management method for realizing data sharing through the mutual cooperation of a manager and a big data server is characterized in that the big data server acquires a data request of a user and sends the data request to a manager terminal, the manager terminal determines the contribution level of the user based on account information carried in the data request, and the corresponding data use authority is distributed to the user according to the contribution level of the user.
By dynamically setting the data value degree and the user contribution degree, the enthusiasm of users for sharing data is improved, and data supply and the establishment of data use ecology are promoted.
And distributing corresponding data use permission to the user according to the contribution degree level of the user, and determining final shared data in the pre-shared data based on the use permission.
And constructing fine granularity of the pre-shared data according to the data sharing requirement of the user.
Further, the data granularity may include: label, content, quality, reference, distribution, rate, location, etc.
Constructing a data sharing interface, wherein the data sharing interface adopts the following steps: SPARQL endpoint or REST web service.
Further, after the step of data response, the step of S103 further includes S104, and the step of data sharing:
and the big data server sends the shared receipt to the user passing the identity authentication, and when the user accepts the shared receipt, the sharing operation is executed.
Storing the shared data in a cloud server.
And visually displaying the shared data stored in the cloud server through a display device.
And marking and storing the sharing operation.
Detailed description of the invention
As shown in fig. 2, the present embodiment provides a smart city data sharing system based on big data, the system includes:
the device comprises a data acquisition module, a data processing module, a data response module and a data sharing module, wherein the modules are in communication connection.
The data acquisition module automatically performs big data collection, big data association and big data update based on the big data server.
And the data processing module is used for classifying, evaluating the data value degree, converting the format and encrypting the data acquired by the data acquisition module and then storing the data.
And the data response module carries out user authentication and establishes a sharing interface according to the sharing request of the user.
And the data sharing module executes corresponding sharing operation according to the user contribution degree and the data fine granularity based on the user verification result of the data response module, so that the smart city data sharing and data visualization are realized, and the sharing operation is marked and stored.
Further, the data acquisition module comprises, from each channel based on a big data server: network platform, government data platform, mobile device, data sensor and satellite communication equipment automatic acquisition data specifically include:
and the big data collection unit is used for collecting open data based on the constructed data information collection module to form a first big data set.
And the big data association unit is associated with the user side and the equipment side which sign the data sharing protocol based on the information association module, collects private data and forms a second big data set.
And a big data updating unit which sets a fixed time interval to perform data updating on the first big data set and/or the second big data set. Or updating data of the first big data set and/or the second big data set in real time.
Further, the data processing module specifically includes:
and the data classification unit classifies the data in the big data set according to the data collected in the data acquisition step and the data type and the data field.
For example: the data can be divided into: the system comprises statistical data, spatial data, policy data and other types of data, wherein the statistical data comprises a text form and a number form, the spatial data comprises a geographic coordinate information data form and an attribute information data form corresponding to geographic coordinate information, the policy data comprises a text form, and the rest data is divided into other types.
Further, the data may be classified according to a domain corresponding to the data, and the domain may include: water, electricity, gas, heat, environment, traffic data, medical, educational, environmental, entertainment, travel, housing, community, economic, financial, health, scientific, municipal, public safety, employment, or the like.
And the data value degree evaluation unit is used for judging and marking the data value degree of the classified data according to a preset value degree judgment rule.
Further, the data worth degree determination rule may set different weights to the data according to different application scenarios. For example: the value degree of the data can be judged from the aspects of the variety of the data, the depth of the data, the time span, the integrity of the data, the real-time performance of the data and the like.
The preset value degree determination rule includes, for example: different weights are distributed to the collected big data based on the variety, the data depth, the time span, the data integrity and the data real-time property of the data, so that the value degree of the data is calculated, and the data can be divided into grades. The above-described determination rule of the preset worth degree is merely an example, and is not a limitation to this, and the worth degree determination rule may be set as needed.
And the data format conversion unit is used for converting the classified data into structural data with a uniform format.
The data is converted into the structural data with a uniform format, the unification of the data format is realized, different data formats are converted into the uniform format for sharing and publishing, and different types of data are provided for users to the maximum extent
And data are shared, so that the wide use of the data is promoted.
And the safety encryption module judges the safety level of the classified data according to a preset safety level judgment rule, and encrypts and stores the data after selecting an encryption scheme based on different safety levels.
Further, the security encryption and decryption module is used for selecting an encryption scheme for encryption according to the data encryption level set by the user, and comprises an encryption level judgment module and an encryption and decryption module. For example: the encryption grade judging module judges the encryption grade of the data stream according to the digital check sequence, if the encryption grade is first-grade encryption, the data stream is encrypted by adopting an MD5 encryption algorithm, if the encryption grade is second-grade encryption, the data stream is encrypted by adopting a block chain asymmetric encryption algorithm, and if the encryption grade is third-grade encryption, the data stream is encrypted by adopting a quantum encryption mode.
Further, the data response module performs user authentication and establishes a sharing interface according to a sharing request of a user, and specifically includes:
the big data server receives a sharing request of a user, the authority verification module calls the unified authentication service to realize the identity verification of the user, and the data access authority of the user is determined according to the user identification and the sharing request.
And if the user passes the identity authentication, acquiring corresponding pre-shared data according to the request and the instruction content.
The big data server determines the contribution level of the user based on the user identification.
For example: the big data server can verify account information carried in a data request based on the data request of the user, so that the contribution degree level of the user is determined, and the corresponding data use permission function is allocated to the user according to the contribution degree level of the user.
Or, the authority management method for realizing data sharing through the mutual cooperation of a manager and a big data server is characterized in that the big data server acquires a data request of a user and sends the data request to a manager terminal, the manager terminal determines the contribution level of the user based on account information carried in the data request, and the corresponding data use authority is distributed to the user according to the contribution level of the user.
And distributing corresponding data use permission to the user according to the contribution degree level of the user, and determining final shared data in the pre-shared data based on the use permission.
And constructing fine granularity of the pre-shared data according to the data sharing requirement of the user.
Further, the data granularity may include: label, content, quality, reference, distribution, rate, location, etc.
Constructing a data sharing interface, wherein the data sharing interface adopts the following steps: SPARQL endpoint or REST web service.
Further, the data sharing module sends a sharing receipt to the user who passes the identity authentication through the big data server, and when the user accepts the sharing receipt, the sharing operation is executed.
Storing the shared data in a cloud server.
And visually displaying the shared data stored in the cloud server through a display device.
And marking and storing the sharing operation.
It should be noted that the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same. Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: it is to be understood that modifications may be made to the technical solutions described in the foregoing embodiments, or equivalents may be substituted for some of the technical features thereof, but such modifications or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A smart city data sharing method based on big data is characterized by comprising the following steps:
the method comprises the steps of data acquisition, wherein the data acquisition step specifically comprises the steps of automatically collecting big data, associating the big data and updating the big data based on a big data server;
the data processing method comprises the steps of classifying acquired data, evaluating data value degree, converting format and storing after encryption;
a step of data response, which is to verify the user and establish a sharing interface according to the sharing request of the user;
and a data sharing step, wherein based on the data response result, corresponding sharing operation is executed according to the user contribution degree and the data fine granularity, so that the smart city data sharing and data visualization are realized, and the sharing operation is marked and stored.
2. The smart city data sharing method based on big data according to claim 1, wherein the data obtaining step is based on big data server including from each channel: network platform, government data platform, mobile device, data sensor and satellite communication equipment automatic acquisition data specifically include:
collecting big data, namely collecting open data based on the constructed data information collection module to form a first big data set;
associating the big data, namely associating the big data with a user side and an equipment side which sign a data sharing protocol based on an information association module, collecting private data and forming a second big data set;
a step of updating big data, which is to set a fixed time interval to update the data of the first big data set and/or the second big data set; or updating data of the first big data set and/or the second big data set in real time.
3. The smart city data sharing method based on big data as claimed in claim 1, wherein the data processing step includes:
classifying the data, namely classifying the data in the big data set according to the data type and the data field according to the data collected in the data acquisition step;
evaluating the data value degree, namely judging and marking the data value degree of the classified data according to a preset value degree judgment rule;
converting the data format, namely converting the classified data into structural data with a uniform format;
and the safety encryption module judges the safety level of the classified data according to a preset safety level judgment rule, and encrypts and stores the data after selecting an encryption scheme based on different safety levels.
4. The smart city data sharing method based on big data as claimed in claim 1, wherein the data response step, according to the sharing request of the user, performs user authentication and establishes a sharing interface, specifically comprising:
the big data server receives a sharing request of a user, the authority verification module calls a unified authentication service to realize the identity verification of the user, and the data access authority of the user is determined according to the user identification and the sharing request;
if the user passes the identity authentication, acquiring corresponding pre-shared data according to the request and the instruction content;
the big data server determines the contribution level of the user based on the user identification;
distributing corresponding data use permission to the user according to the contribution degree level of the user, and determining final shared data in the pre-shared data based on the use permission;
constructing fine granularity of pre-shared data according to the data sharing requirement of a user;
constructing a data sharing interface, wherein the data sharing interface adopts the following steps: SPARQL endpoint or REST web service.
5. The big data-based smart city data sharing method according to claim 4, wherein the data response step further comprises a data sharing step:
the big data server sends a sharing receipt to the user passing the identity authentication, and when the user receives the sharing receipt, the sharing operation is executed;
storing the shared data in a cloud server;
carrying out visual display on the shared data stored in the cloud server through the display equipment;
and marking and storing the sharing operation.
6. A smart city data sharing system based on big data, the system comprising: the data acquisition module, the data processing module, the data response module and the data sharing module are in communication connection;
the data acquisition module automatically performs big data collection, big data association and big data update based on the big data server;
the data processing module performs classification, data value degree evaluation, format conversion and encryption on the data acquired by the data acquisition module and then stores the data;
the data response module carries out user authentication and establishes a sharing interface according to the sharing request of the user;
and the data sharing module executes corresponding sharing operation according to the user contribution degree and the data fine granularity based on the user verification result of the data response module, so that the smart city data sharing and data visualization are realized, and the sharing operation is marked and stored.
7. The smart city data sharing system based on big data as claimed in claim 6, wherein the data acquisition module comprises from each channel based on big data server: network platform, government data platform, mobile device, data sensor and satellite communication equipment automatic acquisition data specifically include:
the big data collection unit is used for collecting open data based on the constructed data information collection module to form a first big data set;
the big data association unit is used for associating with the user side and the equipment side which sign the data sharing protocol based on the information association module, collecting private data and forming a second big data set;
the big data updating unit is used for setting a fixed time interval to perform data updating on the first big data set and/or the second big data set; or updating data of the first big data set and/or the second big data set in real time.
8. The smart city data sharing system based on big data as claimed in claim 6, wherein the data processing module specifically comprises:
the data classification unit is used for classifying the data in the big data set according to the data collected in the data acquisition step and the data type and the data field;
the data value degree evaluation unit judges and marks the data value degree of the classified data according to a preset value degree judgment rule;
the data format conversion unit is used for converting the classified data into structural data with a uniform format;
and the safety encryption module judges the safety level of the classified data according to a preset safety level judgment rule, and encrypts and stores the data after selecting an encryption scheme based on different safety levels.
9. The smart city data sharing method based on big data as claimed in claim 6, wherein the data response module performs user authentication and establishes a sharing interface according to the sharing request of the user, specifically comprising:
the big data server receives a sharing request of a user, the authority verification module calls a unified authentication service to realize the identity verification of the user, and the data access authority of the user is determined according to the user identification and the sharing request;
if the user passes the identity authentication, acquiring corresponding pre-shared data according to the request and the instruction content;
the big data server determines the contribution level of the user based on the user identification;
distributing corresponding data use permission to the user according to the contribution degree level of the user, and determining final shared data in the pre-shared data based on the use permission;
constructing fine granularity of pre-shared data according to the data sharing requirement of a user;
constructing a data sharing interface, wherein the data sharing interface adopts the following steps: SPARQL endpoint or REST web service.
10. The smart city data sharing system based on big data as claimed in claim 9, wherein the data sharing module sends a sharing receipt to the authenticated user through the big data server, and when the user accepts the sharing receipt, performs the sharing operation;
storing the shared data in a cloud server;
carrying out visual display on the shared data stored in the cloud server through the display equipment;
and marking and storing the sharing operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111511974.2A CN114138731A (en) | 2021-12-07 | 2021-12-07 | Smart city data sharing method and system based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111511974.2A CN114138731A (en) | 2021-12-07 | 2021-12-07 | Smart city data sharing method and system based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114138731A true CN114138731A (en) | 2022-03-04 |
Family
ID=80385955
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111511974.2A Pending CN114138731A (en) | 2021-12-07 | 2021-12-07 | Smart city data sharing method and system based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114138731A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114860855A (en) * | 2022-05-10 | 2022-08-05 | 江苏阳光智慧城市科技有限公司 | Internet mobile terminal inputting system based on data management |
| CN115348295A (en) * | 2022-08-26 | 2022-11-15 | 中国长江三峡集团有限公司 | Data sharing method and device for offshore wind power equipment |
| CN117151905A (en) * | 2023-07-21 | 2023-12-01 | 深圳千岸科技股份有限公司 | Financial data sharing method and related device |
| CN117201501A (en) * | 2023-09-15 | 2023-12-08 | 武汉鲸禾科技有限公司 | Intelligent engineering sharing management system and operation method |
| CN117278252A (en) * | 2023-08-17 | 2023-12-22 | 武汉易通商融信息技术有限公司 | Big data based secure information sharing processing method, system and storage medium |
| CN117354070A (en) * | 2023-12-06 | 2024-01-05 | 南京勤德智能科技有限公司 | Intelligent water service data terminal safety protection system and method based on Internet of things |
-
2021
- 2021-12-07 CN CN202111511974.2A patent/CN114138731A/en active Pending
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114860855A (en) * | 2022-05-10 | 2022-08-05 | 江苏阳光智慧城市科技有限公司 | Internet mobile terminal inputting system based on data management |
| CN115348295A (en) * | 2022-08-26 | 2022-11-15 | 中国长江三峡集团有限公司 | Data sharing method and device for offshore wind power equipment |
| CN117151905A (en) * | 2023-07-21 | 2023-12-01 | 深圳千岸科技股份有限公司 | Financial data sharing method and related device |
| CN117278252A (en) * | 2023-08-17 | 2023-12-22 | 武汉易通商融信息技术有限公司 | Big data based secure information sharing processing method, system and storage medium |
| CN117201501A (en) * | 2023-09-15 | 2023-12-08 | 武汉鲸禾科技有限公司 | Intelligent engineering sharing management system and operation method |
| CN117201501B (en) * | 2023-09-15 | 2024-03-26 | 武汉鲸禾科技有限公司 | Intelligent engineering sharing management system and operation method |
| CN117354070A (en) * | 2023-12-06 | 2024-01-05 | 南京勤德智能科技有限公司 | Intelligent water service data terminal safety protection system and method based on Internet of things |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114138731A (en) | Smart city data sharing method and system based on big data | |
| CN110335187B (en) | Smart city operating system | |
| CN106027519B (en) | Efficient condition privacy protection and security authentication method in Internet of vehicles | |
| CN108964926A (en) | User trust negotiation establishing method based on two-layer block chain in heterogeneous alliance system | |
| CN103366255A (en) | Innovative social management intelligent network platform | |
| CN106779485B (en) | SOA architecture-based comprehensive management system and data processing method | |
| CN112469003A (en) | Traffic sensor network data transmission method, system and medium based on hybrid encryption | |
| CN106911670A (en) | Intimacy protection system and method in a kind of car networking | |
| CN108711011A (en) | Pass through Internet of Things generation, distribution task and the method for obtaining task completion assessment | |
| CN112383631A (en) | Regional Internet of things platform and data processing method based on regional Internet of things platform | |
| CN107330102B (en) | Whole journey tourism wisdom GIS online integrated management system | |
| CN116414912A (en) | Smart city information service system | |
| CN110542454A (en) | Environmental quality detection system based on block chain and Internet of things application technology | |
| CN103117999A (en) | Safe computer system and method based on cloud framework | |
| CN111861139A (en) | Merchant recommendation method and device and computer equipment | |
| CN112351408B (en) | Data safety transmission method and system for intelligent network-connected electric vehicle | |
| Didouh et al. | TileChain: A Blockchain-Based Framework for Security Service Management For Vehicular Communications | |
| CN112333199B (en) | Data processing method and device | |
| CN118657646B (en) | Distributed intelligent community platform based on zero trust network and communication method thereof | |
| CN112039839A (en) | Operation and maintenance method and device based on customer premise examination and approval authorization | |
| CN116415978B (en) | Text and travel consumption data analysis method and device based on federal learning and multiparty calculation | |
| Zhao et al. | Blockchain-enabled targeted information dissemination framework in vehicular networks | |
| KR102674769B1 (en) | My data-based personal travel information linkage system and server | |
| CN115460022B (en) | Resource management method for intelligent auxiliary platform | |
| CN118657646A (en) | Distributed intelligent community platform based on zero trust network and communication method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220304 |