CN112527805A - Real-time playback method of radio mass monitoring data - Google Patents
Real-time playback method of radio mass monitoring data Download PDFInfo
- Publication number
- CN112527805A CN112527805A CN202110101620.4A CN202110101620A CN112527805A CN 112527805 A CN112527805 A CN 112527805A CN 202110101620 A CN202110101620 A CN 202110101620A CN 112527805 A CN112527805 A CN 112527805A
- Authority
- CN
- China
- Prior art keywords
- playback
- data
- time
- frequency point
- distributed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/221—Column-oriented storage; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Computing Systems (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
本发明提供一种无线电海量监测数据的实时回放方法，包括依次连接的分布式存储系统、数据清洗加载模块、分布式回放存储模块、分布式回放控制模块；应用的采集机将采集的频谱数据传输至分布式存储系统；分布式存储系统为大数据平台的存储模块，原始监测上传至分布式存储系统后等待后续模块进行处理；数据清洗加载模块从分布式存储系统中提取数据，按照原子协议进行解帧后，对每个任务的监测文件进行解帧，保存并写入Hbase数据库中；分布式回放存储模块以列式存储的方式存储回放的数据，在列式存储Hbase数据库上实现；分布式回放控制模块用于回放的控制，包括接受外部的查询参数，进行回放速率控制，容错管理、流推送。
The invention provides a real-time playback method of radio mass monitoring data, comprising a distributed storage system, a data cleaning and loading module, a distributed playback storage module, and a distributed playback control module which are connected in sequence; an applied acquisition machine transmits the collected spectrum data to the distributed storage system; the distributed storage system is the storage module of the big data platform, and the original monitoring is uploaded to the distributed storage system and waits for subsequent modules to process; the data cleaning and loading module extracts data from the distributed storage system, and performs according to the atomic protocol. After de-framing, de-frame the monitoring files of each task, save and write them into the HBase database; the distributed playback storage module stores the playback data in a columnar storage manner, which is implemented on the columnar storage HBase database; distributed The playback control module is used for playback control, including accepting external query parameters, performing playback rate control, fault tolerance management, and stream push.
Description
Technical Field
The invention belongs to the technical field of playback of radio historical monitoring data, and particularly relates to a real-time playback method of radio mass monitoring data.
Background
With the construction and data convergence of a large radio monitoring data platform, radio monitoring centers in various provinces accumulate large-scale networking fixed station monitoring data which are precious data assets in the radio industry, the requirements of the monitoring centers and various radio applications on fine-grained playback of massive historical data are increasing day by day, and many applications need to query the data according to certain conditions and perform playback processing according to a specific playback sequence, such as multidimensional waterfall playback, occupancy rate trend, signal simulation and the like of the monitoring data. Since the playback data amount involved in the monitoring data playback is huge, generally the monitoring data amount of one year in one province is about 50T, the upper layer application cannot simply query the storage result data from the database and then play back the storage result. Currently, the playback of radio monitoring data provides the data in the following way:
original stream file mode: after receiving a request of the application for the original data playback, the center sends the monitoring file containing the time interval to the application by searching, and after receiving the reply message, the application acquires the original monitoring file from the corresponding address according to the download information of the reply message. The application unframes the part of the monitoring files according to the atomic service, acquires the data of the dimension required by the application and then applies the data
The coarse grain approach provides: because the amount of the played back data is huge, the center clusters the monitoring data according to days, hours and the like, keeps the average value of the levels of the monitoring data, stores the data in a database, and returns the data to an application after inquiring the data through corresponding inquiry conditions when the application needs to play back. And when the amount of data is large, it is difficult for the conventional database to guarantee the performance of data playback.
These playback methods and playback techniques all suffer from different drawbacks and cannot support large-scale playback services in an efficient and easy-to-use manner. On one hand, the application is provided with the original file, because the file needs to be downloaded and unframed, the playback speed is extremely slow, and because the file is the original file, the application needs to be unframed and positioned, the application pressure is caused; on one hand, the coarse-grained provision method cannot meet the granularity requirement of the application, and the specific query is executed on the static data of the database system, and the query result is returned to the user in a batch processing mode rather than a stream processing mode, so that the speed cannot be controlled; finally, the defects of long time delay of batch processing, incapability of controlling the playing speed and the like exist respectively in a database system or a stream calculation mode. Therefore, the existing playback modes cannot be directly used as a playback system to process static data.
Disclosure of Invention
The present invention aims to solve the above technical problems and provide a real-time playback method for radio massive monitoring data.
In order to achieve the purpose, the invention adopts the following technical scheme:
a real-time playback method of radio mass monitoring data comprises a distributed storage system, a data cleaning and loading module, a distributed playback storage module and a distributed playback control module which are connected in sequence; the applied acquisition machine transmits the acquired frequency spectrum data to a distributed storage system through data such as FTP (file transfer protocol), Flume and the like; the distributed storage system is a storage module of a big data platform, and original monitoring is uploaded to the distributed storage system and then waits for a subsequent module to process; the data cleaning and loading module extracts data from the distributed storage system, deframes the data according to an atomic protocol, deframes the monitoring file of each task, stores the deframed monitoring file according to a format of < time, frequency point and level >, and writes the deframed monitoring file into an Hbase database; the distributed playback storage module stores the played back data in a column-type storage mode and is implemented on a column-type storage Hbase database; the distributed playback control module is used for controlling playback, and comprises receiving external query parameters, performing playback rate control, fault-tolerant management and stream pushing; the distributed playback storage module is divided into a time sequence level data storage method and a frequency point detail storage method according to a time domain and a frequency domain.
Preferably, the time-series level data storage method stores data according to a time domain, the time-series level data completes the storage of the minute-level, fifteen-minute-level and hour-level data of all monitoring data, the storage of the characteristic values of each frequency point is completed in each time dimension, the characteristic values include the average value, the maximum value and the minimum value of the level of the frequency point at the moment, and the corresponding storage modes are as follows:
wherein, the row key of the time sequence level can be used as a row key to quickly inquire and position historical data, a 16 byte is used as the value of the row key, wherein, the task ID of 6 bits is mapped by 32 bit task IDs according to the sequence of numbers;
timestamp represents a timestamp, the time value at which data was written for this purpose; in the column names, startfreq represents the value of the starting frequency point at the moment, step represents the monitoring step length at the moment, and num represents the number of the frequency points at the moment; avg represents the average value of the level at the moment, each frequency point has an average level value, two bytes are occupied, and the average level values of all the frequency points are arranged according to the frequency point sequence and are stored according to the byte array; min and max represent the minimum and maximum levels, which are organized and stored in the same way as the average level.
Preferably, the frequency point details are mainly stored in a frequency domain, the frequency point details are mainly aggregated in aggregation granularity of fifteen minutes and hour, and the corresponding storage mode is as follows:
wherein, rowkey of frequency point details is used as row key to quickly inquire and position historical data, wherein, 15 bytes are selected as row key value, wherein, the 6-bit task ID is mapped by 32-bit task ID according to the sequence of numbers;
timestamp represents a timestamp, the time value at which data was written for this purpose; in the column name, { time1} indicates a specific time, the corresponding values are all level values of a specific frequency point at that time and the number of times the level occurs, and the level values are arranged in descending or ascending order of the level values.
Preferably, the distributed playback control module comprises a playback controller, the playback controller is used for playing back data streams, and the playback controller comprises a frequency point controller, an occupancy rate controller and a level controller;
the real-time playback method of the radio mass monitoring data comprises a playback job execution method, and the playback job execution method comprises the following steps:
s1. the playback client sends a playback request to the playback server, the playback request mainly supports the query of frequency point trend, level and occupancy rate, the minimum supported time granularity is 1 minute;
s2, after receiving the request, the playback server sends the request to corresponding controllers according to the type of the request, and the various request controllers decompose, dilute and control the speed of the playback request;
s3. decomposing and mapping the requests by various controllers, changing the requests into a string of continuous rowkeys, and inquiring corresponding records from Hbase by the controllers by taking the rowkeys as keywords;
s4. each request controller sends the received data to the playback server;
s5. the playback server returns data to the playback client in turn according to the connection socket streaming interface.
Preferably, the playback controller comprises a time sequence level playback and a frequency point detail playback;
the time sequence level playback shows the characteristic conditions of all frequency points at a certain moment, such as the average level, the median, the maximum and the minimum of the frequency points, and the input parameters are as follows: < start time, end time, start frequency point, end frequency point, rarefaction pace, playback rate, device ID >;
and the frequency point detail playback shows the full situation of the frequency point at each moment in a period of time, such as occupancy rate, trend and the like, and the input parameters are as follows: < start time, end time, frequency point, playback rate, device ID >;
according to the parameters, the playback system sequentially acquires all data corresponding to time, frequency points and equipment from the column storage, the data are sequentially sent to the application to meet the real-time data requirement of the application, the playback of all the data supports the specified playback rate, and the playback controller controls the sending rate through the playback rate in the parameters.
Preferably, after receiving a playback request of a playback client, a playback controller decomposes the request according to request parameters to generate a series of rowkeys required by the query, the playback controller queries from an Hbase database according to the rowkeys, a part of query results are put into a cache of the playback, a speed controller of the playback controller reads data from the cache according to the speed and sends the data to an application client, if the data in the cache is consumed completely, the rest of the rowkeys are used for continuously querying the data from the Hbase database, and the playback controller sends the results to the playback client one by one in a socket data stream mode.
After the technical scheme is adopted, the invention has the following advantages:
in order to realize that the radio data playback needs to read the data with self-defined, rapid and coarse granularity, and transmit the data to data display software and algorithm to carry out diversified display such as numbers, curves, drawings, algorithms and the like, thereby facilitating the reproduction of upper-layer application.
Drawings
Fig. 1 is a schematic structural diagram of a real-time playback method of radio mass monitoring data;
FIG. 2 is a flow chart illustrating the steps of a real-time playback method of radio mass monitoring data;
fig. 3 is a flowchart illustrating steps of a playback operation execution method in a real-time playback method of radio mass monitoring data.
Detailed Description
The present invention will be described in further detail with reference to the following drawings and specific examples.
As shown in fig. 1 to 3, a real-time playback method for radio mass monitoring data includes a distributed storage system, a data cleaning and loading module, a distributed playback storage module, and a distributed playback control module, which are connected in sequence.
The applied acquisition machine transmits the acquired frequency spectrum data to a distributed storage system through data such as FTP (file transfer protocol), Flume and the like; the distributed storage system is a storage module of a big data platform, and original monitoring is uploaded to the distributed storage system and then waits for a subsequent module to process; the data cleaning and loading module extracts data from the distributed storage system, deframes the data according to an atomic protocol, deframes the monitoring file of each task, stores the deframed monitoring file according to a format of < time, frequency point and level >, and writes the deframed monitoring file into an Hbase database; the distributed playback storage module stores the played back data in a column-type storage mode and is implemented on a column-type storage Hbase database; the distributed playback control module is used for controlling playback, and comprises the steps of receiving external query parameters, performing playback rate control, fault-tolerant management and stream pushing.
The real-time playback method of the radio mass monitoring data specifically comprises the following steps:
1. the networking monitoring application issues a monitoring task, monitoring data are stored in a monitoring application acquisition machine, and the acquisition machine transmits the data to a distributed storage system through data transmission software (FTP, FLUME) at intervals;
2. the distributed storage system performs compressed storage according to tasks and equipment;
3. the data cleaning and loading module detects the uploaded data, deframes the newly uploaded data according to an atomic protocol, and stores the deframed data into a distributed playback storage;
4. distributed playback storage uses columnar storage playback data (Hbase), including storage of time series level data and frequency point detail data;
5. the playback controller converts the playback request parameters into a row key group, fetches data from the distributed playback storage through the row keys, and finally sends the data to the upper application according to the designated rate.
The distributed playback storage module is divided into a time sequence level data storage method and a frequency point detail storage method according to a time domain and a frequency domain.
The time sequence level data storage method stores data according to a time domain, the time sequence level data completes the storage of minute-level, fifteen-minute-level and hour-level data of all monitoring data, the storage of characteristic values of each frequency point is completed under each time dimension, the characteristic values comprise the average value, the maximum value and the minimum value of the level of the frequency point at the moment, and the corresponding storage modes are as follows:
wherein, the row key of the time sequence level can be used as a row key to quickly inquire and position historical data, a 16 byte is used as the value of the row key, wherein, the task ID of 6 bits is mapped by 32 bit task IDs according to the sequence of numbers;
timestamp represents a timestamp, the time value at which data was written for this purpose; in the column names, startfreq represents the value of the starting frequency point at the moment, step represents the monitoring step length at the moment, and num represents the number of the frequency points at the moment; avg represents the average value of the level at the moment, each frequency point has an average level value, two bytes are occupied, and the average level values of all the frequency points are arranged according to the frequency point sequence and are stored according to the byte array; min and max represent the minimum and maximum levels, which are organized and stored in the same way as the average level.
The frequency point details are mainly stored in a frequency domain, the frequency point details are mainly aggregated on aggregation granularity of fifteen minutes and hour, and the corresponding storage modes are as follows:
wherein, rowkey of frequency point details is used as row key to quickly inquire and position historical data, wherein, 15 bytes are selected as row key value, wherein, the 6-bit task ID is mapped by 32-bit task ID according to the sequence of numbers;
timestamp represents a timestamp, the time value at which data was written for this purpose; in the column name, { time1} indicates a specific time, the corresponding values are all level values of a specific frequency point at that time and the number of times the level occurs, and the level values are arranged in descending or ascending order of the level values.
The real-time playback process of the radio mass monitoring data comprises the following steps:
1. the data cleaning and loading module calls a wireless data atomic protocol to unframe data, and the data is written into an Hbase database after being aggregated according to the requirement of a design table in the Hbase database;
2. the playback client sends a playback request to a playback server, the playback request mainly supports the query of frequency point trend, level and occupancy rate, and the minimum supported time granularity is 1 minute;
3. after receiving the request, the playback server sends the request to corresponding controllers according to the type of the request, and the various request controllers decompose, dilute and control the speed of the playback request;
4. decomposing and mapping the requests by various controllers, changing the requests into a string of continuous rowkeys, and inquiring corresponding records from the Hbase by the controllers by taking the rowkeys as keywords;
5. the various request controllers send the received data to a playback server;
6. and the playback server sequentially returns the data to the playback client according to the connection socket stream interface.
The distributed playback control module comprises a playback controller, the playback controller is used for playing back data streams, and the playback controller comprises a frequency point controller, an occupancy rate controller and a level controller;
the real-time playback method of the radio mass monitoring data comprises a playback job execution method, and the playback job execution method comprises the following steps:
s1. the playback client sends a playback request to the playback server, the playback request mainly supports the query of frequency point trend, level and occupancy rate, the minimum supported time granularity is 1 minute;
s2, after receiving the request, the playback server sends the request to corresponding controllers according to the type of the request, and the various request controllers decompose, dilute and control the speed of the playback request;
s3. decomposing and mapping the requests by various controllers, changing the requests into a string of continuous rowkeys, and inquiring corresponding records from Hbase by the controllers by taking the rowkeys as keywords;
s4. each request controller sends the received data to the playback server;
s5. the playback server returns data to the playback client in turn according to the connection socket streaming interface.
The playback controller comprises time sequence level playback and frequency point detail playback;
the time sequence level playback shows the characteristic conditions of all frequency points at a certain moment, such as the average level, the median, the maximum and the minimum of the frequency points, and the input parameters are as follows: < start time, end time, start frequency point, end frequency point, rarefaction pace, playback rate, device ID >;
and the frequency point detail playback shows the full situation of the frequency point at each moment in a period of time, such as occupancy rate, trend and the like, and the input parameters are as follows: < start time, end time, frequency point, playback rate, device ID >;
according to the parameters, the playback system sequentially acquires all data corresponding to time, frequency points and equipment from the column storage, the data are sequentially sent to the application to meet the real-time data requirement of the application, the playback of all the data supports the specified playback rate, and the playback controller controls the sending rate through the playback rate in the parameters.
The playback control of the real-time playback of the radio mass monitoring data mainly realizes the control of the playback rate so as to ensure the stability of the playback operation, and the realization process comprises the following steps:
1. after receiving a playback request of a playback client, the playback controller decomposes the request according to the request parameters to generate a series of rowkeys required by the query;
2. the playback controller inquires from Hbase according to the rowkeys, and a part of inquiry results are put into a cache of the playback;
3. the speed controller of the playback controller reads data from the cache according to the speed and sends the data to the application client, and if the data in the cache is completely consumed, the data is continuously inquired from the Hbase by using the rest Rowkey;
4. the playback controller sends the results to the client end one by one in the form of a socket data stream.
To this end, the data playback logic can meet all the requirements of a radio playback service.
Other embodiments of the present invention than the preferred embodiments described above will be apparent to those skilled in the art from the present invention, and various changes and modifications can be made therein without departing from the spirit of the present invention as defined in the appended claims.
Claims (6)
1. A real-time playback method of radio massive monitoring data is characterized by comprising a distributed storage system, a data cleaning and loading module, a distributed playback storage module and a distributed playback control module which are sequentially connected;
the applied acquisition machine transmits the acquired frequency spectrum data to a distributed storage system through data such as FTP (file transfer protocol), Flume and the like; the distributed storage system is a storage module of a big data platform, and original monitoring is uploaded to the distributed storage system and then waits for a subsequent module to process; the data cleaning and loading module extracts data from the distributed storage system, deframes the data according to an atomic protocol, deframes the monitoring file of each task, stores the deframed monitoring file according to a format of < time, frequency point and level >, and writes the deframed monitoring file into an Hbase database; the distributed playback storage module stores the played back data in a column-type storage mode and is implemented on a column-type storage Hbase database; the distributed playback control module is used for controlling playback, and comprises receiving external query parameters, performing playback rate control, fault-tolerant management and stream pushing; the distributed playback storage module is divided into a time sequence level data storage method and a frequency point detail storage method according to a time domain and a frequency domain.
2. The method for real-time playback of radio massive monitoring data according to claim 1, wherein the time sequence level data storage method stores data in time domain, the time sequence level data completes the storage of data of all the monitoring data in minute, fifteen minute and hour levels, and completes the storage of characteristic values of each frequency point in each time dimension, the characteristic values include the average value, the maximum value and the minimum value of the level of the frequency point at the time, and the corresponding storage modes are as follows:
wherein, the row key of the time sequence level can be used as a row key to quickly inquire and position historical data, a 16 byte is used as the value of the row key, wherein, the task ID of 6 bits is mapped by 32 bit task IDs according to the sequence of numbers;
timestamp represents a timestamp, the time value at which data was written for this purpose; in the column names, startfreq represents the value of the starting frequency point at the moment, step represents the monitoring step length at the moment, and num represents the number of the frequency points at the moment; avg represents the average value of the level at the moment, each frequency point has an average level value, two bytes are occupied, and the average level values of all the frequency points are arranged according to the frequency point sequence and are stored according to the byte array; min and max represent the minimum and maximum levels, which are organized and stored in the same way as the average level.
3. The method as claimed in claim 1, wherein the frequency point details mainly implement data storage in frequency domain, and the frequency point details mainly complete aggregation of the frequency point details on aggregation granularity of fifteen minutes and hour, and the corresponding storage modes are as follows:
wherein, rowkey of frequency point details is used as row key to quickly inquire and position historical data, wherein, 15 bytes are selected as row key value, wherein, the 6-bit task ID is mapped by 32-bit task ID according to the sequence of numbers;
timestamp represents a timestamp, the time value at which data was written for this purpose; in the column name, { time1} indicates a specific time, the corresponding values are all level values of a specific frequency point at that time and the number of times the level occurs, and the level values are arranged in descending or ascending order of the level values.
4. The real-time playback method of the radio mass monitoring data according to any one of claims 1 to 3, wherein the distributed playback control module includes a playback controller, the playback controller is used for playing back data streams, and the playback controller includes a frequency point controller, an occupancy rate controller and a level controller;
the real-time playback method of the radio mass monitoring data comprises a playback job execution method, and the playback job execution method comprises the following steps:
s1. the playback client sends a playback request to the playback server, the playback request mainly supports the query of frequency point trend, level and occupancy rate, the minimum supported time granularity is 1 minute;
s2, after receiving the request, the playback server sends the request to corresponding controllers according to the type of the request, and the various request controllers decompose, dilute and control the speed of the playback request;
s3. decomposing and mapping the requests by various controllers, changing the requests into a string of continuous rowkeys, and inquiring corresponding records from Hbase by the controllers by taking the rowkeys as keywords;
s4. each request controller sends the received data to the playback server;
s5. the playback server returns data to the playback client in turn according to the connection socket streaming interface.
5. The method as claimed in claim 4, wherein the playback controller comprises a timing level playback and a frequency point detail playback;
the time sequence level playback shows the characteristic conditions of all frequency points at a certain moment, such as the average level, the median, the maximum and the minimum of the frequency points, and the input parameters are as follows: < start time, end time, start frequency point, end frequency point, rarefaction pace, playback rate, device ID >;
and the frequency point detail playback shows the full situation of the frequency point at each moment in a period of time, such as occupancy rate, trend and the like, and the input parameters are as follows: < start time, end time, frequency point, playback rate, device ID >;
according to the parameters, the playback system sequentially acquires all data corresponding to time, frequency points and equipment from the column storage, the data are sequentially sent to the application to meet the real-time data requirement of the application, the playback of all the data supports the specified playback rate, and the playback controller controls the sending rate through the playback rate in the parameters.
6. The method as claimed in claim 4, wherein the playback controller, after receiving the playback request from the playback client, decomposes the request according to the request parameters to generate a series of rowkeys required for the query, queries the Hbase database according to the rowkeys, puts a portion of the query results into the buffer for the playback, reads the data from the buffer according to the rate, and sends the data to the application client, if the data in the buffer is consumed, continues to query the Hbase database with the remaining rowkeys, and sends the results to the playback client one by one in the form of socket data stream.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110101620.4A CN112527805B (en) | 2021-01-26 | 2021-01-26 | A real-time playback method of radio mass monitoring data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110101620.4A CN112527805B (en) | 2021-01-26 | 2021-01-26 | A real-time playback method of radio mass monitoring data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112527805A true CN112527805A (en) | 2021-03-19 |
| CN112527805B CN112527805B (en) | 2022-04-19 |
Family
ID=74975450
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110101620.4A Active CN112527805B (en) | 2021-01-26 | 2021-01-26 | A real-time playback method of radio mass monitoring data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112527805B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113194011A (en) * | 2021-04-29 | 2021-07-30 | 浙江原初数据科技有限公司 | Automatic establishment method and device for radio electromagnetic signal environment |
| CN113609081A (en) * | 2021-07-28 | 2021-11-05 | 浙江原初数据科技有限公司 | Radio ultrashort wave frequency band monitoring frequency sweep basic data storage method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103999090A (en) * | 2011-12-14 | 2014-08-20 | 奈飞公司 | Improving startup times of streaming digital media playback |
| US20140279841A1 (en) * | 2013-03-13 | 2014-09-18 | Wal-Mart Stores, Inc. | System and method for streaming events in a transaction-based system |
| CN105893596A (en) * | 2016-04-18 | 2016-08-24 | 华信咨询设计研究院有限公司 | Radio monitoring data replay method |
-
2021
- 2021-01-26 CN CN202110101620.4A patent/CN112527805B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103999090A (en) * | 2011-12-14 | 2014-08-20 | 奈飞公司 | Improving startup times of streaming digital media playback |
| US20140279841A1 (en) * | 2013-03-13 | 2014-09-18 | Wal-Mart Stores, Inc. | System and method for streaming events in a transaction-based system |
| CN105893596A (en) * | 2016-04-18 | 2016-08-24 | 华信咨询设计研究院有限公司 | Radio monitoring data replay method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113194011A (en) * | 2021-04-29 | 2021-07-30 | 浙江原初数据科技有限公司 | Automatic establishment method and device for radio electromagnetic signal environment |
| CN113609081A (en) * | 2021-07-28 | 2021-11-05 | 浙江原初数据科技有限公司 | Radio ultrashort wave frequency band monitoring frequency sweep basic data storage method |
| CN113609081B (en) * | 2021-07-28 | 2023-07-28 | 浙江原初数据科技有限公司 | Method for storing radio ultrashort wave frequency band monitoring sweep frequency basic data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112527805B (en) | 2022-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109710678B (en) | Real-time data system for industrial big data monitoring management and operation method | |
| CN102541990B (en) | Database redistribution method and system utilizing virtual partitions | |
| CN100568872C (en) | Content management device and content management system | |
| CN112527805A (en) | Real-time playback method of radio mass monitoring data | |
| US20100169350A1 (en) | High-performance, scalable, adaptive and multi-dimensional event repository | |
| CN107704545A (en) | Railway distribution net magnanimity information method for stream processing based on Storm Yu Kafka message communicatings | |
| CN102272751B (en) | Data integrity in a database environment through background synchronization | |
| CN105740352A (en) | Historical data service system used for smart power grid dispatching control system | |
| CN104778225A (en) | Method for synchronizing data in unstructured data multi-storage system | |
| CN102130959A (en) | A system and method for implementing cloud storage resource scheduling | |
| CN102932846A (en) | Data management system for distributed heterogeneous sensing network and data management method for data management system | |
| CN104935951B (en) | One kind being based on distributed video transcoding method | |
| CN112035563A (en) | Real-time database system based on shared storage | |
| CN114189455A (en) | Container network flow monitoring and counting method and system based on ebpf technology | |
| CN106537347A (en) | Distributing and processing streams over one or more networks for on-the-fly schema evolution | |
| CN103548004A (en) | Method and device for realizing multilevel storage in file system | |
| CN102497450A (en) | Two-stage-system-based distributed data compression processing method | |
| CN105407044A (en) | Method for implementing cloud storage gateway system based on network file system (NFS) | |
| CN111245863A (en) | Industrial data edge perception and management system of multiple disaster recovery backup architecture | |
| CN114969057A (en) | A data reading system and data reading method based on time series database | |
| CN112395344A (en) | A PLC data acquisition and management system | |
| CN114547071A (en) | Real-time alarm monitoring method based on thermal data cache service | |
| Wang et al. | SACCS: scalable asynchronous cache consistency scheme for mobile environments | |
| CN101382959B (en) | A method, device and system for acquiring multimedia resources | |
| CN104301757A (en) | Domestic KTV requesting method and system based on cloud technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A real-time playback method for massive wireless monitoring data Granted publication date: 20220419 Pledgee: Hangzhou branch of Bank of Nanjing Co.,Ltd. Pledgor: Zhejiang Yuanchu Data Technology Co.,Ltd. Registration number: Y2025980023072 |