CN111294350B - Data processing system capable of quickly adapting to protocol change - Google Patents
Data processing system capable of quickly adapting to protocol change Download PDFInfo
- Publication number
- CN111294350B CN111294350B CN202010076512.1A CN202010076512A CN111294350B CN 111294350 B CN111294350 B CN 111294350B CN 202010076512 A CN202010076512 A CN 202010076512A CN 111294350 B CN111294350 B CN 111294350B
- Authority
- CN
- China
- Prior art keywords
- data
- protocol
- module
- frame
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/06—Notations for structuring of protocol data, e.g. abstract syntax notation one [ASN.1]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2273—Test methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Communication Control (AREA)
Abstract
The invention discloses a data processing system capable of rapidly adapting to protocol change, which comprises a main control module, an interface module, a protocol preprocessing module, a data processing module and a storage module, wherein the main control module is used for controlling the interface module to be connected with the protocol preprocessing module; the main control module starts the whole system and loads each functional module; the interface module displays a protocol list and a data list and responds to the main control module message and the user instruction; the protocol preprocessing module preprocesses the data protocol into a preset format; the protocol module reads in the preprocessed data protocol, calculates the position of the data item according to the length of the data item and the number information of the data item and records the position in the protocol, wherein the position information of the data item is not listed in the data protocol; the data processing module identifies a data protocol, analyzes data to be analyzed into effective data items according to a data protocol list, and arranges periodic data according to a time sequence; the storage module stores the analyzed data; the invention can quickly adapt to protocol changes.
Description
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to a data processing system capable of rapidly adapting to protocol change.
Background
The system test is a product test carried out in a laboratory or an external field, is an important link in the product development process, is an important means for finding product design and trial-manufacture defects and verifying that the product meets the use requirements, and is an important early step before a flight test of a guided ammunition weapon system. A large amount of test data can be generated in the process of system testing, the analysis and the processing of the test data are complex systematic work, the traditional test data processing mode is that a model of project personnel develops data processing software to process the test data, and because the model has respective development team and a special data recording format, a corresponding set of data processing program needs to be developed, the data processing mode has the defects that: 1) the inheritance of data and programs is poor, and the sharing is difficult; 2) low level repetition, low processing efficiency and easy error; 3) the modification period of the data processing program caused by the definition adjustment of the system data is long, and the influence range is large.
In the initial stage of development of a project, data definition in a system often changes, and in order to meet the test requirements of the system, a data processing system capable of analyzing test data in time according to changes of a system protocol is needed to ensure the data processing requirements in a large number of test processes of the system and ensure that the test data can be processed and analyzed in time.
The common processing program writes the data definition in the program, and when the data definition is changed in the system, the program needs to be modified to adapt to the new definition, so that a great deal of time is spent in the process.
Another method of protocol-independent data processing is to store data and data attributes together as data in association with each other. This method is usually used by professional organizations who propose Data structures and access mechanisms, such as HDF (hierarchical Data Format). The disadvantages of such a process are: (1) the whole mechanism is complex, and the professional ability required for developing a data recording and processing system on the basis of the complex mechanism is strong; (2) when the data protocol changes, the data recording system needs to change in time, thereby bringing more workload. The above two points have a relatively large development difficulty under the conditions of short system test project period and limited manpower.
Disclosure of Invention
In view of this, the present invention provides a data processing system capable of adapting to protocol changes quickly, and the data processing system is capable of adapting to protocol changes quickly without affecting the recording and storage of original data.
The technical scheme for realizing the invention is as follows:
a data processing system capable of rapidly adapting to protocol change comprises a main control module, an interface module, a protocol preprocessing module, a data processing module and a storage module;
the main control module starts the whole system and loads each functional module;
the interface module displays a protocol list and a data list, and responds to the message of the main control module and the user instruction;
the protocol preprocessing module preprocesses the data protocol into a preset format;
the protocol module reads in the preprocessed data protocol, calculates the position of the data item according to the length of the data item and the number information of the data item and records the position in the protocol, wherein the position information of the data item is not listed in the data protocol;
the data processing module identifies a data protocol, analyzes data to be analyzed into effective data items according to a data protocol list, and arranges periodic data according to a time sequence;
and the storage module stores the analyzed data.
Further, the preset format is:
first row: the length of the frame header;
a second row: frame header content;
third row: the frame length comprises the lengths of the frame header and the check sum;
fourth row: an X-axis, where 0 denotes the use of frame count as a time stamp, -1 denotes the pre-header time stamp, and other natural numbers denote the use of intra-frame data as a time stamp;
the fifth element: a time scale length;
a sixth line: a period;
the text content follows the following format:
sequence number name length scale sign bit definition
The sequence number is a natural number starting from 1 and is consistent with an original data protocol;
the name is the name of the data and is consistent with the original data protocol;
the length is the data length, when analyzing according to the bit, only the last valid data of the current byte is 1, and other bits are written with 0;
the scale is used for data analysis;
symbol: 0 is unsigned number, 1 is signed number, and 2 is bit-wise resolution;
bit definition: and analyzing the corresponding bits according to the bits.
Further, the data processing module specifically processes the data as follows: finding a corresponding protocol from the protocol list according to a frame header of the data to be analyzed, recording the position of the protocol in the protocol list, and finding an analysis method from the corresponding protocol for analysis when analyzing the specified data item in the data;
and (3) time scale processing: and performing time mark processing according to an X-axis type in the protocol, analyzing time mark data attached to the front of a data frame to be used as a data time mark when the time mark data is-1, counting the identified frames when the time mark data is 0, generating the data time mark by combining a period in the protocol, finding data with a corresponding serial number from the data frame when the time mark data is a natural number, and processing and generating the data time mark according to an analysis method in the protocol.
Further, the system also comprises a curve generation module which presents the data which is completed with the analysis in the form of a curve.
Has the beneficial effects that:
1. the method separates the protocol of the data from the analysis program, so that the data analysis method is irrelevant to the data protocol, the problem of data analysis after the data protocol is modified is solved, and the method can be quickly adapted to the change of the protocol.
2. The method realizes data analysis of time marks, non-time marks and time marks in the data by using various defining methods of the data time marks.
Drawings
FIG. 1 is a schematic diagram of the system of the present invention.
Detailed Description
The invention is described in detail below by way of example with reference to the accompanying drawings.
The invention provides a data processing system capable of rapidly adapting to protocol change, which comprises a main control module, an interface module, a protocol module, a data processing module, a protocol preprocessing module, a curve generating module and a storage module, as shown in figure 1. The main control module starts the whole system, loads each functional module and checks whether the system works normally or not; the interface module comprises a protocol list window and a data list window and responds to the master control, the message and the user instruction; the protocol preprocessing module preprocesses the data protocol, translates the data protocol into a set format and stores the data protocol as a protocol text in a txt file format, and the protocol module is used for processing the data protocol; the data processing module is used for identifying a data frame protocol, analyzing data to be analyzed into effective data items according to a protocol list according to the identified protocol, and arranging periodic data according to a time sequence; the curve generation module is used for drawing a curve for the analyzed data; the storage module is used for storing the analyzed data.
The key of the method is to preprocess the data protocol, translate the data protocol into a set format and store the data protocol as a protocol text in a txt file format.
The data protocol format is:
first row: frame header length
A second row: frame header content
Third row: frame length: the header timestamp is not included for the length containing the header, checksum.
Fourth row: an X axis: 0 is a time scale using the frame count, -1 is a pre-header time scale, and other natural numbers are time scales using intra-frame data,
the fifth element: time mark length, the first time mark is valid.
A sixth row: cycle, periodic write cycle, no periodic write 1.
Text content is in the following format
Sequence number name length scale sign bit definition
Sequence number: the data is a natural number starting from 1, can be consistent with an original data protocol, and is convenient to search.
The name is as follows: is the name of the data, should be consistent with the original data protocol, and is not repeatable.
Length: for the data length, when analyzing according to the bit, only the last valid data of the current byte is 1, and other bits are written with 0.
Scale bar: scale for data analysis.
Symbol: 0 is unsigned, 1 is signed, 2 is bit resolved, when the next field bit definition is valid.
Bit definition: the corresponding bits are resolved according to the bits, such as: 0x02, indicating that bit D2 is valid in this byte.
After the protocol text is formulated, the data processing program processes data according to the following method:
a protocol module: and (3) data protocol processing: reading a data protocol into a protocol list, and processing the protocol while reading: and calculating the position of the data item according to the length of the data item and the number information of the data item by using the position information of the data item which is not listed in the protocol, and recording the position information in the protocol.
The data processing module performs data analysis and time scale processing:
data analysis: the data processing module searches a corresponding protocol from the protocol list according to the frame header of the data to be analyzed, records the position of the protocol in the protocol list, and finds an analysis method from the corresponding protocol for analysis when analyzing the specified data item in the data.
And (3) time scale processing: and performing time mark processing according to an X-axis type in the protocol, analyzing time mark data attached in front of a data frame to be used as a data time mark when the time mark data is-1, counting the identified frame when the time mark data is 0, generating the data time mark by combining a period in the protocol, finding data with a corresponding sequence number from the data frame when the time mark data is a natural number, and processing according to an analysis method in the protocol to generate the data time mark.
According to the method, the data processing technology can carry out universal analysis on the periodic data, and only the protocol text is modified without modifying an analysis program when the data protocol is changed.
The method is successfully applied to system testing of a certain weapon system, and multiple tests performed on the weapon system show that the method can quickly respond to protocol modification without modifying a data processing program, can perform instant analysis on various data generated by the system, and provides a basis for test analysis, fault diagnosis and the like.
In summary, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (2)
1. A data processing system capable of rapidly adapting to protocol change is characterized by comprising a main control module, an interface module, a protocol preprocessing module, a data processing module and a storage module;
the main control module starts the whole system and loads each functional module;
the interface module displays a protocol list and a data list and responds to the main control module message and the user instruction;
the protocol preprocessing module preprocesses the data protocol into a preset format;
the protocol module reads in the preprocessed data protocol, calculates the position of the data item according to the length of the data item and the number information of the data item and records the position in the protocol, wherein the position information of the data item is not listed in the data protocol;
the data processing module identifies a data protocol, analyzes data to be analyzed into effective data items according to a data protocol list, and arranges periodic data according to a time sequence;
the storage module stores the analyzed data;
the preset format is as follows:
first row: the length of the frame header;
a second row: frame header content;
third row: the frame length comprises the lengths of the frame header and the check sum;
fourth row: an X-axis, where 0 denotes the use of frame count as a time stamp, -1 denotes the pre-header time stamp, and other natural numbers denote the use of intra-frame data as a time stamp;
the fifth element: a time scale length;
a sixth row: a period;
the data processing module specifically processes data as follows: finding a corresponding protocol from the protocol list according to a frame header of the data to be analyzed, recording the position of the protocol in the protocol list, and finding an analysis method from the corresponding protocol for analysis when analyzing the specified data item in the data;
and (3) time scale processing: and performing time mark processing according to an X-axis type in the protocol, analyzing time mark data attached in front of a data frame to be used as a data time mark when the time mark data is-1, counting the identified frame when the time mark data is 0, generating the data time mark by combining a period in the protocol, finding data with a corresponding sequence number from the data frame when the time mark data is a natural number, and processing according to an analysis method in the protocol to generate the data time mark.
2. A rapid adaptation protocol change data processing system as claimed in claim 1 further comprising a curve generation module that presents the parsed data in the form of a curve.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010076512.1A CN111294350B (en) | 2020-01-23 | 2020-01-23 | Data processing system capable of quickly adapting to protocol change |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010076512.1A CN111294350B (en) | 2020-01-23 | 2020-01-23 | Data processing system capable of quickly adapting to protocol change |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111294350A CN111294350A (en) | 2020-06-16 |
| CN111294350B true CN111294350B (en) | 2022-08-19 |
Family
ID=71024410
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010076512.1A Active CN111294350B (en) | 2020-01-23 | 2020-01-23 | Data processing system capable of quickly adapting to protocol change |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111294350B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049439A (en) * | 2015-08-06 | 2015-11-11 | 株洲南车时代电气股份有限公司 | Protocol configuration based data communication method for locomotive display equipment |
| CN105812365A (en) * | 2016-03-12 | 2016-07-27 | 武汉芯泰科技有限公司 | Programmable and reconfigurable frame processor |
| CN105912269A (en) * | 2016-04-11 | 2016-08-31 | 武汉芯泰科技有限公司 | Wireless configurable flash memory |
| CN108040040A (en) * | 2017-11-30 | 2018-05-15 | 北京锐安科技有限公司 | A kind of automation analysis method and device of application protocol message |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170249331A1 (en) * | 2016-02-25 | 2017-08-31 | Netapp, Inc. | Adapting to heterogeneous backend targets in a storage system |
-
2020
- 2020-01-23 CN CN202010076512.1A patent/CN111294350B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049439A (en) * | 2015-08-06 | 2015-11-11 | 株洲南车时代电气股份有限公司 | Protocol configuration based data communication method for locomotive display equipment |
| CN105812365A (en) * | 2016-03-12 | 2016-07-27 | 武汉芯泰科技有限公司 | Programmable and reconfigurable frame processor |
| CN105912269A (en) * | 2016-04-11 | 2016-08-31 | 武汉芯泰科技有限公司 | Wireless configurable flash memory |
| CN108040040A (en) * | 2017-11-30 | 2018-05-15 | 北京锐安科技有限公司 | A kind of automation analysis method and device of application protocol message |
Non-Patent Citations (1)
| Title |
|---|
| 基于元数据驱动的通信协议建模技术;高欣;《冶金自动化》;20150601;第352-355页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111294350A (en) | 2020-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109189684B (en) | Python-based automatic interface testing method | |
| US6964036B2 (en) | Descriptive variables while debugging | |
| US6058493A (en) | Logging and reproduction of automated test operations for computing systems | |
| US20110161132A1 (en) | Method and system for extracting process sequences | |
| CN110347598B (en) | Test script generation method and device, server and storage medium | |
| CN109032577B (en) | Data simulation method | |
| CN111782117B (en) | Interface display method and device, storage medium and electronic device | |
| US20080249978A1 (en) | Apparatus, and system for certificate of mailing | |
| CN111966587A (en) | Data acquisition method, device and equipment | |
| CN107506190A (en) | XML file amending method and device based on Spring frameworks | |
| CN115391322A (en) | Data checking method, device, equipment, storage medium and program product | |
| CN112732567A (en) | Mock data testing method and device based on ip, electronic equipment and storage medium | |
| CN100392642C (en) | Translation support system and program | |
| CN111294350B (en) | Data processing system capable of quickly adapting to protocol change | |
| CN110286882B (en) | Foreground system design and verification method based on model detection | |
| CN107886309A (en) | Document examines instrument automatically | |
| US8051048B2 (en) | System and method for automated transfer and evaluation of the quality of mass data of a technical process or a technical project | |
| CN112784545B (en) | Dynamic chart editing method of radioactive gamma nuclide report file | |
| CN114327614A (en) | Method and application for recording and analyzing data flow of reference model | |
| Dauphin et al. | Specification-driven performance monitoring of SDL/MSC-specified protocols | |
| CN111896030A (en) | Fiber-optic gyroscope data structure configuration method, data structure and analysis method | |
| Thomassen | Forensic analysis of unallocated space in WINDOWS registry hive files | |
| CN111767222A (en) | Data model verification method and device, electronic equipment and storage medium | |
| KR102523329B1 (en) | Method for visualizing performance improvement element and changing software code for power improvement | |
| CN118295864B (en) | Linux operating system hardware error identification method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |