JP5018000B2 - Data processing method - Google Patents

Description

  The present invention relates to a data processing system for storing digital data inputted externally in a database, searching the stored data, and processing / analyzing the stored data. In particular, the present invention searches binary format data stored in a database. The present invention relates to a data processing method for obtaining a file output converted from data to character string data.

  This type of data processing system, for example, samples the voltage and current waveforms of each part of the power system and power equipment, converts them into digital signals, and analyzes the digital signals to determine the operating status of the system and the operating status of the equipment. Analysis system required, test system that acquires test data from various measurement signals in test driving of vehicles, etc., video analysis system that extracts video parts that show intruders etc. from video taken by surveillance cameras, and fingerprint data This is implemented by fingerprint authentication systems that authenticate individuals.

  The data processing system as described above includes a data collection unit that converts a large amount of digital data or analog signal into digital data and collects it, and converts this digital data into a data format adapted to the data storage method of the database and stores it. Data conversion unit, a data processing unit that searches the data stored in the database and performs the desired processing, and an output unit that outputs the processing results as image data or file data. This is realized by using a software configuration (see, for example, Patent Document 1).

  Here, processing from data storage to file output to the database is as follows.

(1) Data storage processing When the collected data is stored in the database, the acquired data is stored in a binary format. In addition, in order to reduce the number of records stored in the database, data in a certain interval are collectively stored in one record (eg, from ON output of signal A to OFF output of signal A). For this reason, in each field of the database, data acquired from the time when the signal A is output to the time when the signal A is output is stored as a single binary data string.

(2) Data retention processing at the time of file output When binary data accumulated in the database is output to a file, the data obtained from the database is divided by the number of bytes of data before binary conversion, and then numerical conversion is performed. The data after the numerical conversion is processed, and further stored in the memory as an array for each character string converted data.

  FIG. 2 shows an example of a data retention processing mode, in which sampling data (binary format) obtained from a database is delimited by a specified byte (eg, 2 bytes) and converted into a numerical value (S1), and converted into a numerical value converted value. A physical quantity (actual voltage value, current value, etc.) is converted using a primary conversion formula y = ax + b having coefficients a and b (S2), and the converted value is converted into character string data and stored in memory as field data. (S3).

(3) File output processing After all the field data acquired from the database is converted to character string data and stored in the memory, the data acquired at the same time is retrieved, and the data of all fields is acquired and output to a file. .

FIG. 3 shows an example of the file output processing mode. The character string data at the same time is extracted from the array storing the sampling data of each field to be output (S4), and the data for one line is obtained after acquiring the data of all the fields. Is written to a file (S5), and these processes are repeated.
JP 2003-122767 A

  In the conventional data processing method from data search to file output to the database, if the number of data to be acquired from the database is large, the memory area is expanded at any time and the large-capacity memory area is used when the converted character string data is retained. It takes time to secure and release the memory area, and as a result, it takes time to output the file, which makes high-speed processing difficult.

  An object of the present invention is to provide a data processing method capable of shortening a processing time from a binary format data search stored in a database to a file output converted into a character string.

  In order to solve the above problems, the present invention holds the binary format data of each field acquired from the database without converting it into a character string in the data holding process, and converts the binary format data into the character string data in the file output process. The conversion method is characterized by the following method.

Detected binary format digital data for one field is converted into numerical data by the data converter, stored for each field, stored in a database, and written to file data as character string data when the stored data is output. A data processing method for obtaining
A data number storage memory area for acquiring and storing the number of data for one field converted into the numerical data , a delimiter byte number, a byte number / conversion coefficient memory area for storing a conversion coefficient for data processing, and the binary format A binary data memory storage area for storing the data is provided in the database, and the data is stored in each memory area provided by the data holding processing means.
When outputting the file data, the file output processing means specifies the data position obtained from the number of delimiter bytes and time, converts the numerical value with the size of the delimiter byte, and uses the conversion coefficient for the converted value The physical quantity is converted, the return result is converted into character string data, and written to the file output data.

  As described above, according to the present invention, in the data holding process, the binary format data of each field acquired from the database is held as it is without being converted into a character string, and the binary format data is converted into the character string data in the file output process. As a result, it is possible to shorten the time for securing and releasing the memory until the search data is converted to the character string, and as a result, the time until file output can be shortened.

  In addition, since the data search time is shortened, high-speed processing can be expected as the entire data processing system.

  FIG. 1 is a processing mode diagram from data storage to file output showing an embodiment of the present invention, and the processing will be individually described below.

  (1) The data storage process stores the acquired data in a binary format when the collected data is stored in the database, as in the conventional method. In addition, in order to reduce the number of records accumulated in the database, data in a certain interval are collectively stored in one record, and stored in each field of the database as a single binary data string.

(2) Data holding process at the time of file output The number of data is acquired from the binary format data of each field acquired from the database and stored in the memory area (S11). In addition, necessary data such as the number of delimiter bytes and data for data processing (primary conversion coefficients a and b in the example) are stored in the memory area (S12). Then, the binary data acquired from the database is stored as array data as it is (S13).

(3) File output processing In the sampling data (binary format) of each field to be output, the position of the data to be obtained is specified from the time and the number of delimiter bytes, and numerical conversion is performed with the size of delimiter bytes (2 bytes) (S14). A physical quantity conversion is performed on the numerically converted value using a primary conversion equation y = ax + b having conversion coefficients a and b (S15), and the conversion result is converted into character string data and added to the file output data (S16). ). When the data of all fields is acquired, the field data for one line is written in the file (S17).

  Therefore, according to this embodiment, in the data holding process, the binary format data of each field acquired from the database is held as it is without being converted into a character string, and the binary format data is converted into the character string data in the file output process. The time for securing and releasing the memory can be shortened in the data holding process.

The processing aspect figure from the data storage which shows embodiment of this invention to file output. FIG. 10 is a diagram showing a data retention process in a conventional data processing system. The file output processing figure in the conventional data processing system.

Claims (1)

Detected binary format digital data for one field is converted into numerical data by the data converter, stored for each field, stored in a database, and written to file data as character string data when the stored data is output. A data processing method for obtaining
A data number storage memory area for acquiring and storing the number of data for one field converted into the numerical data , a delimiter byte number, a byte number / conversion coefficient memory area for storing a conversion coefficient for data processing, and the binary format A binary data memory storage area for storing the data is provided in the database, and the data is stored in each memory area provided by the data holding processing means.
When outputting the file data, the file output processing means specifies the data position obtained from the number of delimiter bytes and time, converts the numerical value with the size of the delimiter byte, and uses the conversion coefficient for the converted value A data processing method characterized by performing physical quantity conversion, converting a return result into character string data, and writing it into the file output data.

Images