CN116257226A - Data verification method and device, electronic equipment and storage medium - Google Patents
Data verification method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116257226A CN116257226A CN202211725750.6A CN202211725750A CN116257226A CN 116257226 A CN116257226 A CN 116257226A CN 202211725750 A CN202211725750 A CN 202211725750A CN 116257226 A CN116257226 A CN 116257226A
- Authority
- CN
- China
- Prior art keywords
- verification
- data
- target
- script
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Stored Programmes (AREA)
Abstract
The application provides a data verification method, a data verification device, electronic equipment and a storage medium, which relate to the technical field of computers and are used for reducing the technical threshold of data verification of users and reducing the time cost spent by the users in data verification. The method comprises the following steps: displaying a verification configuration interface; the data verification method verification configuration interface is used for displaying a plurality of verification types and a plurality of verification parameters; determining a target checking type and a target checking parameter in response to the selection operation of a user on a data checking method checking configuration interface; determining a target verification script from a mapping relation comprising a plurality of verification types and a plurality of verification scripts of the data verification method according to the target verification type of the data verification method; substituting the target verification parameters of the data verification method into the target verification script of the data verification method so as to verify the service data.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data verification method, a data verification device, an electronic device, and a storage medium.
Background
Along with the development of digital economy, each industry does not pursue the scale of data volume, the requirement on data quality is higher and higher in the process of data application, and how to find and locate the data quality problem faster, more accurately and more intelligently, and develop corresponding treatment work is the key and core of the current enterprise-level data asset management.
The existing configuration data quality auditing rule requires a developer to write shell scripts, configure timing scheduling tasks, add preconditions and give entry. The method has higher requirement on script development capability of the user, so that the user spends more energy in carrying out data verification tasks and is not easy to realize.
Disclosure of Invention
The application provides a data verification method, a data verification device, electronic equipment and a storage medium, which are used for reducing the technical threshold of data verification by a user and reducing the time cost spent by the user for verifying data.
In order to achieve the above purpose, the present application adopts the following technical scheme:
in a first aspect, a data verification method is provided, where the data verification method includes: displaying a verification configuration interface; the data verification method verification configuration interface is used for displaying a plurality of verification types and a plurality of verification parameters; determining a target checking type and a target checking parameter in response to the selection operation of a user on a data checking method checking configuration interface; determining a target verification script from a mapping relation comprising a plurality of verification types and a plurality of verification scripts of the data verification method according to the target verification type of the data verification method; substituting the target verification parameters of the data verification method into the target verification script of the data verification method so as to verify the service data.
Optionally, substituting the target verification parameter of the data verification method into the target verification script of the data verification method to verify the service data includes: substituting the target verification parameters of the data verification method into the target verification script of the data verification method to obtain a current verification task; and executing the current verification task of the data verification method, and verifying the business data of the data verification method to obtain a verification result.
Optionally, the data verification method further includes: and generating abnormal reminding information under the condition that the data verification method verification result is abnormal, and sending the data verification method abnormal reminding information to a data verification method user.
Optionally, the data verification method further includes: and visualizing the current verification task of the data verification method at the front end to display the execution progress of the current verification task of the data verification method, and displaying the verification result of the data verification method in a page at the front end of the data verification method.
Optionally, the data verification method verification result includes a total data size of service data and a data size of abnormal data of the data verification method, and the data verification method further includes: evaluating the business data of the data verification method according to the total data quantity of the business data of the data verification method and the data quantity of the abnormal data of the data verification method, and generating a quality report; the data verification method quality report is used for reflecting the abnormality degree of the service data of the data verification method.
In a second aspect, a data verification device is provided, where the device includes a display unit, a determining unit, and a processing unit; the display unit is used for displaying the verification configuration interface; the verification configuration interface is used for displaying a plurality of verification types and a plurality of verification parameters; the determining unit is used for determining a target checking type and a target checking parameter in response to the selection operation of a user on the checking configuration interface; the determining unit is further used for determining a target verification script from the mapping relation comprising a plurality of verification types and a plurality of verification scripts according to the target verification type; and the processing unit is used for substituting the target verification parameters into the target verification script so as to verify the service data.
Optionally, the processing unit is specifically configured to: substituting the target verification parameters into the target verification script to obtain a current verification task; and executing the current verification task, and verifying the business data to obtain a verification result.
Optionally, the processing unit is further configured to: and generating abnormal reminding information and sending the abnormal reminding information to a user under the condition that the verification result is abnormal.
Optionally, the display unit is further configured to: and visualizing the current verification task at the front end to display the execution progress of the current verification task, and displaying the verification result in a page at the front end.
Optionally, the verification result includes a total data size of the service data and a data size of the abnormal data, and the processing unit is further configured to: evaluating the service data according to the total data volume of the service data and the data volume of the abnormal data to generate a quality report; the quality report is used to reflect the degree of anomaly of the traffic data.
In a third aspect, there is provided an electronic device comprising: a processor, a memory for storing instructions executable by the data verification method processor; wherein the data verification method processor is configured to execute instructions to implement the data verification method of the first aspect described above.
In a fourth aspect, there is provided a computer readable storage medium having instructions stored thereon that, when executed by a processor of an electronic device, enable the electronic device to perform the data verification method of the first aspect as described above.
The technical scheme provided by the embodiment of the application at least brings the following beneficial effects: the data verification device displays a verification configuration interface to present a plurality of verification types and a plurality of verification parameters to a user. And responding to the selection operation of the user on the data verification method verification configuration interface, and determining the target verification type and the target verification parameters by the data verification device. Further, the data verification device determines a target verification script from the mapping relation comprising a plurality of verification types and a plurality of verification scripts of the data verification method according to the target verification type of the data verification method, and substitutes target verification parameters of the data verification method into the target verification script of the data verification method so as to verify the service data. Compared with the prior art that a user is required to write the shell script during data verification, the method and the device have the advantages that the user can configure the relevant verification script for the user only by carrying out relevant selection in the verification configuration interface, the user is not required to write the shell script, the requirement of the user on the script development capability is reduced, and the time cost spent by the user for verifying the data is further saved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a data verification system according to an embodiment of the present application;
fig. 2 is a schematic block diagram of a data verification device according to an embodiment of the present application;
fig. 3 is a schematic flow chart of a data verification method according to an embodiment of the present application;
fig. 4 is a schematic diagram of internal data interaction of a data verification device according to an embodiment of the present application;
fig. 5 is a second flow chart of a data verification method according to an embodiment of the present application;
fig. 6 is a flowchart illustrating a data verification method according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
It should be noted that, in the embodiment of the present application, "english: of", "corresponding" and "corresponding" may sometimes be used in combination, and it should be noted that the meaning to be expressed is consistent when the distinction is not emphasized.
In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the terms "first", "second", and the like are used to distinguish the same item or similar items having substantially the same function and effect, and those skilled in the art will understand that the terms "first", "second", and the like are not limited in number and execution order.
Before explaining the embodiments of the present application in detail, some technical terms and related techniques related to the embodiments of the present application are described.
Computer shell layer (shell): in computer science, shell is commonly called shell (to distinguish from core), which refers to software (command interpreter, command parser) that "provides an operation interface for user". It is similar to command. Com and later cmd. Exe under DOS. It receives the user command and then invokes the corresponding application.
shell script (shell script): shell script is a program written by utilizing the functions of shells, the program uses a plain text file to write the grammar and instructions of some shells inside, and then uses the functions of regular expression, pipeline command, data stream redirection and the like to realize the target function.
The service data verification, also called service data auditing, starts to audit the quality of the data from the interface, can start to monitor the data from the source, stop the subsequent flow and give an alarm if a problem exists, can solve the problem found after report data comes out and reprocess the problem, thereby realizing the prequalification of the problem, finding the abnormality of the service data in advance, finding the abnormality of the service system, analyzing the positioning problem in time and controlling the risk, and effectively improving the service efficiency.
In the related art, a developer is required to write shell scripts, configure timing scheduling tasks, add preconditions and give parameters. The method has higher requirement on script development capability of the user, so that the user spends more energy in carrying out data verification tasks and is not easy to realize.
In view of this, the embodiment of the application provides a data verification method, which needs to make relevant selections in a verification configuration interface by a user, so that relevant verification scripts can be configured for the user, the user does not need to write shell scripts, the requirement of the user on script development capability is reduced, and the time cost spent by the user for verifying data is further saved.
The data verification method provided by the embodiment of the application is described in detail below with reference to the accompanying drawings.
The data verification method provided by the embodiment of the application can be applied to a data verification system, and fig. 1 shows a schematic structural diagram of the data verification system. As shown in fig. 1, the data verification system 10 includes a data verification device 11 and an electronic apparatus 12. The data verification device 11 and the electronic device 12 may be connected in a wired manner or may be connected in a wireless manner, which is not limited in the embodiment of the present application.
The data verification device 11 is configured to display a verification configuration interface, and determine a target verification type and a target verification parameter in response to a selection operation of a user on the verification configuration interface. The data verification device 11 is further configured to determine a target verification script from a mapping relationship including a plurality of verification types and a plurality of verification scripts according to the target verification type, and substitute the target verification parameter into the target verification script to verify the service data.
Optionally, as shown in fig. 2, the data checking device 11 includes an audit rule configuration module, an audit task module, an audit result display module, a quality report module, an audit storage management module, a quality evaluation report configuration module, and a problem work order configuration module.
The auditing task module is used for editing the execution plan of the existing auditing rules, checking the historical execution condition of the auditing task, manually starting the auditing task and other scenes. The structured query language (Structured Query Language, SQL) generated by the auditing task is reviewed in order for the developer to verify that the developed auditing task is correct. The auditing result module is used for displaying auditing results, and is convenient for auditing personnel to statistically analyze data quality. The operation and maintenance personnel can screen and check the historical auditing task through the account period, the table and the auditing task execution time of the data to carry out auditing analysis. The quality report module is used for analyzing and displaying macro analysis results of a large number of auditing tasks. The method comprises the steps of quality improvement, quality medium and quality difference proportion, task completion rate, task passing rate, auditing object number, auditing rule number, error number and alarm number. And the auditing storage management module is used for respectively carrying out storage management on the correct data and the error data. The data is checked regularly to judge correct data and error data, and data distribution is performed when the data is executed outside the library, so that the data list of correct and error targets of data distribution is generally stored in audit storage management. The quality report configuration is used for configuring report generation period, generating time and configuring rule scoring algorithm. The problem work order configuration module is used for managing the generated problems. The quality problem of the data is checked through rule checking, the data is converted into a form of a work order, and short messages or nails are notified to operation and maintenance personnel to wait for the operation and maintenance personnel to process and solve the problem.
The data verification device 11 may implement the data verification method of the embodiment of the present application in various electronic apparatuses 12. For example, the electronic device 12 may be a cell phone, tablet computer, wearable device, in-vehicle device, augmented reality (augmented reality, AR)/Virtual Reality (VR) device, notebook computer, ultra-mobile personal computer (mobile personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA), desktop computer, cloud server, etc., and the embodiments of the present application are not limited to a specific type of electronic device.
In different application scenarios, the data verification device 11 and the electronic device 12 may be independent devices, or may be integrated in the same device, which is not specifically limited in the embodiment of the present application.
When the data verification device 11 and the electronic device 12 are integrated in the same device, the data transmission mode between the data verification device 11 and the electronic device 12 is the data transmission mode between the internal modules of the device. In this case, the data transmission flow therebetween is the same as "in the case where the data verification apparatus 11 and the electronic device 12 are independent of each other".
In the following embodiments provided in the present embodiment, description will be given taking an example in which the data verification device 11 and the electronic apparatus 12 are provided independently of each other.
FIG. 3 is a flow chart illustrating a data verification method according to some example embodiments. In some embodiments, the data verification method described above may be applied to the data verification apparatus and the electronic device shown in fig. 1, and may also be applied to other similar devices.
As shown in fig. 3, the data verification method provided in the embodiment of the present application includes the following S201 to S204.
S201, the data verification device displays a verification configuration interface.
The check configuration interface is used for displaying a plurality of check types and a plurality of check parameters.
As a possible implementation manner, the data verification device displays a verification configuration interface for the user at the front end.
The data verification device automatically generates a verification configuration form of the audit SQL through the audit rule configuration module, and displays a verification configuration interface comprising the verification configuration form at the front end for a user to select or fill in the verification configuration form. The verification configuration form is provided with a plurality of verification types and a plurality of verification parameters for users to select or fill in.
As shown in table 1, a check type versus parameter configuration table is shown.
TABLE 1
It should be noted that, the filtering condition is to edit the sphere condition in the traditional SQL on the visual interface, including ports, variables, basic functions, operation functions, aggregation functions and analysis functions; for example, attr_name= 'developer' is configured in the interface.
S202, the data verification device responds to the selection operation of a user on a verification configuration interface to determine the target verification type and the target verification parameters.
As one possible implementation manner, the data verification device determines a verification type selected by a user from a plurality of verification types as a target verification type and determines a verification parameter selected by the user from a plurality of verification parameters as a target verification parameter in response to a selection operation of the user on the verification configuration interface. Further, the data verification device transmits the target verification type and the target verification parameter determined by the front end to the back end.
Illustratively, the data verification device communicates the target verification type and target verification parameters to the backend program via the ajax component and writes to a relational database service (Relational Database Service, RDS).
S203, the data verification device determines a target verification script from the mapping relation comprising a plurality of verification types and a plurality of verification scripts according to the target verification type.
It should be noted that, the mapping relationship is set in the data checking device by the operation and maintenance personnel in advance, and the plurality of checking scripts in the mapping relationship are all stored in the data checking device by the operation and maintenance personnel in advance.
As a possible implementation manner, the data verification device determines, after determining the target verification type, a target verification script corresponding to the target verification type from a mapping relationship including a plurality of verification types and a plurality of verification scripts.
It can be understood that, in the embodiment of the application, a traditional mode that a user needs to write shell script manually for verification during data auditing is converted into an auditing type and parameter front-end visual configuration mode by utilizing a data auditing low-code development mode, and a large number of auditing task configurations can be realized only through an auditing configuration module without writing codes.
S204, the data verification device substitutes the target verification parameters into the target verification script to verify the service data.
As a possible implementation manner, the data verification device substitutes the target verification parameter into the target verification script to obtain the current verification task. Further, the data checking device executes the current checking task and checks the service data to obtain a checking result.
Exemplary, as shown in fig. 4, a schematic diagram of data interaction between the front end and the back end during the verification process performed by the data verification device is shown. Wherein the front end (User Interface Design, UI) includes an Element UI component, an iview component, and a Jquery component. The back end comprises an upgrade service function, a system message function, a verification login function, a business processing function, a data management function and a comprehensive query function. The front end UI and the back end interact data through interaction layers (comprising vue components, vuex components and vue-router components). Accordingly, data generated therebetween may be stored to the database through the data layer. The entire process is supported by the infrastructure layer (including file servers, operating systems, middleware, etc.).
The technical scheme provided by the embodiment of the application at least brings the following beneficial effects: the data verification device displays a verification configuration interface to present a plurality of verification types and a plurality of verification parameters to a user. And responding to the selection operation of the user on the verification configuration interface, and determining the target verification type and the target verification parameter by the data verification device. Further, the data verification device determines a target verification script from the mapping relation comprising a plurality of verification types and a plurality of verification scripts according to the target verification types, and substitutes target verification parameters into the target verification script to verify the service data. Compared with the prior art that a user is required to write the shell script during data verification, the method and the device have the advantages that the user can configure the relevant verification script for the user only by carrying out relevant selection in the verification configuration interface, the user is not required to write the shell script, the requirement of the user on the script development capability is reduced, and the time cost spent by the user for verifying the data is further saved.
In one design, in order to facilitate the user to perceive the verification result, as shown in fig. 5, the data verification method provided in the embodiment of the present application further includes:
s301, the data verification device acquires a verification result.
Wherein the verification result comprises normal or abnormal.
As a possible implementation manner, the data verification device substitutes the target verification parameters into the target verification script to verify the service data, and generates a verification result. Further, the data verification device obtains the verification result.
S302, when the verification result is abnormal, the data verification device generates abnormal reminding information and sends the abnormal reminding information to a user.
As a possible implementation manner, the data verification device generates the abnormality reminding information when the verification result is abnormal. Further, the data verification device generates abnormal reminding information to the terminal of the user.
For example, the quality problem of the data is checked by checking the rules, the data is converted into a form of a work order, and a short message or a nail is notified to an operation and maintenance personnel to wait for the operation and maintenance personnel to process and solve the problem.
In some embodiments, when the data verification device substitutes the target verification parameters into the target verification script to verify the service data, the data verification device may further visualize the current verification task at the front end, so as to display the execution progress of the current verification task, and display the verification result in the page at the front end.
In one design, the verification result includes a total data size of the service data and a data size of the abnormal data, and in order to facilitate the user to perceive the verification result, as shown in fig. 6, the data verification method provided in the embodiment of the present application further includes:
s401, the data verification device acquires the total data volume of the service data and the data volume of the abnormal data.
As a possible implementation manner, the data verification device obtains the total data volume of the service data and the data volume of the abnormal data from the verification result.
And S402, the data verification device evaluates the service data according to the total data volume of the service data and the data volume of the abnormal data to generate a quality report.
Wherein the quality report is used to reflect the degree of anomaly of the traffic data.
As a possible implementation manner, the data verification device takes the ratio of the data volume of the abnormal data to the total data volume of the service data as the score of the service data and takes the score as the quality report.
The foregoing embodiments mainly describe the solutions provided in the embodiments of the present application from the perspective of the apparatus (device). It will be appreciated that, in order to implement the above-mentioned method, the apparatus or device includes hardware structures and/or software modules corresponding to each of the method flows, and these hardware structures and/or software modules corresponding to each of the method flows may constitute a material information determining apparatus. Those of skill in the art will readily appreciate that the algorithm steps of the examples described in connection with the embodiments disclosed herein may be implemented as hardware or a combination of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The embodiment of the application may divide the functional modules of the apparatus or the device according to the above method example, for example, the apparatus or the device may divide each functional module corresponding to each function, or may integrate two or more functions into one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.
Fig. 7 is a schematic diagram illustrating a structure of a data verification apparatus according to an exemplary embodiment. Referring to fig. 7, the data verification apparatus 50 provided in the embodiment of the present application includes a display unit 501, a determining unit 502, and a processing unit 503.
A display unit 501, configured to display a verification configuration interface; the verification configuration interface is used for displaying a plurality of verification types and a plurality of verification parameters; a determining unit 502, configured to determine a target verification type and a target verification parameter in response to a selection operation of a user on the verification configuration interface; a determining unit 502, configured to determine a target verification script from a mapping relationship including a plurality of verification types and a plurality of verification scripts according to the target verification type; and the processing unit 503 is used for substituting the target verification parameters into the target verification script to verify the service data.
Optionally, the processing unit 503 is specifically configured to: substituting the target verification parameters into the target verification script to obtain a current verification task; and executing the current verification task, and verifying the business data to obtain a verification result.
Optionally, the processing unit 503 is further configured to: and generating abnormal reminding information and sending the abnormal reminding information to a user under the condition that the verification result is abnormal.
Optionally, the display unit 501 is further configured to: and visualizing the current verification task at the front end to display the execution progress of the current verification task, and displaying the verification result in a page at the front end.
Optionally, the verification result includes a total data amount of the service data and a data amount of the abnormal data, and the processing unit 503 is further configured to: evaluating the service data according to the total data volume of the service data and the data volume of the abnormal data to generate a quality report; the quality report is used to reflect the degree of anomaly of the traffic data.
Fig. 8 is a schematic structural diagram of an electronic device provided in the present application. As shown in fig. 8, the electronic device 60 may include at least one processor 601 and a memory 602 for storing processor executable instructions, wherein the processor 601 is configured to execute the instructions in the memory 602 to implement the data verification method in the above-described embodiments.
In addition, the electronic device 60 may also include a communication bus 603 and at least one communication interface 604.
The processor 601 may be a processor (central processing units, CPU), micro-processing unit, ASIC, or one or more integrated circuits for controlling the execution of the programs of the present application.
The communication bus 603 may include a path to transfer information between the above components.
The communication interface 604 uses any transceiver-like device for communicating with other devices or communication networks, such as ethernet, radio access network (radio access network, RAN), wireless local area network (wireless local area networks, WLAN), etc.
The memory 602 may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (random access memory, RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), a compact disc read-only memory (compact disc read-only memory) or other optical disk storage, a compact disc storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be implemented separately and coupled to the processor 601 via a bus. The memory may also be integrated with the processor 601.
The memory 602 is used for storing instructions for executing the embodiments of the present application, and is controlled by the processor 601 to execute the instructions. The processor 601 is configured to execute instructions stored in the memory 602 to perform the functions of the methods of the present application.
As an example, in connection with fig. 7, the display unit 501, the determination unit 502, and the processing unit 503 in the data verification apparatus 50 realize the same functions as those of the processor 601 in fig. 8.
In a particular implementation, the processor 601 may include one or more CPUs, such as CPU0 and CPU1 of FIG. 8, as an embodiment.
In a particular implementation, as one embodiment, the electronic device 60 may include multiple processors, such as the processor 601 and the processor 607 in FIG. 8. Each of these processors may be a single-core (single-CPU) processor or may be a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).
In a particular implementation, as one embodiment, the electronic device 60 may also include an output device 605 and an input device 606. The output device 605 communicates with the processor 601 and may display information in a variety of ways. For example, the output device 605 may be a liquid crystal display (liquid crystal display, LCD), a light emitting diode (light emitting diode, LED) display device, a Cathode Ray Tube (CRT) display device, or a projector (projector), or the like. The input device 606 is in communication with the processor 601 and may accept input of user objects in a variety of ways. For example, the input device 606 may be a mouse, a keyboard, a touch screen device, a sensing device, or the like.
Those skilled in the art will appreciate that the structure shown in fig. 8 is not limiting of the electronic device 60 and may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.
In addition, the application also provides a computer readable storage medium, which when executed by a processor of an electronic device, enables the electronic device to perform the data verification method provided in the above embodiment.
In addition, the application also provides a computer program product comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the data verification method as provided in the above embodiments.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
Claims (12)
1. A method of data verification, the method comprising:
displaying a verification configuration interface; the check configuration interface is used for displaying a plurality of check types and a plurality of check parameters;
responding to the selection operation of a user on the verification configuration interface, and determining a target verification type and a target verification parameter;
determining a target verification script from a mapping relation comprising the plurality of verification types and the plurality of verification scripts according to the target verification type;
substituting the target verification parameters into the target verification script to verify the business data.
2. The data verification method according to claim 1, wherein substituting the target verification parameter into the target verification script to verify the service data comprises:
substituting the target verification parameters into the target verification script to obtain a current verification task;
and executing the current verification task, and verifying the business data to obtain a verification result.
3. The data verification method according to claim 2, wherein the method further comprises:
and generating abnormal reminding information and sending the abnormal reminding information to the user under the condition that the verification result is abnormal.
4. The data verification method according to claim 2, wherein the method further comprises:
and visualizing the current verification task at the front end to display the execution progress of the current verification task, and displaying the verification result in a page at the front end.
5. The data verification method according to claim 2, wherein the verification result includes a total data amount of the service data and a data amount of abnormal data, the method further comprising:
evaluating the service data according to the total data volume of the service data and the data volume of the abnormal data to generate a quality report; the quality report is used for reflecting the abnormality degree of the service data.
6. A data verification device, which is characterized by comprising a display unit, a determination unit and a processing unit;
the display unit is used for displaying a verification configuration interface; the check configuration interface is used for displaying a plurality of check types and a plurality of check parameters;
the determining unit is used for determining a target inspection type and a target inspection parameter in response to the selection operation of a user on the inspection configuration interface;
the determining unit is further configured to determine a target verification script from a mapping relationship including the plurality of verification types and the plurality of verification scripts according to the target verification type;
and the processing unit is used for substituting the target verification parameters into the target verification script so as to verify the service data.
7. The data verification device according to claim 6, wherein the processing unit is specifically configured to:
substituting the target verification parameters into the target verification script to obtain a current verification task;
and executing the current verification task, and verifying the business data to obtain a verification result.
8. The data verification device of claim 7, wherein the processing unit is further configured to:
and generating abnormal reminding information and sending the abnormal reminding information to the user under the condition that the verification result is abnormal.
9. The data verification device of claim 7, wherein the display unit is further configured to:
and visualizing the current verification task at the front end to display the execution progress of the current verification task, and displaying the verification result in a page at the front end.
10. The data verification device according to claim 7, wherein the verification result includes a total data amount of the service data and a data amount of the abnormal data, and the processing unit is further configured to:
evaluating the service data according to the total data volume of the service data and the data volume of the abnormal data to generate a quality report; the quality report is used for reflecting the abnormality degree of the service data.
11. An electronic device, comprising: a processor, a memory for storing instructions executable by the processor; wherein the processor is configured to execute instructions to implement the data verification method of any one of claims 1-5.
12. A computer readable storage medium having instructions stored thereon, which when executed by a processor of an electronic device, enable the electronic device to perform the data verification method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211725750.6A CN116257226A (en) | 2022-12-30 | 2022-12-30 | Data verification method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211725750.6A CN116257226A (en) | 2022-12-30 | 2022-12-30 | Data verification method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116257226A true CN116257226A (en) | 2023-06-13 |
Family
ID=86685514
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211725750.6A Pending CN116257226A (en) | 2022-12-30 | 2022-12-30 | Data verification method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116257226A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117390700A (en) * | 2023-11-23 | 2024-01-12 | 南方电网调峰调频发电有限公司检修试验分公司 | Calibration data determination method, device and computer equipment for relay protection system |
-
2022
- 2022-12-30 CN CN202211725750.6A patent/CN116257226A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117390700A (en) * | 2023-11-23 | 2024-01-12 | 南方电网调峰调频发电有限公司检修试验分公司 | Calibration data determination method, device and computer equipment for relay protection system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20120272220A1 (en) | System and method for display of software quality | |
| JP2023086678A (en) | Method and apparatus for generating and applying deep learning model based on deep learning framework | |
| CN116257226A (en) | Data verification method and device, electronic equipment and storage medium | |
| CN107679423A (en) | Partition integrity inspection method and device | |
| CN114253852A (en) | Automatic testing method, device, equipment and medium | |
| CN113360365A (en) | Flow testing method and flow testing system | |
| CN113535568B (en) | Verification method, device, equipment and medium for application deployment version | |
| CN113568838B (en) | Test data generation method, device, equipment, storage medium and program product | |
| CN111914002B (en) | Machine room resource information processing method and device and electronic equipment | |
| CN112766552B (en) | Method and device for optimizing Internet architecture and electronic equipment | |
| CN115600038A (en) | Page rendering method, device, equipment and medium | |
| CN115801873A (en) | Service publishing method, system, electronic device and storage medium | |
| CN110399296B (en) | Method, system and medium for testing interactive interface between client and server | |
| CN115269431A (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN114218313A (en) | Data management method, device, electronic equipment, storage medium and product | |
| CN114691527A (en) | Unit test case generation method, apparatus, device, medium, and program product | |
| CN113391903A (en) | Method and device for establishing schedulability model, electronic equipment and storage medium | |
| CN114003497A (en) | Method, device and equipment for testing service system and storage medium | |
| CN114218100A (en) | Business model testing method, device, system, equipment, medium and program product | |
| CN117193990B (en) | Scheduling management method, device, equipment and storage medium of http interface | |
| CN116643993A (en) | Data streaming process debugging method, device, equipment and medium | |
| CN114528224A (en) | Persistent integration method, apparatus, electronic device, storage medium, and program product | |
| CN114461367A (en) | Batch execution method, apparatus, electronic device, medium, and computer program product | |
| CN114489774A (en) | Web application packaging method, device, device and storage medium | |
| CN114676786A (en) | Marking template generation method, data marking method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |