CN118427431A - Data processing method, apparatus, computer device, storage medium, and program product - Google Patents
Data processing method, apparatus, computer device, storage medium, and program product Download PDFInfo
- Publication number
- CN118427431A CN118427431A CN202410352095.7A CN202410352095A CN118427431A CN 118427431 A CN118427431 A CN 118427431A CN 202410352095 A CN202410352095 A CN 202410352095A CN 118427431 A CN118427431 A CN 118427431A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- platform
- user
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 37
- 230000008520 organization Effects 0.000 claims abstract description 49
- 238000000034 method Methods 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 24
- 230000015654 memory Effects 0.000 claims description 32
- 230000008569 process Effects 0.000 claims description 19
- 230000004044 response Effects 0.000 claims description 10
- 238000012790 confirmation Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013523 data management Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9538—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Bioethics (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Storage Device Security (AREA)
Abstract
The invention relates to the technical field of data processing, and discloses a data processing method, a data processing device, computer equipment, a storage medium and a program product. The method comprises the following steps: acquiring application data, organization resources of a platform and user rights; transferring the application data stream to an associated data engine, and splicing the application data, the organization resources of the platform and the user permission based on a preset matching rule to obtain target data; and responding to the configuration operation of the target object, and displaying the target data based on the user permission. By splicing the application data, the organization resources of the platform and the user rights, the invention stores the associated application data, the organization resources of the platform and the user rights together, thereby avoiding special storage and event scheduling services and improving the association degree of the platform and the application.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data processing method, apparatus, computer device, storage medium, and program product.
Background
Performing operations such as data query, data analysis, data processing and the like in a database; however, the user data has larger magnitude and relates to multi-dimensional data, statistical screening is needed in the database in the process of forming the user portrait, the data is frequently screened from the database with larger magnitude, and the response is slower.
However, the conventional big data platform cannot perform data related processing for the application, and needs special storage and event scheduling service, so that the association degree between the used process and the application is not high.
Disclosure of Invention
In view of this, the present invention provides a data processing method, apparatus, computer device, storage medium and program product, so as to solve the problem that the association degree between the process and the application is not high because the conventional large data platform cannot process the data for the application, and special storage and event scheduling services are required.
In a first aspect, the present invention provides a data processing method, the method comprising: acquiring application data, organization resources of a platform and user rights; transferring the application data stream to an associated data engine, and splicing the application data, the organization resources of the platform and the user permission based on a preset matching rule to obtain target data; and responding to the configuration operation of the target object, and displaying the target data based on the user permission.
According to the data processing method provided by the embodiment, the application data, the organization resources of the platform and the user permission are spliced, so that the associated application data, the organization resources of the platform and the user permission are stored together, special storage and event scheduling services are not needed, and the association degree of the platform and the application is improved.
In an optional embodiment, splicing the application data, the organization resources of the platform and the user rights based on a preset matching rule to obtain target data includes: acquiring a first data tag of application data, a second data tag of organization resources of a platform and a third data tag of user permission; detecting whether the first data tag, the second data tag and the third data tag are identical; and if the first data tag, the second data tag and the third data tag are the same, matching the application data, the organization resources of the platform and the user permission according to key conditions to obtain a plurality of groups of target data.
According to the data processing method provided by the embodiment, the data management and classification process is simplified through the data tag. Tags are short descriptions of data attributes that can quickly identify the content and purpose of the data. Wherein the tags provide an abstract representation of the data so that data of different sources, formats or structures can be managed and processed in a unified manner.
In addition, by comparing the data labels, the data meeting the specific conditions can be rapidly screened out, and unnecessary data processing time is reduced.
In addition, by setting the corresponding data tag for the user rights, it can be ensured that only authorized users can access sensitive or confidential data.
In an alternative embodiment, in response to a configuration operation of the target object, presenting the target data based on the user rights includes: generating a threshold value of target data in response to a configuration operation of the target object; if the target data exceeds the threshold, detecting the times that the target data exceeds the threshold; and if the times of the target data exceeding the threshold value exceeds the preset times, displaying the target data based on the user permission.
According to the data processing method, the threshold value is generated through configuration operation, so that the system can flexibly adjust the standard of data display according to different service scenes and requirements, target data can be effectively controlled, only data meeting specific conditions can be displayed, unnecessary data display is reduced, and the effectiveness and the relevance of the data are improved.
In addition, when the target data exceeds the threshold value, the system can detect the situation, count the times exceeding the threshold value, be used for early warning and monitoring, help users to find abnormal or potential problems in time, take corresponding measures, and display the target data by combining the user permission, so that only authorized users can access sensitive or important data. The security and integrity of the data can be protected against unauthorized access and leakage.
In an alternative embodiment, the method further comprises: performing portrait calculation on the target data based on the data engine to obtain a target portrait; detecting whether the target image is identical to the initial image; and if the target portrait is different from the initial portrait, updating a preset model based on the target portrait to obtain a target model.
According to the data processing method provided by the embodiment, the content of each target image is determined, whether the content of the target image is different from the content of the initial image or not is detected, and if the difference exists, the preset model is updated through the different content, so that the suitability of the target model is ensured.
In an alternative embodiment, the method further comprises: storing structured data of the target data; and storing the target data stored by the structured data into different storage blocks according to the types.
According to the data processing method, the target data is stored in the structured data mode, and the data is stored in different storage blocks according to the type, so that the organization, the query efficiency, the management convenience and the safety of the data can be improved, concurrent access, data migration and expansion are supported, and data integration and analysis are simplified.
In an alternative embodiment, the method further comprises: and sending the target model to the client, and responding to the confirmation operation of the target object to process the target model.
According to the data processing method provided by the embodiment, the target object can process the target model in a mode of sending the determined target model to the client, so that the output result of the target model can meet the requirement of the target object, and the suitability of project application is greatly improved.
In a second aspect, the present invention provides a data processing apparatus, the apparatus comprising: the acquisition module is used for acquiring application data, organization resources of the platform and user rights; the association splicing module is used for transferring the application data stream to an associated data engine, and splicing the application data, the organization resources of the platform and the user permission based on a preset matching rule to obtain target data; and the display module is used for responding to the configuration operation of the target object and displaying the target data based on the user permission.
In a third aspect, the present invention provides a computer device comprising: the data processing system comprises a memory and a processor, wherein the memory and the processor are in communication connection, the memory stores computer instructions, and the processor executes the computer instructions, so that the data processing method of the first aspect or any corresponding implementation mode of the first aspect is executed.
In a fourth aspect, the present invention provides a computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the data processing method of the first aspect or any of its corresponding embodiments.
In a fifth aspect, the present invention provides a computer program product comprising computer instructions for causing a computer to perform the data processing method of the first aspect or any of its corresponding embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow diagram of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another data processing method according to an embodiment of the present invention;
FIG. 3 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
Fig. 4 is a schematic diagram of a hardware structure of a computer device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Based on the related technology, operations such as data query, data analysis, data processing and the like are performed in a database; however, the user data has larger magnitude and relates to multi-dimensional data, statistical screening is needed in the database in the process of forming the user portrait, the data is frequently screened from the database with larger magnitude, and the response is slower.
However, the conventional big data platform cannot perform data related processing for the application, and needs special storage and event scheduling service, so that the association degree between the used process and the application is not high.
Based on the above, according to the data processing method provided by the embodiment, the application data, the organization resources of the platform and the user rights are spliced, so that the associated application data, the organization resources of the platform and the user rights are stored together, and therefore special storage and event scheduling services are not needed, and the association degree of the platform and the application is improved.
According to an embodiment of the present invention, there is provided a data processing method embodiment, it being noted that the steps shown in the flowcharts of the figures may be performed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that herein.
In this embodiment, a data processing method is provided, which may be used in a computer device, such as a computer, a server, etc., and fig. 1 is a schematic flow chart of the data processing method according to an embodiment of the present invention, as shown in fig. 1, the flow chart includes the following steps:
Step S101, obtaining application data, organization resources of a platform and user rights.
The application data may be used to characterize applications applicable to the service data. The organization resources of the platform may be used to characterize the resource allocation content of the respective applications. Among other things, organizing resources may include: CPU operations, memory, network resources, etc., are not specifically limited herein.
The user rights may be used to characterize the usage rights of various organizations within the platform. The user authority may be a level 1 authority, a level 2 authority, or the like, and may be assigned by an administrator, which is not particularly limited herein.
Step S102, the application data stream is transferred to an associated data engine, and the application data, the organization resources of the platform and the user permission are spliced based on a preset matching rule, so that target data is obtained.
The preset matching rules may be used to characterize the manner in which the application data, the organization resources of the platform, and the user permissions are spliced. The preset matching rule may be a splicing or other modes by applying the data, the organization resources of the platform and the labels of the user rights, which are not limited herein. The target data may be used to characterize the total data obtained by stitching the application data, the organization resources of the platform, and the user rights.
The data engine (DATA ENGINE) is a core service for storing, processing, and protecting data. It uses specific techniques, such as database engines, to control access rights and process transactions quickly, thus meeting the requirements of most applications within an enterprise that need to process large amounts of data. The database engine is a core service that the database uses to store, process, and protect data. Different database engines have their own features such as storage mechanism, indexing skills, handling of primary keys, granularity of locks, etc. Selecting the appropriate database engine for the project characteristics can improve the storage performance of the server side. Specifically, the application data stream is diverted to a location corresponding to the associated data engine.
Step S103, responding to the configuration operation of the target object, and displaying the target data based on the user permission.
The target object may be a user operating the computer device. The configuration operation may be an operation generated by a user through a mouse click, a keyboard selection, or a touch screen. When the user sends out a triggering operation to the computer equipment, the computer equipment can respond to the configuration operation of the user and display the target data based on the user permission correspondingly.
According to the data processing method provided by the embodiment, the application data, the organization resources of the platform and the user permission are spliced, so that the associated application data, the organization resources of the platform and the user permission are stored together, special storage and event scheduling services are not needed, and the association degree of the platform and the application is improved.
In this embodiment, a data processing method is provided, which may be used in a computer device, such as a computer, a server, etc., and fig. 2 is a schematic flow chart of the data processing method according to an embodiment of the present invention, as shown in fig. 2, where the flow chart includes the following steps:
Step S201, obtaining application data, organization resources of a platform and user rights. Please refer to step S101 in the embodiment shown in fig. 1 in detail, which is not described herein.
Step S202, transferring the application data stream to an associated data engine, and splicing the application data, the organization resources of the platform and the user permission based on a preset matching rule to obtain target data.
Specifically, the step S202 includes:
in step S2021, a first data tag of the application data, a second data tag of the organization resource of the platform, and a third data tag of the user authority are acquired.
The data tag is a data form for describing the characteristics of the service entity, the analysis angle of the service entity can be effectively expanded through the tag, and the data can be screened and analyzed through simple operation on different tags. In the field of data science and machine learning, data tags are additional information associated with data points that can provide more context and meaning about the data points, making them easier to understand and use. Meanwhile, the data label can be used for optimizing the quality and the readability of the data points and improving the value and the utilization rate of the data. Specifically, there is a data tag for each type of data. The method comprises the steps of applying a first data tag of data, a second data tag of organization resources of a platform and a third data tag of user permission.
In step S2022, it is detected whether the first data tag, the second data tag, and the third data tag are identical.
After the computer device obtains the first data tag of the application data, the second data tag of the organization resource of the platform and the third data tag of the user authority, whether the first data tag of the application data, the second data tag of the organization resource of the platform and the third data tag of the user authority are identical or not needs to be detected.
In step S2023, if the first data tag, the second data tag, and the third data tag are the same, the application data, the organization resources of the platform, and the user authority are matched according to the key conditions, so as to obtain multiple sets of target data.
When the first data tag of the application data, the second data tag of the organization resource of the platform and the third data tag of the user permission are all the same, the application data, the organization resource of the platform and the user permission can be spliced together to obtain total data (target data), so that the application data, the organization resource of the platform and the user permission can be accurately and conveniently found when the search is performed subsequently.
Preferably, the APM service establishes a corresponding search request according to the state of the application, so as to determine application data of the corresponding application, organization resources of the platform and user rights, and associate target data using a model in the platform.
In step S203, in response to the configuration operation of the target object, the target data is displayed based on the user rights. Please refer to step S103 in the embodiment shown in fig. 1 in detail, which is not described herein.
According to the data processing method provided by the embodiment, the data management and classification process is simplified through the data tag. Tags are short descriptions of data attributes that can quickly identify the content and purpose of the data. Wherein the tags provide an abstract representation of the data so that data of different sources, formats or structures can be managed and processed in a unified manner.
In addition, by comparing the data labels, the data meeting the specific conditions can be rapidly screened out, and unnecessary data processing time is reduced.
In addition, by setting the corresponding data tag for the user rights, it can be ensured that only authorized users can access sensitive or confidential data.
In an optional embodiment, in response to the configuration operation of the target object in step S203, the displaying the target data based on the user rights includes:
and a step a1 of generating a threshold value of the target data in response to the configuration operation of the target object.
The configuration operation may be an operation generated by a user through a mouse click, a keyboard selection, or a touch screen. When the user sends out a trigger operation to the computer device, the computer device can correspondingly respond to the configuration operation of the user to generate a threshold value of the target data. The threshold may be an outlier, a threshold, or the like, and is not particularly limited herein.
And a2, detecting the times that the target data exceeds the threshold value if the target data exceeds the threshold value.
After the computer device obtains the threshold, it may be detected whether the target data exceeds the threshold, that is, whether the target data is abnormal, and if the target data exceeds the threshold, it may be detected the number of times the target data exceeds the threshold, that is, the number of times the target data reaches the abnormal. The number of times may be 1 time, 5 times, etc., and is not particularly limited herein.
And a3, if the times of the target data exceeding the threshold exceeds the preset times, displaying the target data based on the user permission.
The preset number of times may be used to characterize the number of times an application fails. The preset number of times may be M times, N times, or the like, and may be set autonomously by a user, autonomously by an administrator, or the like, and is not particularly limited herein. If the number of times that the target data exceeds the threshold exceeds the preset number of times, the fault of the application is represented, the target data is required to be displayed to the front end, and threshold warning is carried out. The mode of performing the threshold warning may be by text prompting, or may be text flashing on a display page, and the like, and is not particularly limited herein. Assume that on an e-commerce platform, there is a key performance indicator of "order processing time". To ensure smooth operation of the user experience and business, the platform sets a threshold value: order processing time must not exceed 30 seconds. If the processing time exceeds this threshold, this means that there may be a system bottleneck or performance problem that needs to be handled in time
According to the data processing method, the threshold value is generated through configuration operation, so that the system can flexibly adjust the standard of data display according to different service scenes and requirements, target data can be effectively controlled, only data meeting specific conditions can be displayed, unnecessary data display is reduced, and the effectiveness and the relevance of the data are improved.
In addition, when the target data exceeds the threshold value, the system can detect the situation, count the times exceeding the threshold value, be used for early warning and monitoring, help users to find abnormal or potential problems in time, take corresponding measures, and display the target data by combining the user permission, so that only authorized users can access sensitive or important data. The security and integrity of the data can be protected against unauthorized access and leakage.
In an alternative embodiment, the method further comprises:
and b1, performing portrait calculation on the target data based on the data engine to obtain a target portrait.
"User portrayal" (User Persona) is a method in the areas of product design, marketing, user experience research, etc., for representing and understanding a particular user population. User portraits are fictional characters constructed based on real data and typically contain some key information such as demographics, hobbies, behavioral characteristics, demands, pain points, etc. Specifically, after the target data is determined, the target data may be subjected to portrait calculation by the data engine, that is, by the behavior of the user, to determine the corresponding key information.
Specifically, it may be understood that the data engine performs data cleaning, conversion, aggregation, etc. on the target data to provide a required data format and structure for portrait calculation, and then performs operations such as aggregation, classification, analysis, etc. on the target data to extract key information about the user, such as interests, behaviors, requirements, etc., and convert the key information into the target portrait.
Step b2, detecting whether the target image is identical to the initial image.
The initial portrait may be an initial portrait of the user or a portrait of the user after a certain update. The certain time may be any time before the current update. Specifically, after the target image is determined, it may be detected whether the target image is identical to the initial image. Wherein, the key characteristics, parameters or attributes of the two images can be compared.
And b3, if the target image is different from the initial image, updating a preset model based on the target image to obtain a target model.
If the target portrait is different from the initial portrait, the target portrait is characterized to be missing or to be added with key features, and if the target portrait is added with the key features, the added key features are required to be input into a preset model for training, namely the preset model is updated, so that the target model is obtained.
According to the data processing method provided by the embodiment, the content of each target image is determined, whether the content of the target image is different from the content of the initial image or not is detected, and if the difference exists, the preset model is updated through the different content, so that the suitability of the target model is ensured.
In an alternative embodiment, the method further comprises:
and c1, carrying out structured data storage on the target data.
Prior to storing the target data in a structured format, data cleansing is required. In particular, it may be to delete duplicate data, fill in missing values, correct errors, etc., to ensure the integrity and accuracy of the data.
The data structure, including table structure, fields, data types, etc., is then defined based on the characteristics and requirements of the data. For example, one or more tables are created in a database and each table's columns and column data types are defined. The raw data is mapped into a defined data structure. This may involve operations such as data conversion, encoding or formatting to ensure that the data is properly stored in the structured format. The mapped data is stored in a structured storage system, such as a relational database (e.g., mySQL, oracle, etc.) or a non-relational database (e.g., mongoDB, cassandra, etc.).
And c2, storing the target data stored by the structured data into different storage blocks according to the types.
The data is classified according to the type and characteristics of the data. For example, data is classified into different categories according to the type of data (e.g., text, image, audio, etc.) or business logic (e.g., user information, order data, product information, etc.). One or more memory blocks are allocated for each data class. A memory block may be a physical memory unit (e.g., a disk partition, database table, etc.) or a logical memory unit (e.g., a collection in a database, partition, etc.). Each category of data is stored in a corresponding memory block. This may be accomplished through database tables, collections, or other storage structures. By storing data by type, the efficiency of data retrieval and processing can be improved, while also facilitating management and maintenance of data.
According to the data processing method, the target data is stored in the structured data mode, and the data is stored in different storage blocks according to the type, so that the organization, the query efficiency, the management convenience and the safety of the data can be improved, concurrent access, data migration and expansion are supported, and data integration and analysis are simplified.
In an alternative embodiment, the method further comprises: and sending the target model to the client, and responding to the confirmation operation of the target object to process the target model.
The confirmation operation may be an operation generated by the user through a mouse click, a keyboard selection, or a touch screen. When the user sends a confirmation operation to the computer device, the computer device can respond to the confirmation operation of the user to process the target model correspondingly. For example: the requirement of the user is that the display time of the current webpage display content is 3 seconds, but the display time of the current webpage display content is 2 seconds aiming at the target model, so that the requirement of the user is not met, and the user can modify the target model so that the display time of the current webpage display content is 3 seconds.
According to the data processing method provided by the embodiment, the application data, the organization resources of the platform and the user permission are spliced, so that the associated application data, the organization resources of the platform and the user permission are stored together, special storage and event scheduling services are not needed, and the association degree of the platform and the application is improved.
In this embodiment, a data processing device is further provided, and the device is used to implement the foregoing embodiments and preferred embodiments, and will not be described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
The present embodiment provides a data processing apparatus, as shown in fig. 3, including:
an acquiring module 301, configured to acquire application data, an organization resource of a platform, and a user authority; the association splicing module 302 is configured to transfer the application data stream to an associated data engine, and splice the application data, the organization resources of the platform and the user rights based on a preset matching rule to obtain target data; and the display module 303 is used for displaying the target data based on the user permission in response to the configuration operation of the target object.
In some alternative embodiments, the association splice module 302 includes: the first acquisition unit is used for acquiring a first data tag of application data, a second data tag of organization resources of the platform and a third data tag of user permission; the first detection unit is used for detecting whether the first data tag, the second data tag and the third data tag are identical; and the first matching unit is used for matching the application data, the organization resources of the platform and the user permission according to key conditions if the first data tag, the second data tag and the third data tag are the same, so as to obtain multiple groups of target data.
In some alternative embodiments, the presentation module 303 comprises: the first generation unit is used for responding to the configuration operation of the target object and generating a threshold value of the target data; the second detection unit is used for detecting the times that the target data exceeds the threshold value if the target data exceeds the threshold value; and the display unit is used for displaying the target data based on the user permission if the times of the target data exceeding the threshold exceeds the preset times.
In some alternative embodiments, the apparatus further comprises: the computing module is used for carrying out portrait computation on the target data based on the data engine to obtain a target portrait; a first detection module for detecting whether the target image is the same as the initial image; and the updating module is used for updating the preset model based on the target image to obtain a target model if the target image is different from the initial image.
In some alternative embodiments, the apparatus further comprises: the first storage module is used for carrying out structured data storage on target data; and the second storage module is used for storing the target data after the structured data is stored into different storage blocks according to the types.
In some alternative embodiments, the apparatus further comprises: and the processing module is used for sending the target model to the client and responding to the confirmation operation of the target object to process the target model.
Further functional descriptions of the above respective modules and units are the same as those of the above corresponding embodiments, and are not repeated here.
The data processing apparatus in this embodiment is presented in the form of functional units, where a functional unit refers to an ASIC (Application SPECIFIC INTEGRATED Circuit) Circuit, a processor and a memory that execute one or more software or firmware programs, and/or other devices that can provide the above-described functions.
The embodiment of the invention also provides computer equipment, which is provided with the data processing device shown in the figure 3.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a computer device according to an alternative embodiment of the present invention, as shown in fig. 4, the computer device includes: one or more processors 10, memory 20, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are communicatively coupled to each other using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the computer device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In some alternative embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple computer devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 10 is illustrated in fig. 4.
The processor 10 may be a central processor, a network processor, or a combination thereof. The processor 10 may further include a hardware chip, among others. The hardware chip may be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general-purpose array logic, or any combination thereof.
Wherein the memory 20 stores instructions executable by the at least one processor 10 to cause the at least one processor 10 to perform a method for implementing the embodiments described above.
The memory 20 may include a storage program area that may store an operating system, at least one application program required for functions, and a storage data area; the storage data area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, memory 20 may optionally include memory located remotely from processor 10, which may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk, or solid state disk; the memory 20 may also comprise a combination of the above types of memories.
The computer device also includes a communication interface 30 for the computer device to communicate with other devices or communication networks.
The embodiments of the present invention also provide a computer readable storage medium, and the method according to the embodiments of the present invention described above may be implemented in hardware, firmware, or as a computer code which may be recorded on a storage medium, or as original stored in a remote storage medium or a non-transitory machine readable storage medium downloaded through a network and to be stored in a local storage medium, so that the method described herein may be stored on such software process on a storage medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, a solid state disk or the like; further, the storage medium may also comprise a combination of memories of the kind described above. It will be appreciated that a computer, processor, microprocessor controller or programmable hardware includes a storage element that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the methods illustrated by the above embodiments.
Portions of the present invention may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or aspects in accordance with the present invention by way of operation of the computer. Those skilled in the art will appreciate that the form of computer program instructions present in a computer readable medium includes, but is not limited to, source files, executable files, installation package files, etc., and accordingly, the manner in which the computer program instructions are executed by a computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Herein, a computer-readable medium may be any available computer-readable storage medium or communication medium that can be accessed by a computer.
Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope of the invention as defined by the appended claims.
Claims (10)
1. A method of data processing, the method comprising:
Acquiring application data, organization resources of a platform and user rights;
Transferring the application data stream to an associated data engine, and splicing the application data, the organization resources of the platform and the user permission based on a preset matching rule to obtain target data;
And responding to the configuration operation of the target object, and displaying the target data based on the user permission.
2. The data processing method according to claim 1, wherein the splicing the application data, the organization resources of the platform, and the user rights based on the preset matching rule to obtain the target data includes:
acquiring a first data tag of the application data, a second data tag of the organization resource of the platform and a third data tag of the user permission;
Detecting whether the first data tag, the second data tag and the third data tag are identical;
And if the first data tag, the second data tag and the third data tag are the same, matching the application data, the organization resources of the platform and the user permission according to key conditions to obtain a plurality of groups of target data.
3. The data processing method according to claim 1, wherein the presenting the target data based on the user authority in response to the configuration operation of the target object includes:
Generating a threshold value of the target data in response to a configuration operation of the target object;
If the target data exceeds the threshold value, detecting the times that the target data exceeds the threshold value;
And if the times of the target data exceeding the threshold exceeds the preset times, displaying the target data based on the user permission.
4. The data processing method of claim 1, wherein the method further comprises:
performing portrait calculation on the target data based on the data engine to obtain a target portrait;
detecting whether the target image is identical to the initial image;
and if the target image is different from the initial image, updating a preset model based on the target image to obtain a target model.
5. The data processing method of claim 1, wherein the method further comprises:
storing structured data of the target data;
And storing the target data stored by the structured data into different storage blocks according to the types.
6. The data processing method of claim 4, wherein the method further comprises:
And sending the target model to a client, and responding to the confirmation operation of the target object to process the target model.
7. A data processing apparatus, the apparatus comprising:
the acquisition module is used for acquiring application data, organization resources of the platform and user rights;
The association splicing module is used for transferring the application data stream to an associated data engine, and splicing the application data, the organization resources of the platform and the user permission based on a preset matching rule to obtain target data;
And the display module is used for responding to the configuration operation of the target object and displaying the target data based on the user permission.
8. A computer device, comprising:
A memory and a processor in communication with each other, the memory having stored therein computer instructions, the processor executing the computer instructions to perform the data processing method of any of claims 1 to 6.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon computer instructions for causing a computer to execute the data processing method according to any one of claims 1 to 6.
10. A computer program product comprising computer instructions for causing a computer to perform the data processing method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410352095.7A CN118427431A (en) | 2024-03-26 | 2024-03-26 | Data processing method, apparatus, computer device, storage medium, and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410352095.7A CN118427431A (en) | 2024-03-26 | 2024-03-26 | Data processing method, apparatus, computer device, storage medium, and program product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118427431A true CN118427431A (en) | 2024-08-02 |
Family
ID=92335466
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410352095.7A Pending CN118427431A (en) | 2024-03-26 | 2024-03-26 | Data processing method, apparatus, computer device, storage medium, and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118427431A (en) |
-
2024
- 2024-03-26 CN CN202410352095.7A patent/CN118427431A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107766568B (en) | Efficient query processing using histograms in columnar databases | |
| US20200228392A1 (en) | Method and system for clustering event messages and manage event-message clusters | |
| US9081978B1 (en) | Storing tokenized information in untrusted environments | |
| US11301578B2 (en) | Protecting data based on a sensitivity level for the data | |
| CN111563016B (en) | Log collection and analysis method and device, computer system and readable storage medium | |
| CN113489713B (en) | Network attack detection method, device, equipment and storage medium | |
| CN102201043A (en) | Auditing access to data based on resource properties | |
| US20220229657A1 (en) | Extensible resource compliance management | |
| US11416631B2 (en) | Dynamic monitoring of movement of data | |
| EA038063B1 (en) | Intelligent control system for cyberthreats | |
| US20200250587A1 (en) | Framework for multi-tenant data science experiments at-scale | |
| CN112000992B (en) | Data leakage prevention protection method and device, computer readable medium and electronic equipment | |
| CN108234392B (en) | Website monitoring method and device | |
| CN111611276A (en) | Data query method, device and storage medium | |
| CN111597422A (en) | Buried point mapping method and device, computer equipment and storage medium | |
| CN111783119A (en) | Form data security control method and device, electronic equipment and storage medium | |
| CN118427431A (en) | Data processing method, apparatus, computer device, storage medium, and program product | |
| Syed et al. | Providing efficient, scalable and privacy preserved verification mechanism in remote attestation | |
| CN112528189B (en) | Data-based component packaging method and device, computer equipment and storage medium | |
| CN114357032A (en) | Data quality monitoring method and device, electronic equipment and storage medium | |
| Haas | Protocol to discover machine-readable entities of the ecosystem management actions taxonomy | |
| CN113420288A (en) | Container mirror image sensitive information detection system and method | |
| CN114139509B (en) | Report processing method, device, equipment and medium | |
| CN116719986B (en) | Python-based data grabbing method, device, equipment and storage medium | |
| CN116647412B (en) | Security defense method and system of Web server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |