CN110555074A - method for extracting and processing data at fixed time, terminal and computer readable storage medium - Google Patents
method for extracting and processing data at fixed time, terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN110555074A CN110555074A CN201910856485.7A CN201910856485A CN110555074A CN 110555074 A CN110555074 A CN 110555074A CN 201910856485 A CN201910856485 A CN 201910856485A CN 110555074 A CN110555074 A CN 110555074A
- Authority
- CN
- China
- Prior art keywords
- scheduler
- task
- scheduling
- processing
- script
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/10—Tax strategies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/12—Accounting
- G06Q40/123—Tax preparation or submission
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Theoretical Computer Science (AREA)
- Development Economics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method, a terminal and a computer readable storage medium for extracting and processing data at fixed time, belongs to the field of data extraction and processing, and aims to solve the technical problem of how to realize the extraction and processing of data at fixed time by xxl-joband remote calling of a shell script. The method is based on xxl-joba deployment scheduler, tasks are managed through the scheduler, scheduling is carried out through the actuator, the scheduler remotely calls a shell script through the actuator, and data extraction and processing are carried out by regularly calling an sql script. The terminal comprises a processor and a memory for storing a computer program, the processor being configured to invoke said program instructions to perform the above-described method. The computer-readable storage medium stores a computer program that, when executed by a processor, performs the above-described method.
Description
Technical Field
the invention relates to the field of data extraction and processing, in particular to a method, a terminal and a computer readable storage medium for extracting and processing data at regular time.
background
in the tax industry, along with the continuous deepening of 'gold tax engineering', the types of tax data resources are continuously rich, the data volume is rapidly increased, and especially in recent years, rapidly increased unstructured data such as electronic bills, videos, web pages and the like exceed the current processing capacity. How to collect, store and utilize huge tax-related data and further mine valuable information from massive data has become a major topic for tax informatization. Moving from structured data to big data is a natural choice for further development.
any piece of software for analyzing big data application needs a powerful data extraction component, a data storage warehouse, a data processing engine, a task scheduling engine and a flow design interface. The emphasis of Hadoop and Spark is on data storage and task scheduling.
quartz is the best choice for job scheduling as the outbound job scheduling, but has the following problems:
problem one, the mode of calling API is not humanized;
Problem two, in the need of persistence service quartz JobBean to the bottom layer data sheet, the system invasion is quite serious;
Problem three, the scheduling logic and the Quartz JobBean are coupled in the same project, which leads to the gradual increase of the number of scheduling tasks, the gradual increase of the scheduling task logic and the limitation of the performance of the scheduling system to the service;
Problem four, the quartz bottom layer acquires the DB lock in a preemptive mode and the node which is successfully preempted is responsible for running the task, so that node load is greatly different.
xxl-jobA is a job scheduling tool having the following advantages:
The xxl-jobs can adopt a mode of calling API, and can also adopt a GLUE mode, so that the problem I can be avoided;
The xxl-jobA decomposes the dispatcher from the executor, and the service is only associated with the executor, thereby overcoming the second problem;
Advantages III, xxl-joba's scheduler is separated from executor, executor can be added into project, operation of scheduling system depends on operation of scheduler mostly, only depends on executor integrated by project when executing, thereby overcoming the problem III;
and the xxl-jobs realizes a 'cooperative allocation type' operation task through the actuator, fully exerts the cluster advantages and balances the load of each node, thereby overcoming the fourth problem.
The big data application needs data extraction and processing operation, taking HIVE as an example, the manual execution process is as follows: connecting to a host through the ssh protocol, executing shell commands, and performing step-by-step operation, which is time-consuming and labor-consuming, generally writing a shell script, and then executing, and calling the sql script.
In view of the advantages of xxl-joba, how to implement timing extraction and processing of data by xxl-joba and remote calling of shell scripts is a technical problem to be solved.
disclosure of Invention
The technical task of the invention is to provide a method, a terminal and a computer readable storage medium for extracting and processing data at regular time, so as to solve the problem of how to realize the extraction and processing of data at regular time by xxl-job and remote calling of shell scripts.
In a first aspect, the invention provides a method for extracting and processing data regularly, a scheduler is deployed on the basis of xxl-joba, tasks are managed through the scheduler, scheduling is carried out through an executor, the scheduler remotely calls a shell script through the executor, and data extraction and processing are carried out by calling an sql script regularly.
preferably, the method comprises the steps of:
Compiling a shell script and an sql script and uploading the shell script and the sql script to a server;
Configuring an actuator class of an actuator, wherein the actuator class inherits a JobHandler interface, and a service logic is configured in the JobHandler interface and is used for remotely connecting and calling a shell script;
deploying a scheduler through xxl-joba, wherein the scheduler is used for managing scheduling information and monitoring scheduling results, and the management scheduling information comprises configuration tasks, deletion tasks, recovery tasks and manual execution tasks;
accessing a scheduler and configuring tasks, wherein the task setting comprises setting an executor corresponding to the task, a routing strategy, an operation mode, a blocking processing strategy, a responsible person, task description, timing time and JobHandler;
Based on a manual execution task or a timing trigger mode according to timing time, sending a scheduling request to an actuator through a scheduler, remotely calling a shell script by the actuator based on the scheduling request, calling an sql script through the shell script to execute scheduling, and returning a generated scheduling result to the scheduler;
The scheduling results are reviewed by the scheduler.
preferably, the scheduling request comprises an execution request and a termination request;
Based on a manual task execution or timing trigger mode, sending an execution request to an executor through a scheduler, remotely calling a shell script by the executor based on the execution request, and calling an sql script through the shell script to extract and process data;
Based on a manual task execution or timing trigger mode, sending an end request to an executor through a scheduler, remotely calling a shell script by the executor based on the end request, and calling an sql script through the shell script to end data extraction and processing.
preferably, the scheduler is further configured to monitor a task log;
the executor remotely calls a shell script based on the scheduling request, calls an sql script through the shell script to execute scheduling, and generates a task log, wherein the task log is stored in a server;
And sending a log request to an executor through a scheduler, and remotely calling the shell script by the executor based on the log request to call the sql script to read the task log and return the task log to the scheduler for display.
Preferably, the scheduler has an API interface for calling the scheduler and a scheduling address for supporting the browser to access the scheduler.
Preferably, the configuration task further comprises setting task parameters, subtask IDs, failure retry times and alarm mails corresponding to the tasks.
Preferably, the tasks are configured by adding new tasks or editing tasks.
In a second aspect, the present invention provides a terminal comprising a processor, an input device, an output device and a memory, the processor, the input device, the output device and the memory being interconnected, the memory being configured to store a computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method of timing extraction and processing of data according to any of the first aspects.
In a third aspect, the present invention provides a computer readable storage medium storing a computer program comprising program instructions which, when executed by a processor, the processor performs the method of timing extraction and processing of data as set forth in any one of the first aspect.
the method, the terminal and the computer readable storage medium for extracting and processing data at regular time have the following advantages that:
1. The tasks are managed through the scheduler, and are scheduled through the executor, so that the tasks and the scheduling are decoupled, and the overall stability and the expansibility of the system are improved;
2. The shell script is simple and convenient to call, and can better perform data processing, extraction and synchronous work;
3. The log can be viewed through the scheduler to facilitate clear location of emerging issues.
Drawings
in order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
The invention is further described below with reference to the accompanying drawings.
FIG. 1 is a flow chart of a method for extracting and processing data at regular intervals according to example 1;
FIG. 2 is a schematic diagram showing the task configuration of a scheduler in the method for extracting and processing data at regular time in the embodiment 1;
FIG. 3 is a schematic view of a management interface of a scheduler in the method for extracting and processing data at regular intervals after improvement of embodiment 1.
Detailed Description
the present invention is further described in the following with reference to the drawings and the specific embodiments so that those skilled in the art can better understand the present invention and can implement the present invention, but the embodiments are not to be construed as limiting the present invention, and the embodiments and the technical features of the embodiments can be combined with each other without conflict.
the embodiment of the invention provides a method, a terminal and a computer readable storage medium for extracting and processing data at fixed time, which are used for solving the technical problem of how to realize the extraction and processing of data at fixed time by xxl-joband remotely calling a shell script.
example 1:
The invention discloses a method for extracting and processing data at fixed time, which is based on xxl-joba deployment scheduler, manages tasks through the scheduler, performs scheduling through an actuator, and remotely calls a shell script through the actuator by the scheduler to call an sql script at fixed time for data extraction and processing.
as shown in fig. 1, the method comprises the following steps:
s100, compiling a shell script and an sql script and uploading the shell script and the sql script to a server;
S200, configuring an actuator class of an actuator, wherein the actuator class inherits a JobHandler interface, and a service logic is configured in the JobHandler interface and is used for remotely connecting and calling a shell script;
S300, deploying a scheduler through xxl-joba, wherein the configured scheduler is used for managing scheduling information and monitoring scheduling results, and the management scheduling information comprises configuration tasks, deletion tasks, recovery tasks and manual execution tasks;
S300, accessing a scheduler and configuring tasks, wherein the task setting comprises setting an actuator, a routing strategy, an operation mode, a blocking processing strategy, a responsible person, task description, timing time and JobHandler corresponding to the tasks;
s400, based on a manual task execution mode or a timing time triggering mode, sending a scheduling request to an actuator through a scheduler, remotely calling a shell script by the actuator based on the scheduling request, calling an sql script through the shell script to execute scheduling, and returning a generated scheduling result to the scheduler;
and S500, checking a scheduling result through a scheduler.
The scheduler comprises an API interface, a scheduling address, a management interface and a background, wherein the management interface is matched with the background to realize the functions of managing scheduling information and monitoring scheduling results, and an external component such as xxl-joba can call the API interface to access the scheduler or input the scheduling address in the browser to be linked to the scheduler.
in step S400, a scheduling address is opened in a browser, a task is configured after entering a management interface, an executor, a routing policy, an operation mode, a blocking processing policy, a responsible person, a task description, a timing time, and a JobHandler corresponding to the task need to be set when the task is configured, in this embodiment, the executor is an example executor, the first of the routing policy selection configuration is a GLUE (Shell), the blocking processing policy selection standalone serial is a single timeout time selection 0, the responsible person is designated, the task description is a shell test, and a timing time Cron (the timing time starts to execute the task at a fixed time) is set.
as a further extension, in this embodiment, when configuring a task, the task parameters, the subtask ID, the number of failed retries, and the alarm mail corresponding to the task need to be set, which is specifically shown in fig. 2.
In this embodiment, the scheduling request includes an execution request for requesting the execution of the task to perform data extraction and processing and a termination request for requesting the execution of the termination task to terminate the data extraction and processing. Specifically, the method comprises the following steps:
Mode one the mode of executing the request is: based on a manual task execution or timing trigger mode, sending an execution request to an executor through a scheduler, remotely calling a shell script by the executor based on the execution request, and calling an sql script through the shell script to extract and process data;
Mode two termination request mode is: based on a manual task execution or timing trigger mode, sending an end request to an executor through a scheduler, remotely calling a shell script by the executor based on the end request, and calling an sql script through the shell script to end data extraction and processing.
The invention discloses a method for extracting and processing data regularly, wherein edited shell scripts and sql scripts are stored in a server, an executor class of an executor is deployed, the executor class inherits a JobHandler interface to call the shell scripts, a scheduler is deployed through xxl-jobs, and tasks are configured in the scheduler. When data needs to be extracted and processed, sending an execution request to an executor through a scheduler, and remotely calling a shell script by the executor based on the execution request so as to call an sql script to extract and process the data; when the task needs to be terminated, a termination request is sent to the executor through the scheduler, and the executor remotely calls the shell script based on the termination request to call the sql script to terminate the extraction and processing of the data. The execution and termination can be triggered manually by selecting a manual execution mode on the interface, or a timing time is set when the task is configured so as to be triggered by the timing time.
as a further improvement of this embodiment, the scheduler is also used to monitor the task log. The management interface of the improved scheduler is shown in fig. 3, wherein corresponding manual execution is executed, a corresponding deleted task is deleted, a corresponding deleted task is recovered, a log corresponds to a log request, a task log is acquired and displayed as a request, a corresponding pair is edited to establish a task setting, the GLUE provides a Web IDE, online development of task logic codes is supported, dynamic release is realized, real-time compiling is effective, and the process of online deployment is omitted.
and the executor remotely calls the shell script based on the scheduling request, calls the sql script to execute scheduling through the shell script, and generates a task log, wherein the task log is stored in the server.
When the task needs to be monitored, the log can be selected on a management interface of the scheduler, so that a log request is sent to the executor through the scheduler, and the executor remotely calls the shell script based on the log request to call the sql script to read the task log and return the task log to the scheduler for display.
Example 2:
the invention provides a terminal which comprises a processor, an input device, an output device and a memory, wherein the processor, the input device, the output device and the memory are connected with each other, the memory is used for storing a computer program, the computer program comprises program instructions, and the processor is configured to call the program instructions to execute the method for extracting and processing data at fixed time as disclosed in embodiment 1.
Example 3:
the present invention provides a computer-readable storage medium storing a computer program comprising program instructions which, when executed by a processor, the processor performs a method of timing extraction and processing of data as disclosed in embodiment 1.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (9)
1. the method for regularly extracting and processing the data is characterized in that a scheduler is deployed based on xxl-joba, tasks are managed through the scheduler, scheduling is carried out through an actuator, the scheduler remotely calls a shell script through the actuator, and the sql script is regularly called for data extraction and processing.
2. a method for the timed extraction and processing of data according to claim 1, characterized in that it comprises the following steps:
Compiling a shell script and an sql script and uploading the shell script and the sql script to a server;
configuring an actuator class of an actuator, wherein the actuator class inherits a JobHandler interface, and a service logic is configured in the JobHandler interface and is used for remotely connecting and calling a shell script;
Deploying a scheduler through xxl-joba, wherein the scheduler is used for managing scheduling information and monitoring scheduling results, and the management scheduling information comprises configuration tasks, deletion tasks, recovery tasks and manual execution tasks;
Accessing a scheduler and configuring tasks, wherein the configuration tasks comprise setting an executor corresponding to the tasks, a routing strategy, an operation mode, a blocking processing strategy, a responsible person, task description, timing time and JobHandler;
Based on a manual execution task or a timing trigger mode according to timing time, sending a scheduling request to an actuator through a scheduler, remotely calling a shell script by the actuator based on the scheduling request, calling an sql script through the shell script to execute scheduling, and returning a generated scheduling result to the scheduler;
the scheduling results are reviewed by the scheduler.
3. The method for timing extraction and elaboration of data according to claim 2, characterized in that the scheduling request comprises an execution request and a termination request;
Based on a manual task execution or timing trigger mode, sending an execution request to an executor through a scheduler, remotely calling a shell script by the executor based on the execution request, and calling an sql script through the shell script to extract and process data;
based on a manual task execution or timing trigger mode, sending an end request to an executor through a scheduler, remotely calling a shell script by the executor based on the end request, and calling an sql script through the shell script to end data extraction and processing.
4. a method for the timed extraction and processing of data according to claim 2 or 3, characterised in that said scheduler is also adapted to monitor a task log;
the executor remotely calls a shell script based on the scheduling request, calls an sql script through the shell script to execute scheduling, and generates a task log, wherein the task log is stored in a server;
And sending a log request to an executor through a scheduler, and remotely calling the shell script by the executor based on the log request to call the sql script to read the task log and return the task log to the scheduler for display.
5. a method for the timed extraction and elaboration of data according to claim 1, 2 or 3, characterized in that the scheduler has an API interface for invoking the scheduler and a scheduling address for supporting a browser access to the scheduler.
6. the method for extracting and processing data regularly according to claim 2 or 3, characterized in that the task configuration further comprises setting task parameters, subtask ID, number of failed retries and alarm mail corresponding to the task.
7. The method for extracting and processing data periodically as claimed in claim 6, wherein the tasks are configured by adding new tasks or editing tasks.
8. A terminal, characterized by comprising a processor, an input device, an output device and a memory, the processor, the input device, the output device and the memory being interconnected, the memory for storing a computer program comprising program instructions, the processor being configured for invoking the program instructions for performing the method of timed extraction and processing of data according to any one of claims 1-7.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program comprising program instructions which, when executed by a processor, the processor performs the method of timing extraction and processing of data according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910856485.7A CN110555074B (en) | 2019-09-11 | 2019-09-11 | Method, terminal and computer readable storage medium for timing data extraction and processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910856485.7A CN110555074B (en) | 2019-09-11 | 2019-09-11 | Method, terminal and computer readable storage medium for timing data extraction and processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110555074A true CN110555074A (en) | 2019-12-10 |
| CN110555074B CN110555074B (en) | 2023-04-25 |
Family
ID=68739810
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910856485.7A Active CN110555074B (en) | 2019-09-11 | 2019-09-11 | Method, terminal and computer readable storage medium for timing data extraction and processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110555074B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112346837A (en) * | 2020-10-28 | 2021-02-09 | 常州微亿智造科技有限公司 | Distributed timer system under industrial Internet of things |
| CN112860776A (en) * | 2021-01-20 | 2021-05-28 | 山东众阳健康科技集团有限公司 | Method and system for extracting and scheduling various data |
| CN114816717A (en) * | 2022-05-19 | 2022-07-29 | 广州有信科技有限公司 | Method, device and equipment for executing computer task and storage medium |
| CN116382814A (en) * | 2023-03-31 | 2023-07-04 | 杭州端点网络科技有限公司 | Unified system scheduling adaptation method, device, computer equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108733386A (en) * | 2018-05-21 | 2018-11-02 | 平安科技（深圳）有限公司 | Remote journal real time inspection method, system, computer equipment and storage medium |
| WO2019027597A1 (en) * | 2017-08-02 | 2019-02-07 | Siemens Aktiengesellschaft | Workflows management framework |
-
2019
- 2019-09-11 CN CN201910856485.7A patent/CN110555074B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019027597A1 (en) * | 2017-08-02 | 2019-02-07 | Siemens Aktiengesellschaft | Workflows management framework |
| CN108733386A (en) * | 2018-05-21 | 2018-11-02 | 平安科技（深圳）有限公司 | Remote journal real time inspection method, system, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 杜红光等: "共享集群基于HDFS的数据块密度调度策略", 《计算机科学》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112346837A (en) * | 2020-10-28 | 2021-02-09 | 常州微亿智造科技有限公司 | Distributed timer system under industrial Internet of things |
| CN112860776A (en) * | 2021-01-20 | 2021-05-28 | 山东众阳健康科技集团有限公司 | Method and system for extracting and scheduling various data |
| CN114816717A (en) * | 2022-05-19 | 2022-07-29 | 广州有信科技有限公司 | Method, device and equipment for executing computer task and storage medium |
| CN116382814A (en) * | 2023-03-31 | 2023-07-04 | 杭州端点网络科技有限公司 | Unified system scheduling adaptation method, device, computer equipment and storage medium |
| CN116382814B (en) * | 2023-03-31 | 2024-03-12 | 杭州端点网络科技有限公司 | Unified system scheduling adaptation method, device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110555074B (en) | 2023-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11593599B2 (en) | Long running workflows for document processing using robotic process automation | |
| CN112000737B (en) | Data synchronization method, system, terminal and storage medium based on multi-cloud management | |
| CN110555074A (en) | method for extracting and processing data at fixed time, terminal and computer readable storage medium | |
| CN106802826B (en) | Service processing method and device based on thread pool | |
| US7207034B2 (en) | Undo infrastructure | |
| CN111125444A (en) | Big data task scheduling management method, device, equipment and storage medium | |
| WO2018126964A1 (en) | Task execution method and apparatus and server | |
| CN105607986A (en) | Acquisition method and device of user behavior log data | |
| CN110990432A (en) | Device and method for synchronizing distributed cache clusters across machine rooms | |
| CN103618762A (en) | System and method for enterprise service bus state pretreatment based on AOP | |
| CN111966465B (en) | Method, system, equipment and medium for modifying host configuration parameters in real time | |
| CN110471977B (en) | Data exchange method, device, equipment and medium | |
| JP7161560B2 (en) | Artificial intelligence development platform management method, device, medium | |
| CN113867600A (en) | Development method and device for processing streaming data and computer equipment | |
| CN116340269A (en) | Method for acquiring and searching Flink task logs in real time based on elastic search | |
| CN115329170A (en) | Webpage crawling method, device, equipment and storage medium | |
| CN112860412B (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN110011827A (en) | Towards doctor conjuncted multi-user's big data analysis service system and method | |
| CN109614271A (en) | Control method, device, equipment and the storage medium of multiple company-data consistency | |
| CN111538491B (en) | Data event processing method, device, equipment and storage medium | |
| CN110727565A (en) | Network equipment platform information collection method and system | |
| WO2019062087A1 (en) | Attendance check data testing method, terminal and device, and computer readable storage medium | |
| CN115220887A (en) | Processing method of scheduling information, task processing system, processor and electronic equipment | |
| CN106055322A (en) | Flow scheduling method and device | |
| CN111400060A (en) | Equipment linkage method, device, server and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230331 Address after: 250000 Langchao Science Park, No. 1036, Langchao Road, high tech Zone, Jinan, Shandong Applicant after: Inspur Software Technology Co.,Ltd. Address before: 250100 First Floor of R&D Building 2877 Kehang Road, Sun Village Town, Jinan High-tech Zone, Shandong Province Applicant before: SHANDONG INSPUR BUSINESS SYSTEM Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |