CN109343856A - The generation method and device of custom algorithm component - Google Patents
The generation method and device of custom algorithm component Download PDFInfo
- Publication number
- CN109343856A CN109343856A CN201811243202.3A CN201811243202A CN109343856A CN 109343856 A CN109343856 A CN 109343856A CN 201811243202 A CN201811243202 A CN 201811243202A CN 109343856 A CN109343856 A CN 109343856A
- Authority
- CN
- China
- Prior art keywords
- user
- algorithm component
- custom algorithm
- business
- component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004422 calculation algorithm Methods 0.000 title claims abstract description 233
- 238000000034 method Methods 0.000 title claims abstract description 100
- 238000012545 processing Methods 0.000 claims abstract description 107
- 230000009471 action Effects 0.000 claims abstract description 17
- 238000012544 monitoring process Methods 0.000 claims abstract description 17
- 238000004891 communication Methods 0.000 claims description 22
- 230000008569 process Effects 0.000 description 11
- 238000000605 extraction Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000007246 mechanism Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 230000000379 polymerizing effect Effects 0.000 description 2
- 238000012163 sequencing technique Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 235000019580 granularity Nutrition 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses the generation methods and device of a kind of custom algorithm component.Wherein, method includes: the trigger action that monitoring generates custom algorithm component, obtains user and compiles data according to provided by open system API, generates compiling data packet；By compiling packet delivery into each processor of cluster；The processing to business is realized in selection and editing operation according to user to custom algorithm component.The custom algorithm component that this programme generates, can provide basis without code for business processing, be conducive to the whole of business processing efficiency and promoted, and can meet the individual demand of user, promote user experience.
Description
Technical field
The present invention relates to field of computer technology, and in particular to a kind of generation method and device of custom algorithm component.
Background technique
With the continuous development of science and technology and society, the quantity of all kinds of business is also constantly being promoted in computer field.Currently,
For the processing for realizing business, developer is usually needed to compile corresponding service code according to demand, and according to the business generation of compiling
Code carries out business processing.
However, be unable to fully using method for processing business in the prior art using the interlinking between each business demand,
To the drawback for easily causing business development low to processing whole efficiency.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind
State the generation method and device of the custom algorithm component of problem.
According to an aspect of the invention, there is provided a kind of generation method of custom algorithm component, comprising:
Monitoring generates the trigger action of custom algorithm component, obtains user and is compiled according to provided by open system API
Data generate compiling data packet；
By compiling packet delivery into each processor of cluster；
The processing to business is realized in selection and editing operation according to user to custom algorithm component.
According to another aspect of the present invention, a kind of generating means of custom algorithm component are provided, comprising:
Generation module obtains user according to open system API suitable for monitoring the trigger action for generating custom algorithm component
Provided compiling data generate compiling data packet；
Distribution module, suitable for packet delivery will be compiled into each processor of cluster；
Processing module realizes the place to business suitable for the selection and editing operation according to user to custom algorithm component
Reason.
According to another aspect of the invention, provide a kind of calculating equipment, comprising: processor, memory, communication interface and
Communication bus, the processor, the memory and the communication interface complete mutual communication by the communication bus；
For the memory for storing an at least executable instruction, it is above-mentioned that the executable instruction executes the processor
The corresponding operation of the generation method of custom algorithm component.
In accordance with a further aspect of the present invention, provide a kind of computer storage medium, be stored in the storage medium to
A few executable instruction, the generation method that the executable instruction executes processor such as above-mentioned custom algorithm component are corresponding
Operation.
The generation method and device of the custom algorithm component provided according to the present invention.Monitoring generates custom algorithm component
Trigger action, obtain user and compile data according to provided by open system API, generate compiling data packet；Data will be compiled
Packet is distributed in each processor of cluster；Selection and editing operation according to user to custom algorithm component are realized to industry
The processing of business.The custom algorithm component that this programme generates, can provide basis without code for business processing, be conducive to business
The whole for the treatment of effeciency is promoted, and can meet the individual demand of user, promotes user experience.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of process of the generation method of the custom algorithm component provided according to an embodiment of the present invention
Schematic diagram；
Fig. 2 shows a kind of streams of the generation method of the custom algorithm component provided according to a further embodiment of the invention
Journey schematic diagram；
Fig. 3 shows a kind of operation interface schematic diagram provided according to a further embodiment of the invention；
Fig. 4 shows a kind of structure of the generating means of the custom algorithm component provided according to an embodiment of the present invention
Schematic diagram；
Fig. 5 shows a kind of structural schematic diagram of the calculating equipment provided according to an embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 shows a kind of process of the generation method of the custom algorithm component provided according to an embodiment of the present invention
Schematic diagram.As shown in Figure 1, this method comprises:
Step S110, monitoring generate the trigger action of custom algorithm component, obtain user and are mentioned according to open system API
The compiling data of confession generate compiling data packet.
After the trigger action for monitoring to generate custom algorithm component, into custom algorithm component translation and compiling environment.
Wherein, the present invention to the concrete type of trigger action without limitation, for example, trigger action can be the click for preset control
Operation, or preset voice-controlled operations etc..
In custom algorithm component translation and compiling environment, it is provided with open system API for user, user can mention according to the API
For compiling data accordingly, which is specially compiled code needed for generating custom algorithm component etc..
The compiling data are generated corresponding compiling by preset method by the compiling data further provided according to user
Data packet, and then form custom algorithm component corresponding with the compiling data packet.For example, the compiling that can be provided according to user
Data generate corresponding jar packet by preset packaging method.
Step S120, by compiling packet delivery into each processor of cluster.
After generating compiling data packet, packet delivery will be compiled to each place of cluster by preset distribution mechanisms
It manages in device, in order to when custom algorithm component corresponding using the compiling data packet, can rapidly lead in the next steps
It crosses the compiling data packet and carries out task execution, to improve the whole efficiency of business processing.Wherein, the present invention is to specific distribution
Without limitation, those skilled in the art can voluntarily select mechanism according to actual group type etc..
The processing to business is realized in step S130, selection and editing operation according to user to custom algorithm component.
After generating to custom algorithm component, user is received to the selection operation of generated custom algorithm component,
And then determine the custom algorithm component of user's selection.And further monitoring user is directed to the custom algorithm component of selection
The syntagmatic between the custom algorithm component of user's selection is determined in editing operation, and then according to the syntagmatic to business
It is handled.Also, in business procession, when certain custom algorithm component need to be executed, phase in clustered processors is called
The compiling data packet answered, to realize business processing.
It can be seen that the present embodiment is that user is provided with open system API, provided for user according to open system API
Corresponding compiling data, to meet user demand；And corresponding compiling data packet is generated according to the compiling data that user provides,
And then custom algorithm component corresponding with the compiling data packet is formed, so that subsequent user is when handling similar business scenario,
Can business processing directly be carried out using generated custom algorithm component；The present embodiment generate compile data packet after, into
One step by preset distribution mechanisms by the compiling packet delivery in each processor into cluster, consequently facilitating in business
It in treatment process, no longer needs to by the compiling packet delivery into corresponding processor, and need to only call in respective processor
Custom algorithm component can be performed quickly in compiling data packet, and then promotes business processing efficiency；The present embodiment is generating certainly
After defining algorithm assembly, custom algorithm component can be provided for user, so that user only needs to select required custom algorithm
Component and layout is carried out to the custom algorithm component of selection, the processing to business can be realized, to realize business processing
Without code, business processing efficiency is promoted.
Fig. 2 shows a kind of streams of the generation method of the custom algorithm component provided according to a further embodiment of the invention
Journey schematic diagram.
Custom algorithm component generation method provided in this embodiment can be applied to support the processing system of algorithm assembly.
Include algorithm assembly library in the system, includes polyalgorithm component in the algorithm assembly library.Wherein, multiple algorithm assembly
Include multiple fine-grained basic algorithm components, the basic algorithm component be according to the general-purpose algorithm in business procession and
The algorithm assembly taken out.For example, the basic algorithm component includes extracting class algorithm assembly, conversion class algorithm assembly and/or adding
Carry class algorithm assembly.Wherein, extract class algorithm assembly may include that MySQL extraction assembly, HDFS extraction assembly and Hive take out again
Take component；Conversion class algorithm assembly may include filter assemblies, replacement component, sequencing assembly, connection component, polymerizing component and/
Or combining block；Loading classes algorithm assembly includes MySQL charging assembly, HDFS charging assembly and/or Hive charging assembly.?
This, it will be apparent to a skilled person that the present invention is not to the concrete type etc. of the algorithm assembly in algorithm assembly library
Be not construed as limiting, those skilled in the art can according to actual demand to business needed for algorithm carry out partition by fine granularities, encapsulation obtains
Obtain multiple fine-grained basic algorithm components.
In addition, algorithm assembly library is also provided with template algorithm component, which can be at least one basis
The set of algorithm assembly, at least one general business demand for solution.For example, in actual business procession,
Calculating PV (Page View, page access amount)-UV (Unique Visitor, independent visitor) is usually that a common business needs
It asks, to avoid user from compiling the repetition for commonly using business demand, can be calculated based on basis needed for calculating PV-UV in the present embodiment
Logical relation between method component and required basic algorithm component is encapsulated as PVUV template algorithm component, thus by should
Component is directly realized by the calculating to PV-UV.
However, the basic algorithm component and template algorithm component that are only provided by algorithm assembly library be not able to satisfy it is certain
The demand of complicated business scene, so, the present embodiment further generates custom algorithm component by the following method:
As shown in Fig. 2, this method comprises:
Step S210, monitoring generate the trigger action of custom algorithm component, according to user by open system API to mentioning
The compilation operations of at least one Compilation Method supplied obtain compiling data, and generate compiling data packet；
When the basic algorithm component of algorithm assembly library offer and template algorithm component are unable to satisfy user demand, can pass through
Preset trigger action triggering generates the request of custom algorithm component.Then in the triggering behaviour for monitoring generation custom algorithm component
After work, into custom algorithm component translation and compiling environment.Wherein, the present invention to the concrete type of trigger action without limitation.
In custom algorithm component translation and compiling environment, it is provided with open system API for user, user can be API pairs according to this
At least one Compilation Method that system provides is compiled, so that this step can pass through open system API to offer according to user
At least one Compilation Method compilation operations, obtain compiling data.Wherein, at least one Compilation Method provided specifically can be with
Including initial method, execute method, and/or output method etc..
Optionally, to avoid user from directly carrying out unfavorable operation to the native interface of computing engines, in the present embodiment is
Opening API of uniting is not the primary API of system, but the further encapsulation to the primary API of system, to shield primary to system
The unfavorable operation of API, safeguards system stability and safety.
Further, corresponding compiling data packet is produced according to the compiling data of acquisition, to be formed and the compiling data
Wrap corresponding custom algorithm component.It optionally, can also be the custom algorithm group after generating custom algorithm component
Part configures corresponding authority information, thus only in the matched situation of authority information of user identity and custom algorithm component,
User is allowed to select custom algorithm component.I.e. in the next steps (step S230) judge subscriber identity information whether with make by oneself
The corresponding authority information of algorithm assembly matches, if so, selection and editing operation according to user to custom algorithm component,
Realize the processing to business.
Step S220, by compiling packet delivery into each processor of cluster.
Since the execution of compiling data packet is completed by the processor in cluster, if compiling data packet is stored in
In algorithm assembly library, in custom algorithm component corresponding using the compiling data packet, still need to send out the compiling data packet
It send and is executed into processor, to increase traffic handling time, be unfavorable for the promotion of whole business processing efficiency.Institute
With the present embodiment will compile data packet by preset distribution mechanisms and be distributed to each of cluster after generating compiling data packet
In a processor, so that when using certain custom algorithm component, respective processor can be called in follow-up business treatment process
In compiling data packet carry out business processing.
Step S230, selection and editing operation according to user to custom algorithm component, and the user received are defeated
The business scenario configuration information entered realizes the processing to business.
To improve business processing visualization and operation convenience, pel operation interface can be provided for user.In the pel
Change in operation interface, be presented the corresponding custom algorithm component pel of generated custom algorithm component, and with each base
Plinth algorithm assembly and/or the corresponding basic algorithm component pel of template algorithm component and/or template algorithm component pel.Can then it lead to
Monitoring user is crossed in pel operation interface for custom algorithm component pel, basic algorithm component pel and/or template
The selection operation of algorithm assembly pel determines custom algorithm component, basic algorithm component and/or the template algorithm of user's selection
Component.It further, also include for user's incoming traffic scene configuration information in the pel operation interface provided for user
Entrance.Business scenario configuration information includes business description information, data source information and computing engines information.Wherein, this hair
It is bright to concrete type of business scenario configuration information etc. without limitation, for example, input business scenario configuration information can be
Json type, specifically, user after selecting a certain custom algorithm component pel, can be further advanced by it is default input into
Mouth inputs the business scenarios configuration informations such as the path of the custom algorithm component, for ensureing the smooth of business in the next steps
It executes.For example, pel operation interface as shown in Figure 3 includes in the 3-1 of region in the pel operation interface
Polyalgorithm component pel, specifically, multiple algorithm assembly pel include: basic algorithm component pel, template algorithm component
Pel and custom algorithm component pel.Each component pel provided in pel operation interface and the algorithm assembly phase in system
It is corresponding.Wherein, basic algorithm component pel includes: to extract class component pel, conversion class component pel and/or loading classes component drawings
Member.Extract class algorithm assembly may include MySQL extraction assembly, HDFS extraction assembly and Hive extraction assembly again；Class is converted to calculate
Method component may include filter assemblies, replacement component, sequencing assembly, connection component, polymerizing component, and/or combining block；Load
Class algorithm assembly includes MySQL charging assembly, HDFS charging assembly and/or Hive charging assembly.Pelization shown in Fig. 3 operates boundary
Template algorithm component pel in face is PVUV template component pel.User can drag selection Hive extraction assembly pel, replacement
Component pel, PVUV template component pel and MySQL charging assembly pel are into region 3-2, in user by Hive extraction assembly
In pel, replacement component pel, PVUV template component pel and MySQL charging assembly pel to region 3-2, that is, show that user selects
Algorithm assembly needed for having selected business processing, i.e. Hive extraction assembly, replacement component, PVUV template component and MySQL load group
Part.Also, after the algorithm assembly pel for choosing a certain selection, the business scenario for the algorithm assembly can be inputted with confidence
Breath can input the business scenario for Hive extraction assembly pel such as after choosing Hive extraction assembly pel in the 3-3 of region
Configuration information.
It, can be into the custom algorithm component for determining user's selection, after basic algorithm component and/or template algorithm component
One step grasps the layout of the custom algorithm component of selection, basic algorithm component and/or template algorithm component pel according to user
Make, determines the syntagmatic (syntagmatic including determining the custom algorithm component of selection) between the algorithm assembly of selection.Its
In, the syntagmatic at least one algorithm assembly that the present embodiment determines can be forward direction sing data structure.Forward direction star belongs to DAG
One kind in (Directed Acyclic Graph, directed acyclic graph) is a kind of to store figure in a manner of storing side
Data structure, without being directed toward lower a line with pointer as adjacency list, consequently facilitating improving business processing efficiency.
Further, syntagmatic (the custom algorithm component including parsing selection between the algorithm assembly of selection is parsed
Syntagmatic), obtain corresponding service logic topological relation.Specifically, due to the syntagmatic of at least one algorithm assembly
Not it is the optimal execution logic of business procession, is directly carried out according to the syntagmatic of at least one algorithm assembly of input
The execution of each algorithm assembly easily causes the reduction of business execution efficiency.So to further increase business processing efficiency, this
Embodiment carries out business processing especially by following steps:
Firstly, parsing the syntagmatic of at least one algorithm assembly, obtains the corresponding business of at least one algorithm assembly and patrol
Collect topological relation.Specifically, to the syntagmatic of at least one algorithm assembly of sing data structure before parsing, at least one calculation
Method component carries out topological sorting, obtains the corresponding service logic topology of at least one algorithm assembly according to topological sorting result and closes
System.Wherein, the present embodiment to specific topological sorting method without limitation, for example, the AOE (Activity in DAG can be used
On Edge Network) algorithm carries out topological sorting.Here, it will be apparent to a skilled person that being patrolled according to business
Topological relation is collected to carry out the processing result of business processing and directly carry out business according to the syntagmatic of at least one algorithm assembly
The processing result of processing is identical, to promote business processing efficiency in the case where guaranteeing the identical situation of service processing result.Citing comes
It says, if the algorithm assembly of user's input has component A, B and C, the syntagmatic of component A, B and C of input are A → B → C sequence
Relationship, however, by the data dependence relation between resolution component A, B and C and executing sequential dependency discovery later, component
A and component B is simultaneously not present data dependence and executes order dependent, i.e. component A and component B can be executed parallel, then service logic is opened up
The relationship of flutterring can be A → C ← B, and carrying out business processing based on this service logic topological relation can treatment effeciency with higher.
Further, task is handled according to business scenario configuration information and service logic topological relation creation.Specifically, will
Business procession is the execution for being converted at least one processing task, to pass through the execution of the processing task to creation
Realize the processing to business.Specifically, during creating processing task, in this step (such as by the preset kind of user's input
Json type) business scenario configuration information combination service logic topological relation, be created that for engine identification processing task
Information executes processing task for engine so that the processing mission bit stream is transferred to engine.
Finally, corresponding computing engines is called to execute processing task.Wherein, computing engines can be multiple, as Spark draws
It holds up and/or Flink engine etc..It optionally, is the treatment effeciency of support mission and the accuracy of processing result, in computing engines
Before formal execution processing task, the initialization process of running environment can be carried out previously according to business scenario configuration information.Wherein,
The present embodiment to specific init processing method without limitation.
In a kind of optional embodiment, after creating processing task, to keep reason task everywhere in creation orderly
It is effectively carried out, the processing task that can further create is scheduled processing, and corresponding computing engines is called to execute processing task.
Optionally, in scheduling process, place is not scheduled to postposition task when previous task does not complete to save scheduling resource
Reason only carries out the execution of postposition task after previous task processing is completed.
Summarize in another optional embodiment, during computing engines execute processing task, can acquire and deposit
Store up the engine output data of each algorithm assembly.For example, during computing engines execute processing task, gathering algorithm component
The engine output data of A, and the engine output data of algorithm assembly A is stored in default memory space, if computation module B number
According to algorithm assembly A is depended on, then in the processing task of execution computation module B, then the acquisition algorithm group from default memory space
The engine output data of part A executes processing task.It is further alternative, it can also be stored in default memory space defeated with engine
The corresponding source data of data out, to meet the data adaptation demand of different computing engines.Specifically, due to different meters
Data format needed for calculating engine etc. is not quite similar, and when same data circulate in different computing engines, need to be converted to corresponding
Engine data format, so that active data and corresponding engine data need to be carried during computing engines execute processing task
Two class data, thus increase the storage overhead of computing engines, and the present invention is then to be stored in source data and engine output data
In default memory space, is preset when computing engines need to obtain data from this and obtain corresponding data in memory space, to save
Province's system storage overhead.
In another optional embodiment, user can enter task commissioning mode by predetermined manner.In task tune
In survey mode, monitoring user is directed to the breakpoint insertion operation of any algorithm assembly, and commissioning breakpoint is arranged for the algorithm assembly；Locating
In the implementation procedure of reason task, capture setting has the engine input data and engine output number of the algorithm assembly of commissioning breakpoint
According to；And the engine input data and engine output data are exported, so that user carries out commissioning.Optionally, the engine input of output
Data and engine output data can be presented dimension from least one and be presented.Wherein, present dimension include: time dimension,
Test data ratio dimension, and/or commissioning result dimension etc..It is corresponding so as to be presented according to user to the selection that dimension is presented
Test data.It is further alternative, when engine input data and larger engine output data data volume, engine can be inputted
Data and engine output data store in a distributed fashion.
In another optional embodiment, to realize business rule during handling task execution and executing logic
Decoupling, the present embodiment can also execute processing task by means of regulation engine.Specifically, rule base is constructed first, i.e., to obtaining
The regular data taken carries out syntactic verification, wherein regular data includes that rule condition data and rule condition data are corresponding
Rules results data；If regular data syntactic verification is qualified, regular data is stored in default rule library, then it is preset
It include at least one regular data in rule base；After constructing rule base, processing task data is obtained, number of tasks will be handled
It is matched according to at least one rule condition data in default rule library, what the determining and processing task data matched
Goal rule condition data；Rules results data corresponding with goal rule condition data are determined as and the processing number of tasks
According to corresponding processing result.It optionally, can be by least one rule condition in default rule library during rule match
Data are converted to the rule set of default tree structure (such as RETE tree structure), thus according to the rule set of default tree structure,
Determine the goal rule condition data to match with processing task data.It is further alternative, when determination and pending data phase
When matched goal rule condition data is a plurality of, then need to determine that pending data is corresponding using preset conflict resolution algorithm
Processing result.Wherein, preset collision algorithm can be PRI conflict solution annual reporting law, such as agenda conflict resolution algorithm
Deng.Optionally, corresponding access authority can be configured for each rule in rule set, thus according to access authority to processing task
Data carry out rule match.
It can be seen that the present embodiment be user be provided with open system API and at least one Compilation Method, for user according to
Open system API obtains compiling data to the compilation operations of at least one Compilation Method of offer, thus meeting user's need
The compilation operations convenience of custom algorithm component is further promoted on the basis of asking；The compiling data provided according to user are raw
At corresponding compiling data packet, and then custom algorithm component corresponding with the compiling data packet is formed, so that subsequent user exists
When handling similar business scenario, business processing directly can be carried out using generated custom algorithm component；The present embodiment is in life
After compiling data packet, further each processing by preset distribution mechanisms by the compiling packet delivery into cluster
In device, consequently facilitating being no longer needed to by the compiling packet delivery into corresponding processor in business procession, and only need
It calls the compiling data packet in respective processor that custom algorithm component can be performed quickly, and then promotes business processing effect
Rate；The present embodiment can provide custom algorithm component after generating custom algorithm component for user, so that user only needs to select
It selects required custom algorithm component and layout is carried out to the custom algorithm component of selection, and in process of service execution, root
Processing task is executed according to service logic topological relation and business scenario configuration information, to greatly improve the treatment effeciency of business.
Fig. 4 shows a kind of structure of the generating means of the custom algorithm component provided according to an embodiment of the present invention
Schematic diagram.As shown in figure 4, the device includes: generation module 41, distribution module 42 and processing module 43.
Generation module 41 obtains user according to open system suitable for monitoring the trigger action for generating custom algorithm component
Data are compiled provided by API, generate compiling data packet；
Distribution module 42, suitable for packet delivery will be compiled into each processor of cluster；
Processing module 43 is realized suitable for the selection and editing operation according to user to custom algorithm component to business
Processing.
Optionally, generation module 41 is further adapted for: according to user by open system API at least one volume of offer
The compilation operations of method are translated, compiling data are obtained.
Optionally, at least one Compilation Method of the offer includes: initial method, execution method, and/or output side
Method.
Optionally, device further include: receiving module (not shown), the business scenario suitable for receiving user's input are matched
Confidence breath；
Processing module 43 further comprises: selection and editing operation according to user to custom algorithm component, Yi Jiye
Scene configuration information of being engaged in realizes the processing to business.
Optionally, processing module 43 further comprises: selection and editing operation according to user to custom algorithm component,
Determine the syntagmatic of custom algorithm component；
The syntagmatic for parsing custom algorithm component, obtains corresponding service logic topological relation；
Task is handled according to the business scenario configuration information and the service logic topological relation creation；
Corresponding computing engines are called to execute processing task.
Optionally, device further include: permission configuration module (not shown) is suitable for the custom algorithm component
Configure corresponding authority information；
Processing module 43 is further adapted for: judging whether subscriber identity information with described makes the corresponding permission of algorithm assembly by oneself
Information matches, if so, selection and editing operation according to user to custom algorithm component, realize the processing to business.
Wherein, the specific implementation process of each module can refer in embodiment of the method shown in Fig. 1 or Fig. 2 in the present embodiment device
The description of corresponding portion, this will not be repeated here for the present embodiment.
It can be seen that the present embodiment is that user is provided with open system API, provided for user according to open system API
Corresponding compiling data, to meet user demand；And corresponding compiling data packet is generated according to the compiling data that user provides,
And then custom algorithm component corresponding with the compiling data packet is formed, so that subsequent user is when handling similar business scenario,
Can business processing directly be carried out using generated custom algorithm component；The present embodiment generate compile data packet after, into
One step by preset distribution mechanisms by the compiling packet delivery in each processor into cluster, consequently facilitating in business
It in treatment process, no longer needs to by the compiling packet delivery into corresponding processor, and need to only call in respective processor
Custom algorithm component can be performed quickly in compiling data packet, and then promotes business processing efficiency；The present embodiment is generating certainly
After defining algorithm assembly, custom algorithm component can be provided for user, so that user only needs to select required custom algorithm
Component and layout is carried out to the custom algorithm component of selection, the processing to business can be realized, to realize business processing
Without code, business processing efficiency is promoted.
A kind of nonvolatile computer storage media is provided according to an embodiment of the present invention, and the computer storage is situated between
Matter is stored with an at least executable instruction, which can be performed customized in above-mentioned any means embodiment
The generation method of algorithm assembly.
Fig. 5 shows a kind of structural schematic diagram of the calculating equipment provided according to an embodiment of the present invention, present invention tool
Body embodiment does not limit the specific implementation for calculating equipment.
As shown in figure 5, the calculating equipment may include: processor (processor) 502, communication interface
(Communications Interface) 504, memory (memory) 506 and communication bus 508.
Wherein:
Processor 502, communication interface 504 and memory 506 complete mutual communication by communication bus 508.
Communication interface 504, for being communicated with the network element of other equipment such as client or other servers etc..
Processor 502, for executing program 510, the generation method that can specifically execute above-mentioned custom algorithm component is real
Apply the correlation step in example.
Specifically, program 510 may include program code, which includes computer operation instruction.
Processor 502 may be central processor CPU or specific integrated circuit ASIC (Application
Specific Integrated Circuit), or be arranged to implement the integrated electricity of one or more of the embodiment of the present invention
Road.The one or more processors that equipment includes are calculated, can be same type of processor, such as one or more CPU；It can also
To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 506, for storing program 510.Memory 506 may include high speed RAM memory, it is also possible to further include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 510 specifically can be used for so that processor 502 executes following operation:
Monitoring generates the trigger action of custom algorithm component, obtains user and is compiled according to provided by open system API
Data generate compiling data packet；
By compiling packet delivery into each processor of cluster；
The processing to business is realized in selection and editing operation according to user to custom algorithm component.
In a kind of optional embodiment, program 510 specifically can be used for so that processor 502 executes following operation:
Compiling number is obtained to the compilation operations of at least one Compilation Method of offer by open system API according to user
According to.
In a kind of optional embodiment, at least one Compilation Method of the offer includes: initial method, executes
Method, and/or output method.
In a kind of optional embodiment, program 510 specifically can be used for so that processor 502 executes following operation:
Receive the business scenario configuration information of user's input；
The selection and editing operation of custom algorithm component and business scenario configuration information are realized to industry according to user
The processing of business.
In a kind of optional embodiment, program 510 specifically can be used for so that processor 502 executes following operation:
Selection and editing operation according to user to custom algorithm component determine that the combination of custom algorithm component is closed
System；
The syntagmatic for parsing custom algorithm component, obtains corresponding service logic topological relation；
Task is handled according to the business scenario configuration information and the service logic topological relation creation；
Corresponding computing engines are called to execute processing task.
In a kind of optional embodiment, program 510 specifically can be used for so that processor 502 executes following operation:
For the corresponding authority information of custom algorithm component Configuration；
Judge whether subscriber identity information matches with the corresponding authority information of algorithm assembly of making by oneself, if so, root
The processing to business is realized in selection and editing operation according to user to custom algorithm component.
Algorithm and display are not inherently related to any particular computer, virtual system, or other device provided herein.
Various general-purpose systems can also be used together with teachings based herein.As described above, it constructs required by this kind of system
Structure be obvious.In addition, the present invention is also not directed to any particular programming language.It should be understood that can use various
Programming language realizes summary of the invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention
Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect
Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of any
Can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors
Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice
Microprocessor or digital signal processor (DSP) realize the generating means of custom algorithm component according to embodiments of the present invention
In some or all components some or all functions.The present invention is also implemented as described herein for executing
Some or all device or device programs (for example, computer program and computer program product) of method.In this way
Realization program of the invention can store on a computer-readable medium, or can have the shape of one or more signal
Formula.Such signal can be downloaded from an internet website to obtain, and perhaps be provided on the carrier signal or with any other shape
Formula provides.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability
Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real
It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch
To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame
Claim.
The invention discloses: a kind of generation method of custom algorithm component of A1., comprising:
Monitoring generates the trigger action of custom algorithm component, obtains user and is compiled according to provided by open system API
Data generate compiling data packet；
By compiling packet delivery into each processor of cluster；
The processing to business is realized in selection and editing operation according to user to custom algorithm component.
A2. method according to a1, wherein the acquisition user compiles data according to provided by open system API
Further comprise:
Compiling number is obtained to the compilation operations of at least one Compilation Method of offer by open system API according to user
According to.
A3. the method according to A2, wherein at least one Compilation Method of the offer includes: initial method, holds
Row method, and/or output method.
A4. the method according to any one of A1-A3, wherein the method also includes: receive the business of user's input
Scene configuration information；
The processing of business is further wrapped in the selection and editing operation according to user to custom algorithm component, realization
It includes: the selection and editing operation of custom algorithm component and business scenario configuration information being realized to business according to user
Processing.
A5. method according to a4, wherein described that the selection and layout of custom algorithm component are grasped according to user
Make, realization further comprises to the processing of business:
Selection and editing operation according to user to custom algorithm component determine that the combination of custom algorithm component is closed
System；
The syntagmatic for parsing custom algorithm component, obtains corresponding service logic topological relation；
Task is handled according to the business scenario configuration information and the service logic topological relation creation；
Corresponding computing engines are called to execute processing task.
A6. the method according to any one of A1-A5, wherein the method also includes: for the custom algorithm group
Part configures corresponding authority information；
The processing of business is further wrapped in the selection and editing operation according to user to custom algorithm component, realization
It includes:
Judge whether subscriber identity information matches with the corresponding authority information of algorithm assembly of making by oneself, if so, root
The processing to business is realized in selection and editing operation according to user to custom algorithm component.
The invention also discloses: a kind of generating means of custom algorithm component of B7., comprising:
Generation module obtains user according to open system API suitable for monitoring the trigger action for generating custom algorithm component
Provided compiling data generate compiling data packet；
Distribution module, suitable for packet delivery will be compiled into each processor of cluster；
Processing module realizes the place to business suitable for the selection and editing operation according to user to custom algorithm component
Reason.
B8. the device according to B7, wherein the generation module is further adapted for:
Compiling number is obtained to the compilation operations of at least one Compilation Method of offer by open system API according to user
According to.
B9. the device according to B8, wherein at least one Compilation Method of the offer includes: initial method, holds
Row method, and/or output method.
B10. the device according to any one of B7-B9, wherein described device further include:
Receiving module, suitable for receiving the business scenario configuration information of user's input；
The processing module further comprises: selection and editing operation according to user to custom algorithm component, and
Business scenario configuration information realizes the processing to business.
B11. device according to b10, wherein the processing module further comprises:
Selection and editing operation according to user to custom algorithm component determine that the combination of custom algorithm component is closed
System；
The syntagmatic for parsing custom algorithm component, obtains corresponding service logic topological relation；
Task is handled according to the business scenario configuration information and the service logic topological relation creation；
Corresponding computing engines are called to execute processing task.
B12. the device according to any one of B7-B11, wherein described device further include:
Permission configuration module is suitable for the corresponding authority information of custom algorithm component Configuration；
The processing module is further adapted for: judging whether subscriber identity information with described makes the corresponding power of algorithm assembly by oneself
Limit information matches, if so, selection and editing operation according to user to custom algorithm component, realize the place to business
Reason.
The invention also discloses: a kind of calculating equipment of C13., comprising: processor, memory, communication interface and communication are total
Line, the processor, the memory and the communication interface complete mutual communication by the communication bus；
The memory executes the processor such as storing an at least executable instruction, the executable instruction
The corresponding operation of the generation method of custom algorithm component described in any one of A1-A6.
The invention also discloses a kind of computer storage medium of D14., being stored at least one in the storage medium can be held
Row instruction, the generation side for the custom algorithm component that the executable instruction executes processor as described in any one of A1-A6
The corresponding operation of method.
Claims (10)
1. a kind of generation method of custom algorithm component, comprising:
Monitoring generates the trigger action of custom algorithm component, obtains user and compiles data according to provided by open system API,
Generate compiling data packet；
By compiling packet delivery into each processor of cluster；
The processing to business is realized in selection and editing operation according to user to custom algorithm component.
2. according to the method described in claim 1, wherein, the acquisition user compiles number according to provided by open system API
According to further comprising:
Compiling data are obtained to the compilation operations of at least one Compilation Method of offer by open system API according to user.
3. according to the method described in claim 2, wherein, at least one Compilation Method of the offer include: initial method,
Execution method, and/or output method.
4. method according to any one of claim 1-3, wherein the method also includes: receive the industry of user's input
Business scene configuration information；
The selection and editing operation according to user to custom algorithm component, realization further comprises to the processing of business:
The place to business is realized to the selection and editing operation of custom algorithm component and business scenario configuration information according to user
Reason.
5. described to be grasped according to user to the selection and layout of custom algorithm component according to the method described in claim 4, wherein
Make, realization further comprises to the processing of business:
Selection and editing operation according to user to custom algorithm component, determine the syntagmatic of custom algorithm component；
The syntagmatic for parsing custom algorithm component, obtains corresponding service logic topological relation；
Task is handled according to the business scenario configuration information and the service logic topological relation creation；
Corresponding computing engines are called to execute processing task.
6. method according to any one of claims 1-5, wherein the method also includes: for the custom algorithm
The corresponding authority information of component Configuration；
The selection and editing operation according to user to custom algorithm component, realization further comprises to the processing of business:
Judge whether subscriber identity information matches with the corresponding authority information of algorithm assembly of making by oneself, if so, according to
The processing to business is realized in selection and editing operation of the family to custom algorithm component.
7. a kind of generating means of custom algorithm component, comprising:
Generation module obtains user and is mentioned according to open system API suitable for monitoring the trigger action for generating custom algorithm component
The compiling data of confession generate compiling data packet；
Distribution module, suitable for packet delivery will be compiled into each processor of cluster；
Processing module realizes the processing to business suitable for the selection and editing operation according to user to custom algorithm component.
8. device according to claim 7, wherein the generation module is further adapted for:
Compiling data are obtained to the compilation operations of at least one Compilation Method of offer by open system API according to user.
9. a kind of calculating equipment, comprising: processor, memory, communication interface and communication bus, the processor, the storage
Device and the communication interface complete mutual communication by the communication bus；
The memory executes the processor as right is wanted for storing an at least executable instruction, the executable instruction
Ask the corresponding operation of the generation method of custom algorithm component described in any one of 1-6.
10. a kind of computer storage medium, an at least executable instruction, the executable instruction are stored in the storage medium
Processor is set to execute the corresponding operation of generation method such as custom algorithm component of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811243202.3A CN109343856A (en) | 2018-10-24 | 2018-10-24 | The generation method and device of custom algorithm component |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811243202.3A CN109343856A (en) | 2018-10-24 | 2018-10-24 | The generation method and device of custom algorithm component |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109343856A true CN109343856A (en) | 2019-02-15 |
Family
ID=65311933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811243202.3A Pending CN109343856A (en) | 2018-10-24 | 2018-10-24 | The generation method and device of custom algorithm component |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109343856A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111538493A (en) * | 2020-04-28 | 2020-08-14 | 京东数字科技控股有限公司 | Streaming data processing method, system, storage medium and electronic equipment |
| CN112764721A (en) * | 2021-01-15 | 2021-05-07 | 南京中兴力维软件有限公司 | Data processing method, device, system and computer readable storage medium |
| CN113360201A (en) * | 2020-03-06 | 2021-09-07 | 北京沃东天骏信息技术有限公司 | Calculation task obtaining method and device, storage medium and electronic equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080215405A1 (en) * | 2007-03-01 | 2008-09-04 | Microsoft Corporation | Component based applications running in a common shell |
| CN103294475A (en) * | 2013-06-08 | 2013-09-11 | 北京邮电大学 | Automatic service generating system and automatic service generating method both of which are based on imaging service scene and field template |
| CN106020811A (en) * | 2016-05-13 | 2016-10-12 | 乐视控股（北京）有限公司 | Development method and device of algorithm model |
| CN107133029A (en) * | 2017-03-30 | 2017-09-05 | 武汉斗鱼网络科技有限公司 | Personalization component implementation method and device |
| CN107577515A (en) * | 2017-10-10 | 2018-01-12 | 北京小度信息科技有限公司 | Extended method, device, electronic equipment and the storage medium of visualization component |
| CN107645557A (en) * | 2017-09-29 | 2018-01-30 | 厦门大宛科技有限公司 | A kind of integrated application system based on Service Component |
| CN107645508A (en) * | 2017-10-16 | 2018-01-30 | 深圳市买买提乐购金融服务有限公司 | A kind of data handling system, method, client and server |
-
2018
- 2018-10-24 CN CN201811243202.3A patent/CN109343856A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080215405A1 (en) * | 2007-03-01 | 2008-09-04 | Microsoft Corporation | Component based applications running in a common shell |
| CN103294475A (en) * | 2013-06-08 | 2013-09-11 | 北京邮电大学 | Automatic service generating system and automatic service generating method both of which are based on imaging service scene and field template |
| CN106020811A (en) * | 2016-05-13 | 2016-10-12 | 乐视控股（北京）有限公司 | Development method and device of algorithm model |
| CN107133029A (en) * | 2017-03-30 | 2017-09-05 | 武汉斗鱼网络科技有限公司 | Personalization component implementation method and device |
| CN107645557A (en) * | 2017-09-29 | 2018-01-30 | 厦门大宛科技有限公司 | A kind of integrated application system based on Service Component |
| CN107577515A (en) * | 2017-10-10 | 2018-01-12 | 北京小度信息科技有限公司 | Extended method, device, electronic equipment and the storage medium of visualization component |
| CN107645508A (en) * | 2017-10-16 | 2018-01-30 | 深圳市买买提乐购金融服务有限公司 | A kind of data handling system, method, client and server |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113360201A (en) * | 2020-03-06 | 2021-09-07 | 北京沃东天骏信息技术有限公司 | Calculation task obtaining method and device, storage medium and electronic equipment |
| CN111538493A (en) * | 2020-04-28 | 2020-08-14 | 京东数字科技控股有限公司 | Streaming data processing method, system, storage medium and electronic equipment |
| CN112764721A (en) * | 2021-01-15 | 2021-05-07 | 南京中兴力维软件有限公司 | Data processing method, device, system and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109324793A (en) | Support the processing system and method for algorithm assembly | |
| CN109445797A (en) | Handle task executing method and device | |
| WO2021114530A1 (en) | Hardware platform specific operator fusion in machine learning | |
| US20190324772A1 (en) | Method and device for processing smart contracts | |
| CN109445774A (en) | Method for processing business and device based on pelization operation | |
| CN107450972A (en) | A kind of dispatching method, device and electronic equipment | |
| US10509683B2 (en) | Modeling resource usage for a job | |
| CN109791492B (en) | Pipeline dependency tree query optimizer and scheduler | |
| CN111459621B (en) | Cloud simulation integration and scheduling method and device, computer equipment and storage medium | |
| CN109343856A (en) | The generation method and device of custom algorithm component | |
| CN109189572B (en) | Resource estimation method and system, electronic equipment and storage medium | |
| US20160292581A1 (en) | Minimized processing of streaming changes into a semantic reasoner | |
| CN112748993A (en) | Task execution method and device, storage medium and electronic equipment | |
| Deng et al. | A model-based synthesis flow for automotive CPS | |
| EP1548581A2 (en) | Methods, apparatus and programs for system development | |
| CN104407968B (en) | A kind of method that the code command longest run time is calculated by static analysis | |
| CN109634714A (en) | A kind of method and device of intelligent scheduling | |
| KR101294708B1 (en) | Behavior fallacy analysis apparatus and its method | |
| Zhu et al. | Robust and extensible task implementations of synchronous finite state machines | |
| US10547565B2 (en) | Automatic determination and just-in-time acquisition of data for semantic reasoning | |
| CN109117381A (en) | The adjusting, measuring method and device of processing task | |
| CN117787550A (en) | Index processing method and device based on incremental calculation model and electronic equipment | |
| Kumar et al. | Probabilistic rewrite theories: Unifying models, logics and tools | |
| CN110244954A (en) | A kind of Compilation Method and equipment of application program | |
| CN113704687B (en) | Tensor calculation operation method, device and operation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190215 |
|
| RJ01 | Rejection of invention patent application after publication |