CN112379912B

CN112379912B - Algorithm management method and device, electronic equipment and storage medium

Info

Publication number: CN112379912B
Application number: CN202011280276.1A
Authority: CN
Inventors: 杨雪
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2020-11-16
Filing date: 2020-11-16
Publication date: 2024-05-14
Anticipated expiration: 2040-11-16
Also published as: CN112379912A

Abstract

The application discloses an algorithm management method, a device, electronic equipment and a storage medium, which relate to the technical field of computers, further relate to an algorithm management technology in the technical field of artificial intelligence, can be applied to the technologies such as automatic labeling of data, and comprise the following steps: acquiring an algorithm to be managed through an algorithm management system; under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system, storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm; and uniformly managing each storage algorithm through the algorithm management system. The embodiment of the application can realize unified management of the algorithm, thereby improving the development efficiency and the application efficiency of the algorithm.

Description

Algorithm management method and device, electronic equipment and storage medium

Technical Field

The application relates to the technical field of computers, in particular to an algorithm management technology in the technical field of artificial intelligence.

Background

With the rapid development of computer technology, under the large background of rapid development of global informatization, artificial intelligence leads to a new technological innovation. Currently, artificial intelligence has wide application in a variety of fields, and various types of algorithms can be studied for a particular application field. Different algorithms may be applied to different tools to achieve specific algorithm functions. For example, in the field of automatic labeling, multiple types of automatic labeling algorithms may be designed for each different type of labeling application, such as text labeling, image labeling, audio labeling, and video labeling. Different types of automatic labeling algorithms are typically configured with specialized automatic labeling tools for automatic labeling, one for each automatic labeling algorithm. For example, an image labeling tool can be provided with an image labeling algorithm for automatically labeling an image.

Disclosure of Invention

The embodiment of the application provides an algorithm management method, an algorithm management device, electronic equipment and a storage medium, so that unified management of an algorithm is realized, and the algorithm development efficiency and the application efficiency are improved.

In a first aspect, an embodiment of the present application provides an algorithm management method, including:

Acquiring an algorithm to be managed through an algorithm management system;

Under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system, storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm;

And uniformly managing each storage algorithm through the algorithm management system.

In a second aspect, an embodiment of the present application provides an algorithm management apparatus, including:

the algorithm to be managed acquisition module is used for acquiring an algorithm to be managed through the algorithm management system;

The storage algorithm acquisition module is used for storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system;

And the storage algorithm management module is used for uniformly managing each storage algorithm through the algorithm management system.

In a third aspect, an embodiment of the present application provides an electronic device, including:

at least one processor; and

A memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the algorithm management method provided by the embodiments of the first aspect.

In a fourth aspect, embodiments of the present application also provide a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the algorithm management method provided by the embodiments of the first aspect.

According to the embodiment of the application, under the condition that the acquired algorithm to be managed accords with the algorithm management standard of the algorithm management system, the algorithm to be managed is stored in the algorithm management system to obtain at least one storage algorithm, so that the storage algorithms are uniformly managed by the algorithm management system, the problems of low development efficiency, low application efficiency and the like caused by the fact that the algorithms in the same technical field cannot be uniformly managed in the prior art are solved, and therefore the algorithm development efficiency and the application efficiency are improved.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The drawings are included to provide a better understanding of the present application and are not to be construed as limiting the application. Wherein:

FIG. 1 is a flow chart of an algorithm management method provided by an embodiment of the present application;

FIG. 2 is a flowchart of an algorithm management method according to an embodiment of the present application;

FIG. 3 is a block diagram of an algorithm management device according to an embodiment of the present application;

Fig. 4 is a schematic structural diagram of an electronic device for implementing the algorithm management method according to the embodiment of the present application.

Detailed Description

Exemplary embodiments of the present application will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present application are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In one example, fig. 1 is a flowchart of an algorithm management method according to an embodiment of the present application, where the method may be implemented by an algorithm management device, and the device may be implemented by software and/or hardware and may be generally integrated in an electronic device, where the algorithm management system is used to perform unified management on an algorithm. The electronic device may be a type of device such as a computer. Accordingly, as shown in fig. 1, the method includes the following operations:

S110, acquiring an algorithm to be managed through an algorithm management system.

The algorithm management system may be a system for uniformly managing the preset type algorithm, and may be a software type framework system. The preset type of algorithm may be an algorithm with a similar function type, i.e. the functions of the algorithms are similar. For example, the algorithms are all automatic labeling algorithms for labeling various types of data. Or the algorithms are all image recognition algorithms, and are used for carrying out image recognition on images by adopting different means, for example, algorithms for carrying out image recognition by adopting different types of convolutional neural models. The embodiment of the application does not limit the specific algorithm type of the preset type algorithm. The algorithm to be managed may be an algorithm that needs to be stored in an algorithm management system to be uniformly managed by the algorithm management system. Similarly, the embodiment of the application does not limit the specific algorithm type of the algorithm to be managed.

In the embodiment of the application, the algorithm to be managed can be acquired through the algorithm management system so as to uniformly manage the acquired algorithm to be managed.

And S120, under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system, storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm.

The algorithm management standard may be a management standard pre-constructed by the algorithm management system, and is used for providing a set of general storage templates for storing the algorithm to be managed so as to store the algorithm to be managed. The embodiment of the application does not limit the specific content of the algorithm management standard. The storage algorithm can be an algorithm which is generated correspondingly after the algorithm to be managed is stored in the algorithm management system.

Accordingly, after the algorithm to be managed is acquired by the algorithm management system, it may be first determined whether the algorithm to be managed meets the algorithm management standard of the algorithm management system. If the algorithm to be managed is determined to accord with the algorithm management standard of the algorithm management system, the algorithm to be managed can be stored in the algorithm management system to obtain a storage algorithm corresponding to the algorithm to be managed; otherwise, if the algorithm to be managed does not accord with the algorithm management standard of the algorithm management system, the algorithm to be managed is refused to be stored in the algorithm management system. Various types of algorithms to be managed can be accessed into the algorithm management system according to the storage flow. Thus, the algorithm management system may store multiple types of storage algorithms.

It can be appreciated that, since the algorithm management system simply performs a storage operation on the algorithm to be managed in the algorithm storage stage. Thus, the storage algorithm is essentially the same algorithm as the algorithm to be managed, and the actual content of the algorithm does not change substantially.

It follows that not all algorithms may be stored by the algorithm management system. The algorithm to be managed is stored only if the algorithm to be managed meets the algorithm management standard of the algorithm management system. The algorithm management criteria may be set for a particular function type, such as an automatic labeling function or an image recognition function. When the algorithm management standard of the algorithm management system is accurate, a technician can develop an algorithm matching the algorithm management standard according to the algorithm management standard. After the algorithm is successfully developed, the algorithm can be used as an algorithm to be managed to request access to an algorithm management system.

S130, uniformly managing each storage algorithm through the algorithm management system.

In the embodiment of the application, after the algorithm management system acquires a certain number of storage algorithms, the storage algorithms can be uniformly managed. The unified management may be, for example, unified management of algorithm base data of each algorithm, control of batch activation or deactivation of certain storage algorithms, and the like.

It will be appreciated that since the algorithm management criteria of the algorithm management system are set for a particular function type, the algorithm management system can unify services for the algorithm application tools for that particular function type. Alternatively, the algorithm application tool may include, but is not limited to, an automatic labeling tool, an image recognition tool, a face recognition tool, or the like. In the embodiment of the application, since each storage algorithm meets the algorithm management standard of the algorithm management system, the application standard of each storage algorithm relative to the algorithm application tool is the same. In this manner, different stored algorithms may be applied to different algorithm application tools simultaneously. For example, the algorithm management system may recommend a variety of available automatic labeling algorithms to the automatic labeling tool, the application of such recommended algorithms actually belonging to a unified management operation on the storage algorithm.

It should be noted that in the prior art, one type of algorithm is often only bound to one algorithm application tool. Every development of a new algorithm requires the simultaneous development of an algorithm application tool bound with the algorithm, no matter how much development is needed for the configuration of the algorithm and the operation interaction of the front display interface in the background of the algorithm application tool, the cost of the algorithm access tool is high, the development efficiency and the application efficiency of the algorithm are low, and the same management cannot be realized by the algorithm with the same function type. For example, an image annotation algorithm is bound to an image annotation tool, which can only be applied to the image annotation tool, but not to other image annotation tools or other types of annotation tools. More specifically, the continuous image labeling algorithm is bound with the labeling tool of the label frame, the continuous image semantic algorithm is bound with the labeling tool of the label region, and the continuous image labeling algorithm and the continuous image semantic algorithm both belong to the labeling algorithms, so that the same labeling algorithms are bound in different labeling tools to be applied, and great inconvenience is brought to unified management operations such as algorithm upgrading and the like.

The algorithm management method provided by the embodiment of the application can effectively solve the technical problems. The continuous image labeling number algorithm and the continuous image semantic algorithm corresponding to the image labeling tool both accord with the algorithm management standard of the algorithm management system and are stored in the algorithm management system, and the algorithm management standard is set for the unified labeling requirement of the automatic labeling tool. Therefore, the continuous image labeling algorithm and the continuous image semantic algorithm can be applied to the same image labeling tool, and can be also applied to the video labeling tool when the continuous image labeling algorithm and the continuous image semantic algorithm can be applied to video labeling. Therefore, when a technician develops a new image marking algorithm according to the algorithm management standard and is used as an algorithm to be managed to access an algorithm management system, the new image marking algorithm can be applied to any type of image marking tool through the algorithm management system, or can also be applied to other types of marking tools according to actual functions, the new image marking tool does not need to be developed again for the new image marking algorithm, and operations such as function debugging and the like do not need to be performed on the new image marking algorithm for the new image marking tool, so that the development efficiency of the algorithm is improved. Meanwhile, the new image labeling algorithm can be rapidly applied to the existing image labeling tool, so that the application efficiency of the algorithm is improved.

In an example, fig. 2 is a flowchart of an algorithm management method provided by the embodiment of the present application, and on the basis of the technical solutions of the foregoing embodiments, an implementation manner is provided in which an algorithm management system is constructed, the algorithms to be managed are stored in the algorithm management system, and multiple specific alternative implementations of unified management of each of the storage algorithms by the algorithm management system.

An algorithm management method as shown in fig. 2, comprising:

S210, determining the algorithm management standard; wherein the algorithm management standard is used for managing a preset type algorithm.

It will be appreciated that the algorithm management system first needs to be built before the storage algorithms are uniformly managed by the algorithm management system. In the embodiment of the application, before the algorithm management system is built, the algorithm management standard matched with the algorithm management system needs to be determined first.

For example, assuming that algorithm management criteria are determined from the automatic labeling tool, the determined algorithm management criteria may be used to manage the automatic labeling algorithm. Assuming that the algorithm management criteria are determined from the image recognition tool, the determined algorithm management criteria may be used to manage the image recognition algorithm. Assuming that algorithm management criteria are determined from the face recognition tool, the determined algorithm management criteria may be used to manage the face recognition algorithm. That is, it is required that the algorithm management system performs unified management for the type of algorithm corresponding to the type of algorithm application tool, that is, the matched algorithm management standard can be determined according to the type of algorithm application tool.

S220, constructing an algorithm management system matched with the preset type algorithm according to the algorithm management standard.

Correspondingly, after the algorithm management standard is determined, an algorithm management system matched with the preset type algorithm can be constructed according to the determined algorithm management standard. Through the predetermined algorithm management standard, and then the algorithm management system is built according to the determined algorithm management standard, the built algorithm management system can perform unified management on the preset type algorithm of the same function type which accords with the algorithm management standard.

In an alternative embodiment of the present application, the algorithm management criteria may include, but are not limited to: algorithm application scene, algorithm access format and algorithm application authority.

The algorithm application scene is the application scene of the preset type algorithm. By way of example, algorithm application scenarios may include, but are not limited to, automatic annotation scenarios, image recognition scenarios, face recognition scenarios, and the like. The algorithm application scene can be set according to actual requirements, and the embodiment of the application does not limit the specific scene type of the algorithm application scene. The algorithm access format may be an interface format requirement for storing the algorithm in the algorithm management system, may include, but is not limited to, data format requirements for storing inputs and outputs of the algorithm, and the like. Algorithm application rights may include, but are not limited to, management rights and usage rights to store the algorithm, and the like. Wherein the management authority, i.e. the constraint of the management functions of the storage algorithm by the use roles of the different algorithms is contracted. For example, a team leader may have all of the administrative rights to the storage algorithm, such as performing a censoring or the like on the storage algorithm. A common team member may have administrative rights to view the storage algorithm. The usage rights may be rights set by the storage algorithm at the time of a specific application. Usage rights may include, but are not limited to, whether an algorithm is developed, the concurrency of the algorithm, etc. The embodiment of the application does not limit the specific authority content of the algorithm application authority.

It should be noted that the algorithm application scenario may be a wide range of application scenarios, such as an automatic labeling scenario, an image recognition scenario, and a face recognition scenario. And the method can also comprise a plurality of application scenes with smaller ranges, and each application scene with smaller range belongs to a lower application scene under the application scene with larger range. For example, the algorithm application scene may further include a data preprocessing scene (such as a data cleaning scene of image, text or video data), an image annotation scene, a voice annotation scene, a video annotation scene, a text annotation scene, a web page annotation scene, and the like. These annotation scenes all belong to the automatic annotation scene.

The unified standard of the algorithm to be managed for accessing the algorithm management system can be effectively constrained by determining the content of the algorithm management standard such as the algorithm application scene, the algorithm access format, the algorithm application authority and the like, so that the storage algorithm in the algorithm management system can be the algorithm with the same function type.

S230, acquiring an algorithm to be managed through an algorithm management system.

And S240, under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system, storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm.

In an optional embodiment of the present application, the storing the algorithm to be managed in the algorithm management system may include: determining a target algorithm application scene of the algorithm to be managed according to the algorithm application scene of the algorithm management standard, and establishing a first mapping relation between the algorithm to be managed and the target algorithm application scene; determining a target algorithm access format of the algorithm to be managed according to the algorithm access format of the algorithm management standard, and establishing a second mapping relation between the algorithm to be managed and the target algorithm access format; determining a target algorithm application authority of the algorithm to be managed according to the algorithm application authority of the algorithm management standard, and establishing a third mapping relation between the algorithm to be managed and the target algorithm application authority; and storing the algorithm to be managed according to the first mapping relation, the second mapping relation and the third mapping relation.

The target algorithm application scene may be an algorithm application scene to be matched with the management algorithm. The first mapping relationship may be a mapping relationship between an algorithm to be managed and a target algorithm application scenario. The target algorithm access format may be an algorithm access format to be managed for algorithm matching. The second mapping relationship may be a mapping relationship between the algorithm to be managed and the target algorithm access format. The target algorithm application authority may be an algorithm application authority to be matched with the algorithm to be managed. The third mapping relationship may be a mapping relationship between the algorithm to be managed and the target algorithm application authority.

In the embodiment of the application, when the algorithm to be managed is stored in the algorithm management system, the information such as the algorithm application scene, the algorithm access format, the algorithm application authority and the like corresponding to the algorithm to be managed can be determined according to the algorithm management standard, and the algorithm to be managed is stored according to the determined information.

Specifically, a target algorithm application scene of an algorithm to be managed can be determined through the algorithm application scene in the algorithm management standard, and a first mapping relation between the algorithm to be managed and the target algorithm application scene is established. For example, assuming that the algorithm application scene includes an image annotation scene, a voice annotation scene, a video annotation scene, a text annotation scene, and a web page annotation scene, if the algorithm to be managed is an automatic annotation image algorithm, the image annotation scene and/or the video annotation scene may be selected as a target algorithm application scene, and a first mapping relationship between the algorithm to be managed and the target algorithm application scene is generated. For example, assume that the algorithmic access format includes an input data format of images, audio, video, text, and web pages, and an output data format of numbered images. If the algorithm to be managed is an automatic annotation image algorithm, an image and/or a video can be selected as an input data format in a target algorithm access format, a numbered image is used as an output data format in the target algorithm access format, and a second mapping relation between the algorithm to be managed and the target algorithm access format is generated. The target algorithm access format of the algorithm to be managed can be further determined through the algorithm access format in the algorithm management standard, and a first mapping relation between the algorithm to be managed and the target algorithm access format is established. The target algorithm application permission of the algorithm to be managed can be further determined through the algorithm application permission in the algorithm management standard, and a first mapping relation between the algorithm to be managed and the target algorithm application permission is established. For example, assuming that the algorithm application permission includes whether to open and concurrency setting, if the algorithm to be managed is an automatic image labeling algorithm, an "algorithm open" and a "concurrency of 2" may be selected as the target algorithm application permission, and a third mapping relationship between the algorithm to be managed and the target algorithm application permission is generated. After the first mapping relation, the second mapping relation and the third mapping relation are generated, the algorithm to be managed can be stored according to the first mapping relation, the second mapping relation and the third mapping relation, and a corresponding storage algorithm is generated. Taking the above example as an example, assuming that the algorithm to be managed is an automatic image labeling algorithm, the specific content of the algorithm management standard of the storage algorithm corresponding to the algorithm to be managed is: the algorithm application scene is an image annotation scene and/or a video annotation scene; the algorithm access format is as follows: the input data format is an image and/or video, and the output data format is a numbered image; the algorithm application authority is as follows: the algorithm is open and concurrency is 2.

The technical scheme realizes the determination of the algorithm application scene, the algorithm access format and the algorithm application authority of the algorithm to be managed according to the algorithm management standard, and can realize the storage of the algorithm to be managed to the algorithm management system under the condition that the algorithm to be managed is determined to meet the algorithm management standard so as to ensure that the corresponding formed storage algorithm can meet the requirement of unified management of the algorithm management system.

S250, uniformly managing each storage algorithm through the algorithm management system.

In an optional embodiment of the present application, the unified management of each storage algorithm by the algorithm management system may include: determining a storage algorithm to be started according to an algorithm starting triggering operation in an algorithm management system; and enabling the to-be-enabled storage algorithm.

Wherein the algorithm-enabled trigger operation may be used to trigger the enabled storage algorithm. The storage algorithm to be enabled may be a storage algorithm that needs to be enabled. It will be appreciated that the current state of the storage algorithm to be enabled in the algorithm management system is a disabled state, i.e. a disabled state. When the storage algorithm to be enabled is enabled, it may be allowed to be applied by the algorithm application tool.

Correspondingly, when the algorithm management system is used for carrying out unified management on each storage algorithm, the algorithm management system can capture the algorithm starting triggering operation of the algorithm management system in real time, and when the algorithm starting triggering operation is determined to be captured, the storage algorithm to be started is determined, and starting processing is carried out on the storage algorithm to be started, so that unified starting management on the storage algorithm in the algorithm management system can be realized.

In one illustrative example, the algorithm management system may set an algorithm enabling function to the system itself alone. When a user manages the storage algorithms in batches by using the algorithm management system, one or more storage algorithms can be selected, and an algorithm enabling function is triggered to perform batch enabling operation on the selected storage algorithms. At this time, the algorithm management system may capture the algorithm enabling trigger operation of itself in real time, and when determining that the algorithm enabling trigger operation is detected, determine one or more to-be-enabled storage algorithms selected by the algorithm enabling trigger operation, and enable the to-be-enabled storage algorithms to be storage algorithms that can be normally used.

In an optional embodiment of the present application, the unified management of each storage algorithm by the algorithm management system may include: determining a data object to be processed according to an algorithm enabling triggering operation in an algorithm application tool; determining a data processing standard of the data object to be processed; wherein the data processing standard comprises a data application scene and data processing matters; selecting at least one target storage algorithm from the storage algorithms according to the data processing standard; recommending each target storage algorithm to the algorithm application tool to serve as a data processing algorithm of the data object to be processed in the algorithm application tool; wherein the algorithm management system is communicatively coupled to the algorithm application tool.

The data object to be processed may be a data object in an algorithm application tool, which needs to use a storage algorithm for data processing. The data processing criteria may be a default data processing requirement for the data object to be processed. Optionally, the data processing criteria include a data application scenario and a data processing item. The data application scene is a specific application scene of the data object to be processed, and the data processing item can be specific data processing content of the data object to be processed. The target storage algorithm may be a storage algorithm adapted for data processing of the data object to be processed.

When the method is specifically applied, communication connection between the algorithm management system and the algorithm application tool can be established, and the algorithm management system can capture the algorithm starting trigger operation used for starting the storage algorithm in the algorithm application tool in real time so as to determine the data object to be processed in the algorithm application tool according to the algorithm starting trigger operation. After the data object to be processed is determined, at least one target storage algorithm can be selected from the storage algorithms according to the data processing labels such as the data application scene and the data processing items of the data object to be processed, and the target storage algorithms are recommended to the algorithm application tool. The algorithm application tool may use any one of the target storage algorithms to perform data processing on the data object to be processed.

In one illustrative example, the algorithm management system may capture in real-time an algorithm enablement trigger operation in the algorithm application tool as the user processes data through the algorithm application tool after the algorithm application tool is enabled. For example, when the user marks a frame of "car" in the image by using the marking tool, if the user selects a certain "car" in the image, the algorithm management system may use the "car" selected by the user as the data object to be processed. The algorithm management system may re-predict the type of data object to be processed to determine the data processing criteria for the data object to be processed. For example, the data application scene of the car is determined to be an image annotation scene, and the data processing item is automatically annotated to the car. At this time, the algorithm management system may select at least one algorithm capable of performing automatic image labeling from the storage algorithms as a target storage algorithm and recommend the target storage algorithm to the algorithm application tool. The user can select a most reasonable algorithm from all target storage algorithms according to the actual requirements of the project, and the data in the algorithm application tool is automatically marked and processed.

It should be noted that, the links for storing the algorithm enablement for the algorithm application tool may also be set in various application links. For example, when the application scene requirement is to put in data, the data is given a pre-recognition result with a certain precision by using an algorithm, and according to the requirement, a target storage algorithm can be recommended for an algorithm application tool through an algorithm management system in a data pre-processing link. The embodiment of the application does not limit the time when the algorithm starts the triggering operation and the recommended link of the target storage algorithm.

According to the technical scheme, the algorithm management system recommends an available storage algorithm to the algorithm application tool to process the data object to be processed in the algorithm application tool, so that unified enabling management of the storage algorithm in the algorithm application tool can be realized.

In an optional embodiment of the present application, the unified management of each storage algorithm by the algorithm management system may include: determining a storage algorithm to be deactivated according to an algorithm application tool or an algorithm deactivation triggering operation in the algorithm management system; and performing disabling processing on the storage algorithm to be disabled.

Wherein the algorithm deactivation trigger operation may be used to deactivate the storage algorithm. The deactivation mode of the storage algorithm can comprise a permanent deactivation mode and a suspension mode. Permanently deactivated storage algorithms cannot be re-activated and suspended storage algorithms can be re-activated. The storage algorithm to be deactivated may be a storage algorithm requiring a deactivation process.

Correspondingly, when the algorithm management system is used for carrying out unified management on each storage algorithm, the algorithm management system can capture the algorithm deactivation trigger operation in the algorithm management system or the algorithm application tool in real time, and when the algorithm deactivation trigger operation is determined to be captured, the storage algorithm to be deactivated is determined, and the storage algorithm to be deactivated is subjected to deactivation processing, so that unified activation management on the storage algorithm in the algorithm management system and the algorithm application tool can be realized.

In one illustrative example, the algorithm management system may set an algorithm deactivation function for the system itself alone. When the user uses the algorithm management system to deactivate the storage algorithms in batches, one or more storage algorithms to be deactivated can be selected, and the algorithm deactivation function is triggered to perform batch deactivation operation on the selected storage algorithms. At this time, the algorithm management system may capture its own algorithm deactivation trigger operation in real time, and when it is determined that the algorithm deactivation trigger operation is detected, determine one or more storage algorithms to be deactivated selected by the algorithm deactivation trigger operation, and perform a deactivation process on the one or more storage algorithms, including a permanent deactivation process and/or a suspension process, to prohibit normal use of the deactivated storage algorithms.

In one illustrative example, after the algorithm application tool is enabled, the user may also deactivate the stored algorithm in the algorithm management system through the algorithm application tool. When the user deactivates the storage algorithm by using the algorithm application tool, the storage algorithm currently used in the algorithm application tool can be selected as the storage algorithm to be deactivated, and the algorithm deactivation function is triggered to perform the deactivation operation on the selected storage algorithm. At this time, the algorithm management system may capture the algorithm deactivation trigger operation in the algorithm application tool in real time, and when determining that the algorithm deactivation trigger operation is detected, determine a storage algorithm to be deactivated selected by the algorithm deactivation trigger operation, and perform a deactivation process on the storage algorithm, including a permanent deactivation process and/or a suspension process, to prohibit normal use of the storage algorithm subjected to the deactivation process. It should be noted that, the disabling process may be applied to each link of the algorithm application tool to data processing, such as a pre-processing link or a normal processing link, which is not limited in the embodiment of the present application.

In an optional embodiment of the present application, the unified management of each storage algorithm by the algorithm management system may include: evaluating the algorithm effect of each storage algorithm through the algorithm management system; or, uniformly managing the algorithm basic data of each storage algorithm through the algorithm management system.

The algorithm basic data may be basic data of a storage algorithm, for example, basic data such as creation time, creator, algorithm use, etc. of the storage algorithm.

Because each storage algorithm stored in the algorithm management system accords with the algorithm management standard and belongs to the algorithm type with similar functions, the algorithm effect of each storage algorithm can be evaluated through the algorithm management system so as to carry out comparison evaluation on the performance of each storage algorithm. For example, algorithm performance data such as accuracy and recall rate of the storage algorithm with the same application scene can be compared and evaluated. Or the algorithm basic data of each storage algorithm can be uniformly managed through the algorithm management system. For example. And performing addition, deletion, correction and check management on algorithm basic data of the storage algorithm, or performing algorithm upgrading processing on the storage algorithm. It should be noted that, the code of the storage algorithm may also be modified by the algorithm management system, and the embodiment of the present application does not limit the unified management manner of the storage algorithm by the algorithm management system.

According to the technical scheme, the algorithm application scene, the algorithm access format and the algorithm application authority of the algorithm to be managed are determined according to the algorithm management standard, so that the algorithm to be managed is stored in the algorithm management system according to the unified management standard, and the algorithm management system is used for carrying out starting processing, stopping processing, algorithm effect evaluation or unified management of algorithm basic data and the like on the stored algorithm, so that the algorithm development efficiency and the application efficiency can be improved, and the algorithm management cost can be reduced.

In an example, fig. 3 is a block diagram of an algorithm management device according to an embodiment of the present application, where the embodiment of the present application is applicable to a case where an algorithm management system is used to perform unified management on an algorithm, where the device is implemented by software and/or hardware, and is specifically configured in an electronic device. The electronic device may be a type of device such as a computer.

An algorithm management device 300 as shown in fig. 3, comprising: the algorithm to be managed acquisition module 310, the storage algorithm acquisition module 320, and the storage algorithm management module 330. Wherein,

The algorithm to be managed obtaining module 310 is configured to obtain an algorithm to be managed through an algorithm management system;

A storage algorithm obtaining module 320, configured to store the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm when it is determined that the algorithm to be managed meets an algorithm management standard of the algorithm management system;

and the storage algorithm management module 330 is configured to perform unified management on each storage algorithm through the algorithm management system.

Optionally, the algorithm management device 300 further includes: the algorithm management standard determining module is used for determining the algorithm management standard; the algorithm management standard is used for managing a preset type algorithm; and the algorithm management system construction module is used for constructing an algorithm management system matched with the preset type algorithm according to the algorithm management standard.

Optionally, the algorithm management criteria include: algorithm application scene, algorithm access format and algorithm application authority.

Optionally, the storage algorithm acquisition module 320 is specifically configured to: determining a target algorithm application scene of the algorithm to be managed according to the algorithm application scene of the algorithm management standard, and establishing a first mapping relation between the algorithm to be managed and the target algorithm application scene; determining a target algorithm access format of the algorithm to be managed according to the algorithm access format of the algorithm management standard, and establishing a second mapping relation between the algorithm to be managed and the target algorithm access format; determining a target algorithm application authority of the algorithm to be managed according to the algorithm application authority of the algorithm management standard, and establishing a third mapping relation between the algorithm to be managed and the target algorithm application authority; and storing the algorithm to be managed according to the first mapping relation, the second mapping relation and the third mapping relation.

Optionally, the storage algorithm management module 330 is specifically configured to: determining a storage algorithm to be started according to an algorithm starting triggering operation in an algorithm management system; and enabling the to-be-enabled storage algorithm.

Optionally, the storage algorithm management module 330 is specifically configured to: determining a data object to be processed according to an algorithm enabling triggering operation in an algorithm application tool; determining a data processing standard of the data object to be processed; wherein the data processing standard comprises a data application scene and data processing matters; selecting at least one target storage algorithm from the storage algorithms according to the data processing standard; recommending each target storage algorithm to the algorithm application tool to serve as a data processing algorithm of the data object to be processed in the algorithm application tool; wherein the algorithm management system is communicatively coupled to the algorithm application tool.

Optionally, the storage algorithm management module 330 is specifically configured to: determining a storage algorithm to be deactivated according to an algorithm application tool or an algorithm deactivation triggering operation in the algorithm management system; and performing disabling processing on the storage algorithm to be disabled.

Optionally, the storage algorithm management module 330 is specifically configured to:

optionally, evaluating the algorithm effect of each storage algorithm by the algorithm management system; or, uniformly managing the algorithm basic data of each storage algorithm through the algorithm management system.

Optionally, the algorithm application tool includes an automatic labeling tool, an image recognition tool, or a face recognition tool.

The algorithm management device can execute the algorithm management method provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method. Technical details not described in detail in this embodiment may be referred to the algorithm management method provided in any embodiment of the present application.

Since the algorithm management apparatus described above is an apparatus capable of executing the algorithm management method in the embodiment of the present application, a person skilled in the art will be able to understand the specific implementation of the algorithm management apparatus of the embodiment and various modifications thereof based on the algorithm management method described in the embodiment of the present application, so how the algorithm management apparatus implements the algorithm management method in the embodiment of the present application will not be described in detail herein. The device adopted by the algorithm management method in the embodiment of the application belongs to the scope of protection required by the application as long as the person skilled in the art implements the algorithm management method.

In one example, the present application also provides an electronic device and a readable storage medium.

Fig. 4 is a schematic structural diagram of an electronic device for implementing the algorithm management method according to the embodiment of the present application. As shown in fig. 4, there is a block diagram of an electronic device of an algorithm management method according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the applications described and/or claimed herein.

As shown in fig. 4, the electronic device includes: one or more processors 401, memory 402, and interfaces for connecting the components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the electronic device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 401 is illustrated in fig. 4.

Memory 402 is a non-transitory computer readable storage medium provided by the present application. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the algorithm management method provided by the present application. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to execute the algorithm management method provided by the present application.

The memory 402 is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the to-be-managed algorithm acquisition module 310, the storage algorithm acquisition module 320, and the storage algorithm management module 330 shown in fig. 3) corresponding to the algorithm management method in the embodiment of the present application. The processor 401 executes various functional applications of the server and data processing, i.e., implements the algorithm management method in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 402.

Memory 402 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created by use of an electronic device implementing the algorithm management method, and the like. In addition, memory 402 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 402 may optionally include memory located remotely from processor 401, which may be connected via a network to an electronic device implementing the algorithm management method. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic device implementing the algorithm management method may further include: an input device 403 and an output device 404. The processor 401, memory 402, input device 403, and output device 404 may be connected by a bus or otherwise, for example in fig. 4.

The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of an electronic device implementing the algorithm management method, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick, etc. input devices. The output device 404 may include a display apparatus, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibration motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.

Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASIC (application specific integrated circuit), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

These computing programs (also referred to as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client may be, but is not limited to, a smart phone, a notebook computer, a desktop computer, a tablet computer, a smart speaker, etc. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud computing, cloud service, cloud database, cloud storage and the like. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present application may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed embodiments are achieved, and are not limited herein.

The above embodiments do not limit the scope of the present application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the scope of the present application.

Claims

1. An algorithm management method, comprising:

Acquiring an algorithm to be managed through an algorithm management system;

Under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system, storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm; wherein the algorithm management criteria are matched with an algorithm application tool;

the algorithm management system is used for carrying out unified management on each storage algorithm;

wherein the unified management of each storage algorithm by the algorithm management system includes:

Determining a data object to be processed according to an algorithm enabling triggering operation in an algorithm application tool;

Determining a data processing standard of the data object to be processed; wherein the data processing standard comprises a data application scene and data processing matters;

Selecting at least one target storage algorithm from the storage algorithms according to the data processing standard;

recommending each target storage algorithm to the algorithm application tool to serve as a data processing algorithm of the data object to be processed in the algorithm application tool;

Wherein the algorithm management system is communicatively coupled to the algorithm application tool.

2. The method of claim 1, further comprising:

determining the algorithm management standard; the algorithm management standard is used for managing a preset type algorithm;

And constructing an algorithm management system matched with the preset type algorithm according to the algorithm management standard.

3. The method of claim 1, wherein the algorithm management criteria comprise: algorithm application scene, algorithm access format and algorithm application authority.

4. The method of claim 1, wherein the storing the algorithm to be managed in the algorithm management system comprises:

determining a target algorithm application scene of the algorithm to be managed according to the algorithm application scene of the algorithm management standard, and establishing a first mapping relation between the algorithm to be managed and the target algorithm application scene;

Determining a target algorithm access format of the algorithm to be managed according to the algorithm access format of the algorithm management standard, and establishing a second mapping relation between the algorithm to be managed and the target algorithm access format;

Determining a target algorithm application authority of the algorithm to be managed according to the algorithm application authority of the algorithm management standard, and establishing a third mapping relation between the algorithm to be managed and the target algorithm application authority;

And storing the algorithm to be managed according to the first mapping relation, the second mapping relation and the third mapping relation.

5. The method of claim 1, wherein the unified management of each of the storage algorithms by the algorithm management system comprises:

determining a storage algorithm to be started according to an algorithm starting triggering operation in an algorithm management system;

and enabling the to-be-enabled storage algorithm.

6. The method of claim 1, wherein the unified management of each of the storage algorithms by the algorithm management system comprises:

Determining a storage algorithm to be deactivated according to an algorithm application tool or an algorithm deactivation triggering operation in the algorithm management system;

and performing disabling processing on the storage algorithm to be disabled.

7. The method of claim 1, wherein the unified management of each of the storage algorithms by the algorithm management system comprises:

Evaluating the algorithm effect of each storage algorithm through the algorithm management system; or alternatively, the first and second heat exchangers may be,

And uniformly managing algorithm basic data of each storage algorithm through the algorithm management system.

8. The method of any of claims 1 or 6, wherein the algorithm application tool comprises an automatic labeling tool, an image recognition tool, or a face recognition tool.

9. An algorithm management device comprising:

the storage algorithm acquisition module is used for storing the algorithm to be managed in the algorithm management system to obtain at least one storage algorithm under the condition that the algorithm to be managed accords with the algorithm management standard of the algorithm management system; wherein the algorithm management criteria are matched with an algorithm application tool;

the storage algorithm management module is used for uniformly managing each storage algorithm through the algorithm management system;

the storage algorithm management module is specifically configured to:

10. The apparatus of claim 9, further comprising:

The algorithm management standard determining module is used for determining the algorithm management standard; the algorithm management standard is used for managing a preset type algorithm;

and the algorithm management system construction module is used for constructing an algorithm management system matched with the preset type algorithm according to the algorithm management standard.

11. The apparatus of claim 9, wherein the algorithm management criteria comprise: algorithm application scene, algorithm access format and algorithm application authority.

12. The apparatus of claim 9, wherein the storage algorithm acquisition module is specifically configured to:

13. The apparatus of claim 9, wherein the storage algorithm management module is specifically configured to:

and enabling the to-be-enabled storage algorithm.

14. The apparatus of claim 9, wherein the storage algorithm management module is specifically configured to:

and performing disabling processing on the storage algorithm to be disabled.

15. The apparatus of claim 9, wherein the storage algorithm management module is specifically configured to:

16. The apparatus of any one of claims 9 or 14, wherein the algorithm application tool comprises an automatic labeling tool, an image recognition tool, or a face recognition tool.

17. An electronic device, comprising:

at least one processor; and

A memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the algorithm management method of any one of claims 1-8.

18. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the algorithm management method of any one of claims 1-8.