CN117406982B - Integrated storage and calculation application generation system and method, storage medium and equipment - Google Patents
Integrated storage and calculation application generation system and method, storage medium and equipment Download PDFInfo
- Publication number
- CN117406982B CN117406982B CN202311339594.4A CN202311339594A CN117406982B CN 117406982 B CN117406982 B CN 117406982B CN 202311339594 A CN202311339594 A CN 202311339594A CN 117406982 B CN117406982 B CN 117406982B
- Authority
- CN
- China
- Prior art keywords
- target
- model
- development
- application
- target model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000003860 storage Methods 0.000 title claims abstract description 60
- 238000004364 calculation method Methods 0.000 title claims abstract description 41
- 238000011161 development Methods 0.000 claims abstract description 170
- 238000012549 training Methods 0.000 claims abstract description 24
- 230000006870 function Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 16
- 238000012800 visualization Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 9
- 238000013473 artificial intelligence Methods 0.000 claims description 7
- 238000004088 simulation Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 description 21
- 238000010586 diagram Methods 0.000 description 13
- 230000006872 improvement Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 4
- 230000008676 import Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000010979 ruby Substances 0.000 description 1
- 229910001750 ruby Inorganic materials 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/35—Creation or generation of source code model driven
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/38—Creation or generation of source code for implementing user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Stored Programmes (AREA)
Abstract
The specification discloses a system, a method, a storage medium and equipment for generating a memory and calculation integrated application. The integrative application generation system of the deposit and calculation includes: the system comprises a resource management module, a model development module and an application development module; the resource management module is used for providing an AI model, a model operator, a training data set, a compiler and a development framework; the model development module is used for receiving a model development instruction, judging whether a target model is stored in the resource management module, if yes, calling the target model, otherwise, determining each target model operator selected by a user, constructing a target model based on each target model operator, calling a training data set training target model from the resource management module, and calling a compiler to compile the trained target model; the application development module is used for acquiring application development instructions, automatically generating codes of the development framework, importing the codes into the compiled target model, obtaining target application programs and disposing the target application programs in the integrated storage and calculation equipment.
Description
Technical Field
The present disclosure relates to the field of integrated storage and computing technologies, and in particular, to an integrated storage and computing application generating system, an integrated storage and computing application generating method, an integrated storage medium, and an integrated storage and computing device.
Background
With the development of technology, a memory-computing integrated (Computing in Memory) technology is widely applied to fields such as wearable equipment, intelligent security, mobile terminals, ar\vr and the like, and the memory-computing integrated is embedded with computing capability in a memory so as to execute computing tasks with a new computing architecture.
However, as links such as algorithm training, data set management, operator optimization, compiling, analog simulation, application development and the like are gradually involved in the development process of the integrated application program, the development process of the integrated application program is more complex, development links are all completed by developers through various development tools in the whole process, development efficiency is low, and human resources are seriously wasted.
Therefore, how to simplify and improve the development process of the integrated application program of the memory and improve the development efficiency, thereby reducing the waste of resources is a problem to be solved urgently.
Disclosure of Invention
The present specification provides a system, a method, a storage medium, and a device for generating a unified application for storage and calculation, so as to partially solve the above-mentioned problems existing in the prior art.
The technical scheme adopted in the specification is as follows:
The present specification provides a integrative application generation system of deposit and calculation, the integrative application generation system of deposit and calculation includes: the system comprises a resource management module, a model development module and an application development module;
The resource management module is used for providing a plurality of artificial intelligence AI models, a plurality of model operators, a plurality of training data sets, a development framework and compilers corresponding to different storage and calculation integrated devices;
The model development module is used for receiving a model development instruction, judging whether a target model specified by the model development instruction is stored in the resource management module, if yes, calling the target model from the resource management module, otherwise, responding to the specified operation of a user, determining each target model operator selected by the user, constructing the target model based on each target model operator, calling a training data set specified by the model development instruction from the resource management module to train the target model, and calling a target compiler from the resource management module to compile the trained target model;
the application development module is used for acquiring an application development instruction, generating codes of a development framework corresponding to a target application program according to the application development instruction, importing the codes into a compiled target model, obtaining the target application program, and deploying the target application program in target storage and calculation integrated equipment.
Optionally, the integrated application generation system further includes: an interface visualization module;
The interface visualization module is used for displaying an editing frame to the user, responding to the operation executed by the user in the editing frame, determining a target model operator selected by the user and editing the target model.
Optionally, the interface visualization module is further configured to display a development interface corresponding to a programming language specified by the model development instruction to the user;
And responding to the operation executed by the user in the development interface, and calling a programming component to develop the target model.
Optionally, the integrated application generation system further includes: an operator development module;
The operator development module is used for responding to operator editing operation executed by the user, generating a new model operator and storing the new model operator in the resource management module.
Optionally, the resource management module is further configured to provide simulators corresponding to the plurality of integrated hardware devices;
The model development module is used for determining a target simulator corresponding to the target storage and calculation integrated equipment, and performing simulation on the compiled target model through the target simulator.
Optionally, the application development module is further configured to adjust a code of the target application program based on a preset function requirement, obtain an adjusted application program, and deploy the adjusted application program in the target integrated storage device.
The specification provides a method for generating a memory and calculation integrated application, which comprises the following steps:
Receiving a model development instruction, judging whether a target model specified by the model development instruction is stored in a resource management module, wherein a plurality of artificial intelligence AI models, a plurality of model operators, a plurality of training data sets, a development framework and compilers corresponding to different storage and calculation integrated devices are stored in the resource management module;
If yes, the target model is called from the resource management module, otherwise, each target model operator selected by the user is determined in response to the appointed operation of the user, and the target model is built based on each target model operator;
Invoking a training data set specified by the model development instruction from the resource management module to train the target model;
Invoking a target compiler from the resource management module to compile the trained target model, and acquiring an application development instruction after compiling the target model;
And generating codes of a development framework corresponding to the target application program according to the application development instruction, importing the codes into the compiled target model, obtaining the target application program, and deploying the target application program in target storage and calculation integrated equipment.
Optionally, in response to a specified operation of a user, determining each target model operator selected by the user, and constructing the target model based on each target model operator, including:
if the target model specified by the model development instruction is not stored in the resource management module, displaying an editing frame to the user;
Determining the target model operator selected by the user in response to the operation performed by the user in the editing box;
editing the target model based on the target model operator selected by the user.
Optionally, editing the target model based on the target model operator selected by the user specifically includes:
Displaying a development interface corresponding to the programming language appointed by the model development instruction to the user;
And responding to the operation executed by the user in the development interface, and calling a programming component to develop the target model.
Optionally, the method further comprises:
And generating a new model operator and storing the new model operator in the resource management module in response to operator editing operation performed by the user.
Optionally, the resource management module also stores simulators corresponding to a plurality of integrated hardware devices;
Before generating the code of the development framework corresponding to the target application program according to the application development instruction and importing the code into the compiled target model, the method further comprises:
And determining a target simulator corresponding to the target calculation integrated equipment, and performing simulation on the compiled target model through the target simulator.
Optionally, the target application program is deployed in the target integrated storage device, which specifically includes:
Adjusting the code of the target application program based on the preset function requirement to obtain an adjusted application program;
The present specification provides a computer-readable storage medium storing a computer program which, when executed by a processor, implements the above-described all-in-one application generation method.
The present specification provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the above-described method of generating a unified application when executing the program.
The above-mentioned at least one technical scheme that this specification adopted can reach following beneficial effect:
In the integrated computing application generation system provided in the present specification, the system includes: the system comprises a resource management module, a model development module and an application development module; the resource management module is used for providing an AI model, a model operator, a training data set, a compiler and a development framework; the model development module is used for receiving a model development instruction, judging whether a target model is stored in the resource management module, if yes, calling the target model, otherwise, determining each target model operator selected by a user, constructing a target model based on each target model operator, calling a training data set training target model from the resource management module, and calling a compiler to compile the trained target model; the application development module is used for acquiring application development instructions, automatically generating codes of the development framework, importing the codes into the compiled target model, obtaining target application programs and disposing the target application programs in the integrated storage and calculation equipment.
According to the storage and calculation integrated application generation system, the AI model, the model operator, the training data set, the compiler and the development framework which are needed to be used in the model development and application development processes can be uniformly managed through the resource management module, so that the development of the model and the automatic development of the application program can be realized only by allocating resources stored in the resource management module in the development process, the operation of developers is greatly reduced, the development process of the application program is simplified, and the development efficiency of the application program is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the specification, illustrate and explain the exemplary embodiments of the present specification and their description, are not intended to limit the specification unduly. In the drawings:
FIG. 1 is a schematic diagram of a system for generating a unified memory application provided in the present specification;
FIG. 2 is a schematic flow chart of a method for generating a unified memory application provided in the present specification;
FIG. 3 is a schematic diagram of a model development process provided in the present specification;
FIG. 4 is a schematic illustration of an application development process provided in this specification;
fig. 5 is a schematic view of an electronic device corresponding to fig. 1 provided in the present specification.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the present specification more apparent, the technical solutions of the present specification will be clearly and completely described below with reference to specific embodiments of the present specification and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present specification. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are intended to be within the scope of the present disclosure.
At present, integrative developers often face the following problems: 1. various tools in the development link are messy and complex to use, and lack of the same interface and whole-flow management, so that the development efficiency is influenced. 2. The existing mainstream integrated development environment (INTEGRATED DEVELOPMENT ENVIRONMENT, IDE) supports code editing, testing and debugging of programming languages such as Python, C/C++, and the like, but has limited capability in assisting users in rapid development, such as lack of professional tools and class library support in the field of integrated memory and calculation, database management tools, visual unified interfaces, automatic code generation, and the like.
The following describes in detail the technical solutions provided by the embodiments of the present specification with reference to the accompanying drawings.
FIG. 1 is a schematic diagram of a system for generating a unified application in a unified application generating system, where the system includes: the system comprises a resource management module, a model development module, an application development module, an operator development module and a user management module, wherein the application generation system is provided with an interface visualization module besides an integrated development environment.
The resource management module is configured to provide a plurality of artificial intelligence (ARTIFICIAL INTELLIGENCE, AI) models (such as an image recognition model, a target detection model, a text recognition model, a speech recognition model, a graph calculation model, etc.), a plurality of model operators, a plurality of training data sets, development components corresponding to different programming languages, compilers corresponding to different integrative devices, application development frameworks, simulators corresponding to different integrative hardware devices, and device information (such as model, ID, function, etc.) of each integrative hardware device. Thereby realizing unified management of the data set, the model, the operator and the hardware information through the database.
In practical applications, the types of the integrated storage device (integrated storage machine) may include: the system can be used for computing storage computers, high-performance embedded computers, three-proofing computers, industrial personal computers, high-performance server computers and the like, and is not particularly limited in the specification.
In the present specification, the integrated application generating system may be deployed on a terminal device such as a computer or a server, and in the process of developing an application program, a user (developer) may send a model development instruction to the integrated application generating system through a user management module, and after the model development module receives the model development instruction, may create a model development project and configure a data set.
The model development module may determine an AI model specified by the model development instructions as the target model. And judging whether the target model is stored in the resource management module, and if so, calling the model code of the target model from the resource management module.
If the target model is not stored in the resource management module, the model development module can call the interface visualization module to generate an editing frame through the interface visualization module and display the editing frame to the user.
The editing frame can be provided with model operators provided by the resource management module, a user can select the model operators (such as hooking or dragging the model operators to an editing area in the editing frame), and then the interface visualization module can respond to operations performed by the user in the editing frame, take the model operators selected by the user as target model operators, and construct model codes of a target model based on the target model operators.
After the target model is obtained, the interface visualization module can further display a development interface corresponding to the programming language specified by the current model development instruction to the user, and provide a required development component for the user in the development interface. Through the development components, a user can develop the target model based on each target model operator and edit the model codes of the target model, so that a final target model is constructed.
In practical applications, the programming preamble may include, but is not limited to Python, C, C ++, java, c#, PHP, and JavaScript, but may also include other programming languages, which are not specifically limited in this specification.
It should be noted that, when the resource management module stores the target model, the user may also select to directly call the target model from the resource management module or perform source code design through the edit box.
In addition, the user can edit the model operator through the operator development module, and then the operator development module can respond to operator editing operation executed by the user to generate a new model operator and store the new model operator in the resource management module so that the user can call the newly generated model operator in the construction process of other models.
After obtaining the model code of the target model, the model development module may call a training data set specified by the model development instruction from the resource management module, so as to train the target model through the training data set.
After training the target model, the model development module can further call a target compiler corresponding to the target storage and calculation integrated device from the resource management module, and compile the trained target model through the target compiler to obtain a compiled target model.
And the model development module can call a target simulator corresponding to the target calculation integrated equipment from the resource management module, and simulate the compiled target model through the target simulator, so that the model can be ensured to run on the calculation integrated hardware equipment smoothly.
After the simulation is completed, the model development module can further issue an application development instruction to the application development model, and of course, the application development instruction can also be issued by a user through the user management module after the compiling of the target model is completed.
After receiving the application development instruction, the application development module can create a storage and calculation integrated application development project, automatically generate codes of a development framework corresponding to the target application program according to the application development instruction, and import the codes of the development framework into a compiled target model, wherein the codes of the development framework can be complete codes of the Web development SSH framework.
After the compiled target model is imported into the code of the development framework corresponding to the target application program, the model development module adjusts the code of the target application program (such as changing the format, data amount, model output form and the like of the input data of the target model in the target application program) based on the preset functional requirement to obtain an adjusted application program, and then the adjusted application program is deployed in the target calculation integrated device.
For example, the target integrated storage and calculation device may be an integrated storage and calculation machine mounted in the driving device, and the user may construct a target detection model in the integrated storage and calculation application generation system through the model development module, and then generate a complete target detection program through the application development module and deploy the complete target detection program in the integrated storage and calculation machine of the driving device. In this way, during the traveling of the driving apparatus, the object detection program integrated with the object detection model can detect the object of the obstacle such as the pedestrian, the building, the vehicle, etc. nearby, and then the route navigation is performed according to the object detection result.
For easy understanding, the present disclosure also provides a method for generating a unified application for use in the unified application generating system, as shown in fig. 2.
Fig. 2 is a flow chart of a method for generating a storage-computing integrated application provided in the present specification, which includes the following steps:
S201: and receiving a model development instruction, judging whether a target model specified by the model development instruction is stored in a resource management module, wherein a plurality of artificial intelligence AI models, a plurality of model operators, a plurality of training data sets, development frameworks and compilers corresponding to different storage and calculation integrated devices are stored in the resource management module.
S202: if yes, the target model is called from the resource management module, otherwise, each target model operator selected by the user is determined in response to the appointed operation of the user, and the target model is built based on each target model operator.
S203: and invoking a training data set specified by the model development instruction from the resource management module to train the target model.
S204: and calling a target compiler from the resource management module to compile the trained target model, and acquiring an application development instruction after compiling the target model.
In this specification, the method for generating the integrated deposit and calculation application may be a terminal device deployed with an integrated deposit and calculation application generating system, and for convenience of understanding, this specification provides a schematic diagram of a model development process, as shown in fig. 3.
Fig. 3 is a schematic diagram of a model development process provided in the present specification.
After receiving the model development instruction, the terminal device can create a model development project, then select a model development mode, and directly call the existing model from the resource management module, or the user selects an operator to build the model and set network parameters by himself, and then edit the model source code. After the target model is built, a training data set is called from the resource management module to carry out model training, the trained target model is compiled, and then the compiled target model is simulated and stored through a simulator selected in the resource management module.
S205: and generating codes of a development framework corresponding to the target application program according to the application development instruction, importing the codes into the compiled target model, obtaining the target application program, and deploying the target application program in target storage and calculation integrated equipment.
After the development of the target model is completed, the terminal equipment can further acquire an application development instruction, so that a storage and calculation integrated application program is generated based on the target model. For ease of understanding, the present description provides an application development process schematic, as shown in fig. 4.
Fig. 4 is a schematic diagram of an application development process provided in the present specification.
The terminal equipment can automatically generate codes of the Web development framework, import the compiled target model to obtain a target application program, modify the application program codes according to preset application requirements, and deploy the modified target application program in the selected integrated storage and calculation equipment.
According to the method, the low-code development of the model and the application is realized through the automatic generation function of the source code, the development efficiency is improved, and errors in the development process are reduced.
In order to facilitate management and use of various resources such as a data set and a model, a corresponding resource management module is provided, so that a user can conveniently realize resource management and sharing through the integrated development environment provided by the user, and the development efficiency and the resource utilization rate of the user are obviously enhanced.
The method provides a full-flow development environment for application development on integrated hardware, and comprises a project creation function, a model import function and the like. A developer automatically generates a basic development framework through a project creation function of the application development module and imports a trained model realized by the model development module; after the corresponding functions are realized according to the requirements, the complete WEB codes and the corresponding JSP interfaces can be generated.
The present specification also provides a computer readable storage medium storing a computer program operable to perform a memory-integrated application generation method as provided in fig. 1 above.
The present specification also provides a schematic structural diagram of an electronic device corresponding to fig. 1 shown in fig. 5. At the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile storage, as illustrated in fig. 5, although other hardware required by other services may be included. The processor reads the corresponding computer program from the nonvolatile memory into the memory and then runs the computer program to implement the memory-integrated application generation method described in fig. 2. Of course, other implementations, such as logic devices or combinations of hardware and software, are not excluded from the present description, that is, the execution subject of the following processing flows is not limited to each logic unit, but may be hardware or logic devices.
Improvements to one technology can clearly distinguish between improvements in hardware (e.g., improvements to circuit structures such as diodes, transistors, switches, etc.) and software (improvements to the process flow). However, with the development of technology, many improvements of the current method flows can be regarded as direct improvements of hardware circuit structures. Designers almost always obtain corresponding hardware circuit structures by programming improved method flows into hardware circuits. Therefore, an improvement of a method flow cannot be said to be realized by a hardware entity module. For example, a programmable logic device (Programmable Logic Device, PLD) (e.g., field programmable gate array (Field Programmable GATE ARRAY, FPGA)) is an integrated circuit whose logic functions are determined by user programming of the device. A designer programs to "integrate" a digital system onto a PLD without requiring the chip manufacturer to design and fabricate application-specific integrated circuit chips. Moreover, nowadays, instead of manually manufacturing integrated circuit chips, such programming is mostly implemented with "logic compiler (logic compiler)" software, which is similar to the software compiler used in program development and writing, and the original code before being compiled is also written in a specific programming language, which is called hardware description language (Hardware Description Language, HDL), but HDL is not just one, but a plurality of kinds, such as ABEL(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language), and VHDL (Very-High-SPEED INTEGRATED Circuit Hardware Description Language) and Verilog are currently most commonly used. It will also be apparent to those skilled in the art that a hardware circuit implementing the logic method flow can be readily obtained by merely slightly programming the method flow into an integrated circuit using several of the hardware description languages described above.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, application SPECIFIC INTEGRATED Circuits (ASICs), programmable logic controllers, and embedded microcontrollers, examples of controllers include, but are not limited to, the following microcontrollers: ARC625D, atmel AT91SAM, microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic of the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller in a pure computer readable program code, it is well possible to implement the same functionality by logically programming the method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. Such a controller may thus be regarded as a kind of hardware component, and means for performing various functions included therein may also be regarded as structures within the hardware component. Or even means for achieving the various functions may be regarded as either software modules implementing the methods or structures within hardware components.
The system, apparatus, module or unit set forth in the above embodiments may be implemented in particular by a computer chip or entity, or by a product having a certain function. One typical implementation is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being functionally divided into various units, respectively. Of course, the functions of each element may be implemented in one or more software and/or hardware elements when implemented in the present specification.
It will be appreciated by those skilled in the art that embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, the present specification may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present description can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present description is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the specification. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
It will be appreciated by those skilled in the art that embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, the present specification may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present description can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing is merely exemplary of the present disclosure and is not intended to limit the disclosure. Various modifications and alterations to this specification will become apparent to those skilled in the art. Any modifications, equivalent substitutions, improvements, or the like, which are within the spirit and principles of the present description, are intended to be included within the scope of the claims of the present description.
Claims (14)
1. A computationally intensive application generation system, the computationally intensive application generation system comprising: the system comprises a resource management module, a model development module and an application development module;
The resource management module is used for providing a plurality of artificial intelligence AI models, a plurality of model operators, a plurality of training data sets, a development framework and compilers corresponding to different storage and calculation integrated devices;
The model development module is used for receiving a model development instruction, judging whether a target model specified by the model development instruction is stored in the resource management module, if yes, calling the target model from the resource management module, otherwise, responding to the specified operation of a user, determining each target model operator selected by the user, constructing the target model based on each target model operator, calling a training data set specified by the model development instruction from the resource management module to train the target model, and calling a target compiler corresponding to target storage integrated equipment from the resource management module to compile the trained target model;
The application development module is used for acquiring an application development instruction, generating codes of a development framework corresponding to a target application program according to the application development instruction, importing the codes into a compiled target model, obtaining the target application program, and deploying the target application program in the target storage and calculation integrated device.
2. The all-in-one application generation system of claim 1, further comprising: an interface visualization module;
The interface visualization module is used for displaying an editing frame to the user, responding to the operation executed by the user in the editing frame, determining a target model operator selected by the user and editing the target model.
3. The integrated computing application generation system of claim 2, wherein the interface visualization module is further configured to present a development interface corresponding to a programming language specified by the model development instruction to the user;
And responding to the operation executed by the user in the development interface, and calling a programming component to develop the target model.
4. The all-in-one application generation system of claim 1, further comprising: an operator development module;
The operator development module is used for responding to operator editing operation executed by the user, generating a new model operator and storing the new model operator in the resource management module.
5. The integrated computing application generation system of claim 1, wherein the resource management module is further configured to provide simulators corresponding to a plurality of integrated computing hardware devices;
The model development module is used for determining a target simulator corresponding to the target storage and calculation integrated equipment, and performing simulation on the compiled target model through the target simulator.
6. The integrated storage and computing application generation system of claim 1, wherein the application development module is further configured to adjust the code of the target application program based on a preset functional requirement to obtain an adjusted application program, and deploy the adjusted application program in the integrated target storage and computing device.
7. A method for generating a unified application, comprising:
Receiving a model development instruction, judging whether a target model specified by the model development instruction is stored in a resource management module, wherein a plurality of artificial intelligence AI models, a plurality of model operators, a plurality of training data sets, a development framework and compilers corresponding to different storage and calculation integrated devices are stored in the resource management module;
If yes, the target model is called from the resource management module, otherwise, each target model operator selected by the user is determined in response to the appointed operation of the user, and the target model is built based on each target model operator;
Invoking a training data set specified by the model development instruction from the resource management module to train the target model;
invoking a target compiler corresponding to the target calculation integrated equipment from the resource management module to compile the trained target model, and acquiring an application development instruction after compiling the target model;
And generating codes of a development framework corresponding to the target application program according to the application development instruction, importing the codes into the compiled target model to obtain the target application program, and deploying the target application program in the target storage and calculation integrated equipment.
8. The method of claim 7, wherein determining each target model operator selected by the user in response to a user-specified operation, and constructing the target model based on each target model operator, comprises:
if the target model specified by the model development instruction is not stored in the resource management module, displaying an editing frame to the user;
Determining the target model operator selected by the user in response to the operation performed by the user in the editing box;
editing the target model based on the target model operator selected by the user.
9. The method of claim 8, wherein editing the target model based on the user-selected target model operator, comprises:
Displaying a development interface corresponding to the programming language appointed by the model development instruction to the user;
And responding to the operation executed by the user in the development interface, and calling a programming component to develop the target model.
10. The method of claim 7, wherein the method further comprises:
And generating a new model operator and storing the new model operator in the resource management module in response to operator editing operation performed by the user.
11. The method of claim 7, wherein the resource management module further stores simulators corresponding to a plurality of integrated hardware devices;
Before generating the code of the development framework corresponding to the target application program according to the application development instruction and importing the code into the compiled target model, the method further comprises:
And determining a target simulator corresponding to the target calculation integrated equipment, and performing simulation on the compiled target model through the target simulator.
12. The method of claim 7, wherein deploying the target application in a target computing device comprises:
Adjusting the code of the target application program based on the preset function requirement to obtain an adjusted application program;
The adjusted application is deployed in the target computing integrated device.
13. A computer-readable storage medium, characterized in that the storage medium stores a computer program which, when executed by a processor, implements the method of any of the preceding claims 7-12.
14. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of the preceding claims 7-12 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311339594.4A CN117406982B (en) | 2023-10-12 | 2023-10-12 | Integrated storage and calculation application generation system and method, storage medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311339594.4A CN117406982B (en) | 2023-10-12 | 2023-10-12 | Integrated storage and calculation application generation system and method, storage medium and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117406982A CN117406982A (en) | 2024-01-16 |
| CN117406982B true CN117406982B (en) | 2024-05-10 |
Family
ID=89495545
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311339594.4A Active CN117406982B (en) | 2023-10-12 | 2023-10-12 | Integrated storage and calculation application generation system and method, storage medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117406982B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118379605B (en) * | 2024-06-24 | 2024-08-30 | 之江实验室 | Deployment method, device and storage medium of image recognition large model |
| CN118395194B (en) * | 2024-06-28 | 2024-09-13 | 浪潮电子信息产业股份有限公司 | Model training method, product, equipment and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112465108A (en) * | 2020-11-11 | 2021-03-09 | 上海交通大学 | Neural network compiling method for storage and calculation integrated platform |
| CN112836814A (en) * | 2021-03-02 | 2021-05-25 | 清华大学 | Storage and computation integrated processor, processing system and method for deploying algorithm model |
| CN116450344A (en) * | 2023-03-13 | 2023-07-18 | 之江实验室 | Task execution method and device, storage medium and electronic equipment |
| CN116860259A (en) * | 2023-09-05 | 2023-10-10 | 之江实验室 | Method, device and equipment for model training and automatic optimization of compiler |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2615659A1 (en) * | 2005-07-22 | 2007-05-10 | Yogesh Chunilal Rathod | Universal knowledge management and desktop search system |
-
2023
- 2023-10-12 CN CN202311339594.4A patent/CN117406982B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112465108A (en) * | 2020-11-11 | 2021-03-09 | 上海交通大学 | Neural network compiling method for storage and calculation integrated platform |
| CN112836814A (en) * | 2021-03-02 | 2021-05-25 | 清华大学 | Storage and computation integrated processor, processing system and method for deploying algorithm model |
| CN116450344A (en) * | 2023-03-13 | 2023-07-18 | 之江实验室 | Task execution method and device, storage medium and electronic equipment |
| CN116860259A (en) * | 2023-09-05 | 2023-10-10 | 之江实验室 | Method, device and equipment for model training and automatic optimization of compiler |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117406982A (en) | 2024-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN117406982B (en) | Integrated storage and calculation application generation system and method, storage medium and equipment | |
| CN107451663A (en) | Algorithm assembly, based on algorithm assembly modeling method, device and electronic equipment | |
| CN116126365B (en) | Model deployment method, system, storage medium and electronic equipment | |
| CN107045438B (en) | Application top view processing method, device and component | |
| CN108415695A (en) | A kind of data processing method, device and equipment based on visualization component | |
| CN111540035B (en) | Particle rendering method, device and equipment | |
| CN116932092B (en) | Method, device, medium and equipment for automatically generating operator calling code | |
| CN109144511B (en) | Method and system for automatically generating numerical simulation graphical user interface | |
| JP2024536659A (en) | Task execution method, apparatus, storage medium and electronic device | |
| CN117828360A (en) | Model training method, model training device, model code generating device, storage medium and storage medium | |
| CN115574834A (en) | Intelligent driving scene simulation method, device and equipment based on script | |
| CN112732252B (en) | Method and device for dynamically generating UI and electronic equipment | |
| CN116341642B (en) | Data processing method and device, storage medium and electronic equipment | |
| CN116842715A (en) | Simulation data structuring processing system | |
| CN114115850A (en) | Code generation method and device | |
| CN114546973A (en) | Method and device for converting model parameters | |
| CN113902356A (en) | Regional flow data analysis method and device | |
| CN116843812A (en) | Image rendering method and device and electronic equipment | |
| CN107783761B (en) | Interface construction method, device and equipment | |
| CN116382877B (en) | Task execution method and device, storage medium and electronic equipment | |
| CN111753990A (en) | Quantum computer environment simulation method, equipment and medium | |
| CN116882278B (en) | Think simulation experiment system | |
| CN111596946A (en) | Recommendation method, device and medium for intelligent contracts of block chains | |
| CN116483482B (en) | Deep learning task processing method, system, device, equipment and medium | |
| CN116384038B (en) | Combat behavior modeling simulation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |