[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN110765663A - Concurrent processing method and system based on parametric simulation - Google Patents

Concurrent processing method and system based on parametric simulation Download PDF

Info

Publication number
CN110765663A
CN110765663A CN201911162170.9A CN201911162170A CN110765663A CN 110765663 A CN110765663 A CN 110765663A CN 201911162170 A CN201911162170 A CN 201911162170A CN 110765663 A CN110765663 A CN 110765663A
Authority
CN
China
Prior art keywords
simulation
task
simulation task
parameters
concurrent processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911162170.9A
Other languages
Chinese (zh)
Inventor
王作学
李盛
张波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongye Saidi Chongqing Information Technology Co Ltd
CISDI Chongqing Information Technology Co Ltd
Original Assignee
Zhongye Saidi Chongqing Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongye Saidi Chongqing Information Technology Co Ltd filed Critical Zhongye Saidi Chongqing Information Technology Co Ltd
Priority to CN201911162170.9A priority Critical patent/CN110765663A/en
Publication of CN110765663A publication Critical patent/CN110765663A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention provides a concurrent processing method and a system based on parametric simulation, which comprises the following steps: inputting simulation task parameters, generating a simulation task script according to the simulation task parameters, and further acquiring a simulation task request; monitoring the running state of the system, executing the simulation task request according to the running state of the system, and feeding back an execution result; the invention can effectively improve the concurrent running quantity of the parameterized simulation tasks in the simulation calculation server and improve the service efficiency of server resources.

Description

Concurrent processing method and system based on parametric simulation
Technical Field
The invention relates to the field of computer data processing, in particular to a concurrent processing method and system based on parametric simulation.
Background
With the recent milestone progress in the computer field, many powerful parameterized simulation computing software are introduced in the computer software market. However, most of the parameterized simulation calculation software on the market needs researchers to have a solid theoretical basis and to be skilled in the operation skills of the researchers. In the process of parametric simulation calculation and analysis, the time for extracting analysis results by pre-processing modeling and post-processing is the most, and the operation is the most complicated and the error is the most prone to occur. In addition, the number of CPU cores and the number of memories required by one-time calculation of the simulation calculation task in the real simulation calculation process are mostly specified artificially, and a user can generally specify the simulation calculation server to perform calculation analysis in a maximum calculation resource mode in order to quickly solve the simulation calculation task, so that the simulation calculation server can only run one simulation task at the same time and cannot monitor the use condition of the calculation resources of the simulation calculation server in real time under the normal condition, and the utilization rate and the use efficiency of the server resources are low.
Disclosure of Invention
In view of the problems in the prior art, the invention provides a concurrent processing method and system based on parameterized simulation, which mainly solve the problem that the execution efficiency of simulation tasks is low but system resources are lack of real-time monitoring.
In order to achieve the above and other objects, the present invention adopts the following technical solutions.
A concurrent processing method based on parameterized simulation comprises the following steps:
inputting simulation task parameters, generating a simulation task script according to the simulation task parameters, and further acquiring a simulation task request;
and monitoring the running state of the system, executing the simulation task request according to the running state of the system, and feeding back an execution result.
Optionally, the simulation task parameters include a simulation model type, a task ID, geometric parameters, load parameters, material parameters, and boundary conditions.
Optionally, the entry of the simulation task parameters may be performed through a plurality of user interfaces without interfering with each other.
Optionally, a pre-processing script and a post-processing script are generated according to the simulation task parameters, a simulation model is established, and the simulation task request is obtained according to the simulation model.
Optionally, recording the entry time of the simulation task parameters, and sequentially storing the corresponding simulation task requests into a message queue of the system according to the time sequence.
Optionally, the system operation state includes: system resource information, simulation model information, and simulation task request execution state information.
Optionally, an index of the simulation task request is set, and data generated by executing the simulation task request is acquired according to the index.
And executing the simulation task request in a multi-thread or multi-process mode.
A parametric simulation-based concurrent processing system, comprising:
the task acquisition module is used for inputting simulation task parameters, generating a simulation task script according to the simulation task parameters and further acquiring a simulation task request;
and the execution module monitors the running state of the system, executes the simulation task request according to the running state of the system and feeds back an execution result.
The system comprises a resource management module, a pre-processing script and a post-processing script, wherein the resource management module is used for editing the pre-processing script and the post-processing script which are generated according to the simulation task parameters.
As described above, the concurrent processing method and system based on parameterized simulation of the present invention have the following advantages.
And a simulation task script is automatically created according to the simulation task parameters, and the concurrent processing of the tasks is performed, so that the running efficiency of the simulation task can be effectively improved, and the utilization efficiency of server resources is enhanced.
Drawings
Fig. 1 is a flowchart of a concurrent processing method based on parameterized simulation according to an embodiment of the present invention.
FIG. 2 is a block diagram of a concurrent processing system based on parameterized simulation according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1, the present invention provides a concurrent processing method based on parameterized simulation, including steps S01-S02.
In step S01, the simulation task parameters are entered, and a simulation task script is generated according to the simulation task parameters, so as to obtain a simulation task request:
in one embodiment, a plurality of user input interfaces can be set, and the input of the simulation task parameters can be carried out among the plurality of user input interfaces without mutual interference. In another embodiment, the simulation parameter information input by the user can be acquired by interacting with the user through various Web front-end technologies such as HTML, JavaScript, jQuery, Ajax and the like, and is transmitted to the Web back end through GET or POST and the like. Specifically, the task parameter can be entered through a Web parameter entry interface provided by a browser at a mobile phone end or a PC end. The simulation task parameters may include simulation model type, task ID, geometry parameters, load parameters, material parameters, boundary conditions, and the like.
Taking a Web interface as an example, after a user inputs simulation task parameters through the Web parameter input interface, the Web parameter input interface transmits the corresponding simulation task parameters to the rear end of the Web framework to generate a pre-processing script and a post-processing script. And creating a simulation model according to the simulation task parameters, the pre-processing script and the post-processing script. In one embodiment, common simulation software including ABAQUS, ANSYS, MSCNastran, MATLAB, etc. may be used for the pre-processing script and the post-processing script of the secondary development. And automatically matching corresponding pre-processing scripts and post-processing scripts through information such as simulation model types in the input simulation task parameters, and packaging the pre-processing scripts and the post-processing scripts into the simulation task request.
In one embodiment, the user interface can record the input time of the simulation task parameters, and store the obtained corresponding simulation task requests into a message queue of the system according to the time sequence of the input of the simulation task numbers of a plurality of user interfaces or the same user interface parameter.
In step S02, the system operation status is monitored, the simulation task request is executed according to the system operation status, and the execution result is fed back:
in an embodiment, the back end of the Web framework starts a plurality of sub-threads or sub-processes according to the number of the simulation task requests, and the simulation task requests are sequentially taken out from the message queue according to the time sequence of the simulation task requests. And sequentially submitting the pre-processing script and the post-processing script in the simulation task request to the kernel of the common simulation software to execute the simulation calculation processes of pre-processing, solving, post-processing and the like in the sub-thread or the sub-process.
In an embodiment, index information may be set for the simulation task request, and after the execution of the simulation task request is completed, simulation calculation data such as data and cloud images acquired during the execution process may be stored in the data storage module according to the index information, so that the Web front end may retrieve, in real time, corresponding data acquired by executing the simulation task request according to the index information. The index information may include a task ID in the simulation task parameters.
In an embodiment, when a plurality of sub-threads or sub-processes need to be opened for concurrent processing of a simulation task request, the number of the opened sub-threads or sub-processes can be adjusted according to the running state of the system.
The system running state comprises the following steps: system resource information, simulation model information, simulation task request execution state information, and the like. The system resource information may include: the method comprises the following steps of Web back-end CPU thread, process running quantity and the use conditions of computing resources such as a memory, a hard disk and the like; the emulation task request execution state information may include: the method comprises the steps of simulating task request submission time, starting execution time, ending time, task execution time, simulation calculation results of data, cloud pictures and the like in the concurrent processing of the simulation tasks, the number of simulation calculation requests waiting to be executed in a message queue and task IDs thereof, the number of simulation calculation requests running at the rear end of a Web framework and the task IDs thereof and the like.
Specifically, the thread and the process running number of the Web back-end CPU, and the maximum opening number value of the thread and the maximum opening number value of the process of the Web back-end CPU in the resource management module can be monitored. And if the CPU threads are operated in real time by the back end of the system and the process operation number reaches the maximum opening number of the CPU threads or the maximum opening number of the CPU processes, taking out the simulation task request from the message queue for the moment. If the back end of the system runs the CPU threads in real time and the running number of the processes does not reach the maximum starting number of the CPU threads and the maximum starting number of the CPU processes, a simulation task request is automatically taken out from the message queue in sequence and is subjected to subsequent operation, and meanwhile, the next judgment is carried out.
Referring to fig. 2, the present embodiment provides a concurrent processing system based on parametric simulation, which is used to execute the concurrent processing method based on parametric simulation described in the foregoing method embodiments. Since the technical principle of the system embodiment is similar to that of the method embodiment, repeated description of the same technical details is omitted.
In one embodiment, the concurrent processing system based on parameterized simulation includes a task obtaining module 10 and an executing module 11; the task obtaining module 10 is configured to assist in performing step S01 described in the foregoing method embodiment; the execution module 11 is configured to assist in executing step S02 described in the foregoing method embodiment.
In an embodiment, the system further comprises a data acquisition module, which is used for acquiring simulation model type information selected by multiple users at the browser end and input simulation task parameter information such as task ID, geometric parameters, load parameters, material parameters, boundary conditions and the like.
The data acquisition module can interact with a user through various Web front-end technologies such as HTML, JavaScript, jQuery, Ajax and the like, acquire simulation parameter information input by the user, and transmit the simulation parameter information to a Web rear end in a GET or POST mode; the data acquisition module can be suitable for a PC end browser and a mobile end browser.
The browser-side simulation task parameter information input page in the data acquisition module can be used by multiple users at the same time without mutual interference.
In an embodiment, the system further includes a simulation task generating module, configured to receive the simulation task parameter information transmitted by the data acquisition module, generate a pre-processing script and a post-processing script including simulation model information at a back end of the Web framework, package the pre-processing script and the post-processing script into a simulation task request, and store the simulation task request in a message queue.
After receiving the simulation task parameter information transmitted by the data acquisition module, the simulation task generation module automatically generates a pre-processing script and a post-processing script obtained based on the secondary development of common simulation software according to the simulation model type information selected by a user at the browser end and the input simulation task parameter information such as task ID, geometric parameters, load parameters, material parameters, boundary conditions and the like, wherein in the simulation task generation module, the common simulation software comprises ABAQUS, ANSYS, MSC Nastran and MATLAB.
The method comprises the steps of generating a pre-processing script and a post-processing script containing simulation model information at the rear end of a Web framework through a simulation task generating module, packaging the pre-processing script and the post-processing script into a simulation task request and storing the simulation task request into a message queue, wherein the script generating sequence and the message queue storing sequence are sequentially executed according to the sequence of time when a plurality of users at the front end of the Web submit simulation task parameters to the rear end.
In an embodiment, the system further includes a simulation task concurrent processing module, which is used for starting sub-threads or sub-processes at the back end of the Web framework, sequentially taking out the simulation task requests from the message queue, and sequentially submitting the pre-processing scripts and the post-processing scripts in the simulation task requests to the kernel of the common simulation software in the sub-threads or the sub-processes to execute the simulation calculation processes such as pre-processing, solving, post-processing, and the like. And after the simulation task request is executed, storing the execution results of the obtained data, the cloud pictures and the like into the data storage module according to the task ID in the data acquisition module as an index.
In an embodiment, the execution module includes a monitoring unit, and when the simulation task concurrent processing module starts a sub-thread or a sub-process at the back end of the Web framework, the simulation task concurrent processing module automatically refers to the number of running processes of the CPU thread at the back end of the Web in the information monitoring unit, and the maximum starting number value of the CPU thread at the back end of the Web and the maximum starting number value of the CPU process in the resource management module, and performs determination. And if the CPU threads are operated in real time by the back end of the system and the process operation number reaches the maximum opening number of the CPU threads or the maximum opening number of the CPU processes, taking out the simulation task request from the message queue for the moment. If the back end of the system runs the CPU threads in real time and the running number of the processes does not reach the maximum starting number of the CPU threads and the maximum starting number of the CPU processes, a simulation task request is automatically taken out from the message queue in sequence and is subjected to subsequent operation, and meanwhile, the next judgment is carried out.
The monitoring unit is used for finishing real-time monitoring and recording the system running state, and storing the system running state information to the data storage module, wherein the system running state comprises system resource information, simulation model information, simulation task basic information and simulation task request execution state information. Specifically, the system resource information includes: the method comprises the following steps of Web back-end CPU thread, process running quantity and the use conditions of computing resources such as a memory, a hard disk and the like; simulating task basic information, including: user name information, simulation model type information selected by a user at a browser end in the data acquisition module, and input simulation task parameter information such as task ID, geometric parameters, load parameters, material parameters, boundary conditions and the like; the simulation task requests to execute the state information, which comprises the following steps: the simulation task concurrent processing module comprises simulation task request submission time, execution starting time, execution ending time, task execution time, simulation calculation results of data, cloud pictures and the like in the simulation task concurrent processing module, the number of simulation task requests waiting to be executed in a message queue and task IDs thereof, and the number of simulation task requests running at the rear end of the Web framework and task IDs thereof.
And the data storage module is used for storing system computing resource information, system simulation model information, simulation task basic information and simulation task request execution state information in the monitoring unit by taking the task ID of the data acquisition module as an index.
In an embodiment, the system further comprises a data presentation module, after the user submits the simulation task parameters at the browser end, the user automatically jumps to a Web front-end page of the data presentation module, reads system resource information, simulation task parameter information and simulation task request execution state information from the data storage module, and visually presents the user according to task ID sequencing in the data acquisition module.
The information visually displayed for the user in the data display module can be used for the user to preview, print and download.
In an embodiment, the system further includes a resource management module for an administrator user to manage the user information, the optional simulation model provided for the user, the number of simulation calculation requests that can be accommodated by the message queue, the maximum number of CPU threads on the Web backend, and the maximum number of CPU processes on the Web backend.
In the resource management module, the selectable simulation model provided for the user is a script template obtained based on secondary development of common simulation software. Meanwhile, the administrator user can perform management operations such as adding, deleting and modifying on the script template at any time according to the use condition of the user.
In summary, according to the concurrent processing method and system for parametric simulation of the present invention, by obtaining a small number of simulation task parameters input by a user on a Web front-end page, a system background can automatically complete functions such as automatic generation of a simulation model, concurrent processing of multi-user simulation tasks, data storage, visualization display of simulation task calculation results and system calculation resource information, and the like; the method has the advantages that the requirement of parametric simulation design on the mastery degree of the professional knowledge of the user is reduced, the concurrent operation quantity of the parametric simulation tasks in the simulation calculation server is increased, the simple, efficient and concurrent operation of the parametric simulation system is realized, the resource utilization rate and the service efficiency of the server are increased, and the purpose of improving the working efficiency of researchers and engineering users is achieved. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims (10)

1. A concurrent processing method based on parameterized simulation is characterized by comprising the following steps:
inputting simulation task parameters, generating a simulation task script according to the simulation task parameters, and further acquiring a simulation task request;
and monitoring the running state of the system, executing the simulation task request according to the running state of the system, and feeding back an execution result.
2. The parametric simulation-based concurrent processing method according to claim 1, wherein the simulation task parameters include simulation model type, task ID, geometric parameters, load parameters, material parameters, boundary conditions.
3. The parametric simulation-based concurrent processing method according to claim 1, wherein the entry of the simulation task parameters can be performed through a plurality of user interfaces without interfering with each other.
4. The concurrent processing method based on parameterized simulation according to claim 1, wherein a pre-processing script and a post-processing script are generated according to the simulation task parameters, a simulation model is built, and the simulation task request is obtained according to the simulation model.
5. The concurrent processing method based on parameterized simulation according to claim 4, characterized in that the logging time of the simulation task parameters is recorded, and the corresponding simulation task requests are stored in the message queue of the system in sequence according to the time sequence.
6. The parametric simulation-based concurrent processing method according to claim 4, wherein the system operating state comprises: system resource information, simulation model information, and simulation task request execution state information.
7. The parametric simulation-based concurrent processing method according to claim 1, wherein an index of the simulation task request is set, and data generated by executing the simulation task request is obtained according to the index.
8. The parametric simulation-based concurrent processing method according to claim 1, wherein the simulation task request is executed in a multi-thread or multi-process manner.
9. A concurrent processing system based on parameterized simulation, comprising:
the task acquisition module is used for inputting simulation task parameters, generating a simulation task script according to the simulation task parameters and further acquiring a simulation task request;
and the execution module monitors the running state of the system, executes the simulation task request according to the running state of the system and feeds back an execution result.
10. The parametric simulation-based concurrent processing system according to claim 9, comprising a resource management module for editing pre-processing scripts and post-processing scripts generated according to the simulation task parameters.
CN201911162170.9A 2019-11-25 2019-11-25 Concurrent processing method and system based on parametric simulation Pending CN110765663A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911162170.9A CN110765663A (en) 2019-11-25 2019-11-25 Concurrent processing method and system based on parametric simulation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911162170.9A CN110765663A (en) 2019-11-25 2019-11-25 Concurrent processing method and system based on parametric simulation

Publications (1)

Publication Number Publication Date
CN110765663A true CN110765663A (en) 2020-02-07

Family

ID=69339197

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911162170.9A Pending CN110765663A (en) 2019-11-25 2019-11-25 Concurrent processing method and system based on parametric simulation

Country Status (1)

Country Link
CN (1) CN110765663A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115146496A (en) * 2022-06-02 2022-10-04 西南交通大学 Tunnel internal force automatic calculation platform based on finite elements and implementation method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102360310A (en) * 2011-09-28 2012-02-22 中国电子科技集团公司第二十八研究所 Multitask process monitoring method and system in distributed system environment
CN104899369A (en) * 2015-06-01 2015-09-09 浪潮集团有限公司 Simulator multithreading operation method utilizing PERL script
CN105117506A (en) * 2014-09-25 2015-12-02 航天恒星科技有限公司 Device and method for automatically generating network simulation script
CN108200118A (en) * 2017-12-04 2018-06-22 中山大学 A kind of solution based on the request of movement simulation platform high concurrent
CN110138589A (en) * 2019-04-08 2019-08-16 沈阳化工大学 A kind of underwater sensor network visual simulation system based on Linux

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102360310A (en) * 2011-09-28 2012-02-22 中国电子科技集团公司第二十八研究所 Multitask process monitoring method and system in distributed system environment
CN105117506A (en) * 2014-09-25 2015-12-02 航天恒星科技有限公司 Device and method for automatically generating network simulation script
CN104899369A (en) * 2015-06-01 2015-09-09 浪潮集团有限公司 Simulator multithreading operation method utilizing PERL script
CN108200118A (en) * 2017-12-04 2018-06-22 中山大学 A kind of solution based on the request of movement simulation platform high concurrent
CN110138589A (en) * 2019-04-08 2019-08-16 沈阳化工大学 A kind of underwater sensor network visual simulation system based on Linux

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
樊晓龙等: "基于NS-2的空间网络协议仿真平台设计与实现", 《系统仿真学报》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115146496A (en) * 2022-06-02 2022-10-04 西南交通大学 Tunnel internal force automatic calculation platform based on finite elements and implementation method

Similar Documents

Publication Publication Date Title
Rivi et al. In-situ visualization: State-of-the-art and some use cases
CN1755647A (en) Test automation stack layering
CN104750603A (en) Multi-core DSP (Digital Signal Processor) software emulator and physical layer software testing method thereof
US9418181B2 (en) Simulated input/output devices
CN113722020B (en) Interface calling method, device and computer readable storage medium
US11201806B2 (en) Automated analysis and recommendations for highly performant single page web applications
CN108898229B (en) Method and system for constructing machine learning modeling process
US20230351145A1 (en) Pipelining and parallelizing graph execution method for neural network model computation and apparatus thereof
KR20220027870A (en) Visual programming for deep learning
CN113609028A (en) Page testing method, computing device and readable storage medium
US11954011B2 (en) Apparatus and method for executing customized artificial intelligence production line
CN112667517A (en) Method, device, equipment and storage medium for acquiring automatic test script
CN103309676A (en) Web service encapsulation method and system for ocean numerical modeling regional ocean modeling system (ROMS)
CN110765663A (en) Concurrent processing method and system based on parametric simulation
CN103544357A (en) Method and device for achieving ANSYS calculation tasks
CN114764296A (en) Machine learning model training method and device, electronic equipment and storage medium
CN112632333A (en) Query statement generation method, device, equipment and computer readable storage medium
CN107944564B (en) Deep learning job processing method, device, equipment and storage medium
JPH08314760A (en) Program development supporting device
CN113835835B (en) Method, device and computer readable storage medium for creating consistency group
CN113656717B (en) Webpage control rendering method, device, equipment and storage medium
US20220343044A1 (en) Verification performance profiling with selective data reduction
CN108960433B (en) Method and system for running machine learning modeling process
Fang et al. Automatic GUI test by using SIFT matching
CN103544015A (en) Method and device for achieving VASP calculation tasks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 401329 No. 5-6, building 2, No. 66, Nongke Avenue, Baishiyi Town, Jiulongpo District, Chongqing

Applicant after: MCC CCID information technology (Chongqing) Co.,Ltd.

Address before: Building 1, No. 11, Huijin Road, North New District, Yubei District, Chongqing

Applicant before: CISDI CHONGQING INFORMATION TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20200207

RJ01 Rejection of invention patent application after publication