CN116013124A - Operation replay system and operation method based on virtual DCS simulation training system - Google Patents

Abstract

The invention discloses an operation replay system and an operation method based on a virtual DCS simulation training system, wherein the system comprises the following components: the system comprises an operator online operation module, a graphic editing module, an operation replay module, a dynamic characteristic and interactive characteristic definition script module, a page basic code module, an ActiveX control expansion module and a SimuRTS controller simulation module. The beneficial effect of this patent lies in: the invention uses the recording and playback management functions of the virtual DPU simulation software, can record each step of detailed process of the operation simulation machine by a learner, can adjust and take any time operation record playback to indicate the operation error of the learner, and carries out correct operation demonstration, thus truly realizing intelligent organic integration of simulation and industrial production, training a coach to record the standard process system operation or accident handling flow in advance, being used for simulation operation and accident exercise training of the operator, saving repeated operation time of the learner, reducing misoperation of the learner and reducing economic losses of enterprises and individuals.

Description

Operation replay system and operation method based on virtual DCS simulation training system

Technical Field

The invention relates to an operation system, belongs to the technical field of factory simulation training, and in particular relates to an operation replay system and an operation method based on a virtual DCS simulation training system.

Background

The replay working modes which are widely applied at present are generally as follows: the replay is realized by replaying the video afterwards by applying the working process of the video shooting and recording equipment recording system. In the replay mode, the actual equipment of the application system does not participate in the replay working process; particularly, a large-scale system which is distributed and placed needs a plurality of video shooting and recording devices to participate in recording and replay work at the same time, and clock synchronization among the devices is difficult to achieve.

Disclosure of Invention

The invention aims to provide an operation replay system and an operation method based on a virtual DCS simulation training system, so as to solve the problems in the background technology.

In order to achieve the above purpose, the present invention provides the following technical solutions:

an operation replay system and an operation method based on a virtual DCS simulation training system, wherein the system comprises: the system comprises an operator online operation module, a graphic editing module, an operation replay module, a dynamic characteristic and interactive characteristic definition script module, a page basic code module, an ActiveX control expansion module and a SimuRTS controller simulation module.

The functions of the operator online operation module: operating a replay function action record; operating replay function playback; synchronously recording by different operators in the same group;

the function of the graphic editing module: generating basic codes for supporting an operation replay function for page scripts in the page saving process;

the function of the operation replay module: the super user level is used for managing the operation replay process;

the dynamic characteristics and the interaction characteristics define the functions of the script module: basic codes for defining dynamic and interactive characteristic functions are defined and maintained by secondary developers, and are used for realizing recording and playback of dynamic interactive characteristics in an operation replay function;

the function of the page basic code module: the script is used for defining the basic function of the page, and is used for cooperatively realizing recording and playback actions in the operation replay function;

the function of the ActiveX control expansion module: in the macs software, components for extending functions are included: the editctrlx and ComboFCtrl controls;

the function of the SimuRTS controller simulation module: the method is used for controller simulation, and is used for simulating synchronous recording and playback of the controller in the operation replay function.

The operation method of the patent is as follows:

1.1. recording mode:

(1) The dynamic characteristic implementation scheme is as follows:

the operation replay mainly records user operations, and the key of realization is that the interaction characteristics and various operations of the panel are realized, and under the condition of meeting the requirements, the processing scheme of the dynamic characteristics is completed according to the following modes: the DCS software features are realized by page script, i.e. one dynamic feature corresponds to a segment of VB function, one feature of one object configuration corresponds to the call of a VB function, therefore, after the configuration is completed, the dynamic feature is recorded and stored in the page, and the execution of the dynamic feature on the object is sequentially called and completed in the page timer, therefore, the script call of the dynamic feature of the object stored in the page is directly multiplexed without recording the dynamic feature in the recording process, and the replay can be completed automatically according to the logic and point item value conditions operated in the virtual DPU in the replay process. In addition, the operator online program is single-threaded, execution of dynamic characteristics of a plurality of different pages is sequentially completed in turn, and interaction characteristics and incapability of blocking execution of the dynamic characteristics in a replay process of panel operation are required to be ensured, and a specific scheme is described in a replay mode;

(2) The implementation scheme of the interaction characteristics comprises the following steps:

the interactive characteristic is the main content of operation replay, compared with the dynamic characteristic, the same is that one interactive characteristic corresponds to one VB function call in the script, and the difference is that the interactive characteristic is not executed each time, the execution sequence, the time, the interactive content and the like are uncertain, so that the record of the interactive operation cannot be completed by using the interactive characteristic script recorded in the page only;

when entering the recording mode, the operator needs to record online:

an operational page;

symbol objects on a page;

mouse position (for auxiliary display only, and not dependent on position to perform actions);

mouse actions, moving paths, keyboard key actions and input contents which are needed in the characteristics;

mouse movement events in the interaction property are used for the tip property, which is not itself supported, and thus this action is not supported. But the movement track of the mouse needs to be recorded and is used for assisting in displaying the movement track of the mouse during playback;

the implementation process comprises the following steps:

1) Mouse action: the execution object of the mouse action is a page symbol, and when the mouse operates the object, an operator judges the specific page symbol operated on line according to the position generated by the mouse action;

2) Recording the content: recording symbol ID, mouse action (left mouse button is pressed, right mouse button is lifted, right mouse button is pressed, right mouse button is lifted), relative time of action execution (relative to time of starting recording), and allocating an ID for the record to index an operation process, and storing the above contents into a file;

3) For ejecting a numeric keyboard, secondary confirmation, a function block panel and other operation panels, a right key menu, an edit box (a set value characteristic (numeric keyboard)) and keyboard events and keyboard inputs in the interaction characteristic, the recording content comprises: symbol ID, operation content, control ID, control name, control data and page name of operation;

(3) Operation panel and other non-characteristic operation implementation schemes:

1) An operation panel:

a) The actions of the operation panel of the DCS are basically built by characteristics, the recording of the operation process of the operation panel can be executed according to the implementation scheme of dynamic characteristics and interaction characteristics, and the ejection position of the panel is required to be recorded;

2) Other non-characteristic operations:

other non-characteristic operations include: numeric keypad, secondary confirmation, function block panel, right key menu, edit box (set value feature (numeric keypad)), etc.;

a) The numeric keyboard, the secondary confirmation, the function block panel and the right key menu are realized in a background script of the APC object, and specific actions are recorded into a file on line by an operator;

b) Keyboard input requires recording of keyboard input content during recording and is associated with receipt of the content.

1.2 replay mode:

in order to not influence the operation of an operator on the online main thread, the playback of all actions is uniformly processed by starting one playback thread, and the content processed by the playback thread comprises the following four parts: a mouse action; interaction characteristics; playback of an ActiveX control object; operations other than mouse movements, interaction characteristics, controls, such as inputs on a numeric keypad, etc.

(1) Replay of dynamic characteristics:

the playback of dynamic characteristics utilizes the characteristic script recorded by the page itself and the periodic call of the page script, and the playback effect of the dynamic characteristics depends on the data of the current working condition because the history station has no concept of working condition;

description: because the history station has no working condition, the related service point items cannot be stored;

(2) Interactive features, control operations, replay of other panel operations:

the interactive characteristic is operation-triggered, the replay process is to play back independently of the operation itself, the recorded operation content is completely dependent on the recording mode, and the recorded playback file is loaded first when the replay mode is entered, and the playback is performed according to the recorded time sequence. The recording modes of the control and other panel operations are the same as the interaction characteristics, so that the playback modes are the same, and the recorded contents of the control, the other panel operations are different;

(3) Exiting the replay mode:

the replay mode is performed through a combination key, and the ESC is tentatively set at present, and if conflict exists, the adjustment is performed again.

1.3, record is saved:

when the record is saved, a saving path can be selected, the time of the record is included in the file name of the record by default, the time is accurate to seconds, the time is used for distinguishing different records, the playback is not influenced, and a user can name the record file by himself;

1.4 load record:

opening a record selection dialog box, clicking replay after selecting the record, and starting playback;

1.5 voice function:

the implementation of text speech utterances requires Microsoft Speech SDK support, and this SDK includes a speech application design interface (SAPI), microsoft's continuous speech recognition engine (MCSR), microsoft's speech synthesis (TTS) engine, and so forth. TTS (text to speech) is used for realizing voice synthesis, and TTS is realized based on COM; the implementation of the sounding component is realized by calling a TTS, the sounding component controls the sounding of the text by calling an ISPVoice interface, and once an application program creates an ISPVoice object, the sounding component program only needs to call the ISPVoice: : speaker may generate sound through the entered text;

the API of SAPI provides a high-level interface between an application and a speech engine; SAPI implements all of the low-level details required to control and manage the real-time operation of the various speech engines;

FIG. 1 is a general architecture of a Spech API, from which it can be seen that the Speech engine interacts with SAPI (Speech API) through the DDI layer (device driver interface), through which applications communicate with the SAPI. By using these APIs, it is possible to develop an application program in terms of speech recognition or speech synthesis, realizing the speech function of the replay process.

The sounding component calls an interface ISPVoice to realize a voice function, and the ISPVoice interface belongs to the class of SpVoice; the ISpVoice interface is shown in fig. 2; since each instance of SpVoice contains its own queue input stream (usually just text) and its own output stream (usually one audio device); when an application calls ISPVoice, the text item coming later is added to the end of the SpVoice queue, so the integrity of the current voice is enabled by the self mechanism of SpVoice, so that the current voice is not interrupted by an immediately incoming voice request;

1.6 data interface:

the data interfaces are all provided on-line by an operator, including:

(1) Operation replay interface

(2) WM_WriteRecHSTrigger interface

(3) WM_WriteRecActiveX interface

(4) WM_WriteRecspecials interface

(5) GetRIcinfo interface

(6) RECHUPLoad interface

(7) RECTURLLoad interface

(8) NotifyGroupOPS interface

(9) NotifySimuRTS interface.

The beneficial effect of this patent lies in:

the invention uses the recording and playback management functions of the virtual DPU simulation software, can record each step of detailed process of the operation simulation machine by a learner, can adjust and take any time operation record playback to indicate the operation error of the learner, and carries out correct operation demonstration, thus truly realizing intelligent organic integration of simulation and industrial production, training a coach to record the standard process system operation or accident handling flow in advance, being used for simulation operation and accident exercise training of the operator, saving repeated operation time of the learner, reducing misoperation of the learner and reducing economic losses of enterprises and individuals.

Drawings

FIG. 1 is a general block diagram of a Specech API

FIG. 2 is a block diagram of an ISPVoice interface

FIG. 3 is a general structural diagram of the present patent

Detailed Description

In order to make the technical problems, technical schemes and beneficial effects to be solved more clear, the invention will be further described in detail with reference to the following examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.

Referring to fig. 1 to 3, in an embodiment of the present invention, an operation replay system and an operation method based on a virtual DCS simulation training system, the system includes: the system comprises an operator online operation module, a graphic editing module, an operation replay module, a dynamic characteristic and interactive characteristic definition script module, a page basic code module, an ActiveX control expansion module and a SimuRTS controller simulation module.

The functions of the operator online operation module: operating a replay function action record; operating replay function playback; synchronously recording by different operators in the same group;

the function of the graphic editing module: generating basic codes for supporting an operation replay function for page scripts in the page saving process;

the function of the operation replay module: the super user level is used for managing the operation replay process;

the dynamic characteristics and the interaction characteristics define the functions of the script module: basic codes for defining dynamic and interactive characteristic functions are defined and maintained by secondary developers, and are used for realizing recording and playback of dynamic interactive characteristics in an operation replay function;

the function of the page basic code module: the script is used for defining the basic function of the page, and is used for cooperatively realizing recording and playback actions in the operation replay function;

the function of the ActiveX control expansion module: in the macs software, components for extending functions are included: the editctrlx and ComboFCtrl controls;

the function of the SimuRTS controller simulation module: the method is used for controller simulation, and is used for simulating synchronous recording and playback of the controller in the operation replay function.

The operation method of the patent is as follows:

the realization principle is as follows:

recording specific operation steps in a file through online interaction between a page and an operator, reading the recorded file during playback, and playing back according to recorded operation contents; during playback, the online action playback of the operator and the playback of the simulation controller SimuRTS are synchronously performed, the respective playback is performed, and the command SimuRTS issued in the playback process is not responded and directly returns success.

An operation replay panel:

an operation replay panel is added, wherein the operation panel is defined as a system page, and a user cannot edit the operation panel. And (3) adding on a panel: the recording, stopping, playback, uploading, downloading and recording synchronization function button is used as a management panel for operating replay.

1.1. Recording mode:

(1) The dynamic characteristic implementation scheme is as follows:

the operation replay mainly records user operations, and the key of realization is that the interaction characteristics and various operations of the panel are realized, and under the condition of meeting the requirements, the processing scheme of the dynamic characteristics is completed according to the following modes:

the MACS6 series software features are realized by page script, i.e. one dynamic feature corresponds to a section of VB function, one feature of one object configuration corresponds to the call of a VB function, therefore, after the configuration is completed, the dynamic feature is recorded and stored in the page, and the execution of the dynamic feature on the object is sequentially called and completed in the page timer, therefore, the script call of the dynamic feature of the object stored in the page is directly multiplexed without recording the dynamic feature in the recording process, and the replay can be completed automatically according to the logic and point item value conditions operated in the simuRTS in the replay process. In addition, the operator online program is single threaded, and execution of dynamic properties is sequentially performed sequentially for a plurality of different pages, and it is required to ensure that the interactive properties and panel operations cannot block execution of dynamic properties during replay, and specific schemes are described in replay mode.

(2) The implementation scheme of the interaction characteristics comprises the following steps:

the interactive feature is the main content of the operation replay, and compared with the dynamic feature, the same is that one interactive feature corresponds to one VB function call in the script, except that the interactive feature is not executed each time, the execution sequence, the time, the interactive content and the like are uncertain, so that the recording of the interactive operation cannot be completed by using the interactive feature script recorded in the page only.

When entering the recording mode, the operator needs to record online:

an operational page;

symbol objects on a page;

mouse position (for auxiliary display only, and not dependent on position to perform actions);

the characteristics include mouse action of a user, a path of movement of the mouse, keyboard key action and keyboard input content.

The mouse actions include the following "response events" in the interaction characteristics:

pressing the left button of the mouse;

lifting a left button of the mouse;

pressing the right button of the mouse;

lifting a right button of the mouse;

double clicking the left button of the mouse;

mouse movement events in the interaction property are used for the tip property, which is not itself supported, and thus this action is not supported. But the movement track of the mouse needs to be recorded for auxiliary display of the movement track of the mouse during playback.

Other interaction characteristic events include:

pressing a keyboard;

lifting a keyboard;

an online period;

starting on-line;

input value completion

Other unsupported interaction characteristic events include:

focus loss

The implementation process comprises the following steps:

1) Mouse action: the execution object of the mouse action is a page symbol, and when the mouse operates the object, an operator judges the specific page symbol operated on line according to the position generated by the mouse action;

2) Recording the content: in the response function corresponding to the mouse action, recording symbol ID, mouse action (left mouse button is pressed, left mouse button is lifted, right mouse button is pressed, right mouse button is lifted, left mouse button is double-clicked), relative time of action execution (relative to the time of starting recording), and allocating an ID for the record to index an operation process, and storing the above contents into a file.

3) For operation panels such as a numerical keyboard, a secondary confirmation, a function block panel, etc., a right-key menu, and an edit box (set-point feature (numerical keyboard))

And the keyboard event and the keyboard input need to be processed separately, and the recorded content comprises: symbol ID, operation content, control ID, control name, control data, page name of operation.

(3) Operation panel and other non-characteristic operation implementation schemes:

1) An operation panel:

a) Spark plate: the actions of the operation panel of the spark plate are basically built by characteristics, and the recording of the operation process of the operation panel can be executed according to the implementation scheme of dynamic characteristics and interaction characteristics, and meanwhile, the ejection position of the panel needs to be recorded.

b) General edition: the operation panel of the universal version is rarely constructed by using characteristics, and is mostly realized by using the page APC object and the background script thereof, and the content needs to be specific to the specific realization of the background script of each operation panel APC object, and the recording function is added in the realization process of each sub-function of each page. (this part occupies the vast majority of the workload, the solution needs to be expanded continuously, this requirement does not include a generic version, which is not implemented at all)

2) Other non-characteristic operations:

other non-characteristic operations include: numeric keypad, secondary confirmation, function block panel, right key menu, edit box (set point feature (numeric keypad)), etc.

a) The numeric keypad, the secondary confirmation, the function block panel and the right key menu are realized in a background script of the APC object, and specific actions are recorded into a file on line by an operator.

b) Keyboard input requires recording of keyboard input content during recording and is associated with receipt of the content.

c) Recording without panel dragging

1.2 replay mode:

in order to not influence the operation of an operator on the online main thread, the playback of all actions is uniformly processed by starting one playback thread, and the content processed by the playback thread comprises the following four parts:

a mouse action;

interaction characteristics;

playback of an ActiveX control object;

operations other than mouse movements, interaction characteristics, controls, such as inputs on a numeric keypad, etc.

(1) Replay of dynamic characteristics:

the playback of dynamic characteristics utilizes the characteristic script recorded by the page itself and the periodic call of the page script, and the playback effect of the dynamic characteristics depends on the data of the current working condition because the history station has no concept of working condition.

Description: because the history station has no working condition, the related service point items cannot be stored.

(2) Interactive features, control operations, replay of other panel operations:

the interactive characteristic is operation-triggered, the replay process is to play back independently of the operation itself, the recorded operation content is completely dependent on the recording mode, and the recorded playback file is loaded first when the replay mode is entered, and the playback is performed according to the recorded time sequence. The recording modes of the control and other panel operations are the same as the interaction characteristics, so the playback modes are the same, and the recorded contents of the control, the other panel operations are different, and the specific processing time sequence is as follows:

(3) Exiting the replay mode:

the replay mode is performed through a combination key, and the ESC is tentatively set at present, and if conflict exists, the adjustment is performed again. 1.3, record is saved:

when the record is saved, a saving path can be selected, the default path is a 'HOLLiAS_MACS_REPLAY' directory, the recorded file name should be defaulted to contain the recorded time, the time is accurate to seconds, the time is used for distinguishing different records, the playback is not influenced, and the user can name the recorded file by himself.

1.4 load record:

and opening a record selection dialog box, clicking replay after the record is selected, and starting playback. 1.5 voice function:

the implementation of text speech utterances requires Microsoft Speech SDK support, and this SDK includes a speech application design interface (SAPI), microsoft's continuous speech recognition engine (MCSR), microsoft's speech synthesis (TTS) engine, and so forth. TTS (text to speech) is used to implement speech synthesis, and TTS itself is implemented based on COM.

The implementation of the sounding component is realized by calling a TTS, the sounding component controls the sounding of the text by calling an ISPVoice interface, and once an application program creates an ISPVoice object, the sounding component program only needs to call the ISPVoice: : the speaker may generate sound through the entered text.

The API of SAPI provides a high-level interface between an application and a speech engine. SAPI implements all of the low-level details required to control and manage the real-time operation of the various speech engines.

FIG. 1 is a general architecture of a Spech API, from which it can be seen that the Speech engine interacts with SAPI (Speech API) through the DDI layer (device driver interface), through which applications communicate with the SAPI. By using these APIs, it is possible to develop an application program in terms of speech recognition or speech synthesis, realizing the speech function of the replay process.

The sounding component calls an interface ISPVoice to realize a voice function, and the ISPVoice interface belongs to the class of SpVoice. The ISpVoice interface is shown in fig. 2 below. Since each instance of spoice contains its own queue input stream (usually just text) and its own output stream (usually an audio device). When an application calls ISpVoice:: speaker, the text item that comes next is added to the end of the SpVoice queue, so the integrity of the current utterance is made with this own mechanism of SpVoice so that the current utterance is not interrupted by an immediately incoming utterance request.

1.6 data interface:

the following data interfaces are provided on-line by the operator.

(1) Operation replay interface:

interface definition:

STDMETHOD(OperationReplay)(long RecFlag,long

*lRet)；

functional description:

recording, playback, and stopping function interfaces.

(2) Wm_writerechstrigger interface:

interface definition:

STDMETHOD(WM_WriteRecHSTrigger)(long nID,longnMsgType,long nMsgPar,long ptX,long pTY,BSTRbsDocName)；

functional description:

and the interaction characteristic recording interface is used for providing interaction characteristic recording.

(3) Wm_writerecactigvex interface:

interface definition:

STDMETHOD(WM_WriteRecActiveX)(long nID,BSTRbsControlName,BSTR bsData,BSTR bsDocName)；

functional description:

and operating the recording interface by the editing frame and the drop-down frame, and recording the editing frame and the drop-down frame.

(4) Wm_writerec special interface:

interface definition:

STDMETHOD(WM_WriteRecSpecial)(long nParam,BSTRbsData,BSTR bsDocName)；

functional description:

operations other than interactive features, edit boxes, drop-down boxes are recorded, such as operations on a function block panel, and the like.

(5) Getracinfo interface:

interface definition:

STDMETHOD(GetRecInfo)(long *RecState,DATE *dRecTime)；

functional description:

recording time information is acquired.

(6) The RECUpLoad interface:

interface definition:

STDMETHOD(RECUpLoad)()；

functional description:

the interface of the record content uploading server is internally provided with an uploading interface.

(7) RECTURALADY interface:

interface definition:

STDMETHOD(RECDownLoad)()；

functional description:

and recording a content downloading interface, and providing the downloading interface inside the interface.

(8) NotifyGroupOPS interface:

interface definition:

STDMETHOD(NotifyGroupOPS)(long lCommand)；

(9) NotifySimuRTS interface:

interface definition:

STDMETHOD(NotifySimuRTS)(long lCommand,long*lRet)。

the beneficial effect of this patent lies in:

the invention uses the recording and playback management functions of the virtual DPU simulation software, can record each step of detailed process of the operation simulation machine by a learner, can adjust and take any time operation record playback to indicate the operation error of the learner, and carries out correct operation demonstration, thus truly realizing intelligent organic integration of simulation and industrial production, training a coach to record the standard process system operation or accident handling flow in advance, being used for simulation operation and accident exercise training of the operator, saving repeated operation time of the learner, reducing misoperation of the learner and reducing economic losses of enterprises and individuals.

Although the present invention has been described with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments described, or equivalents may be substituted for elements thereof, and any modifications, equivalents, improvements and changes may be made without departing from the spirit and principles of the present invention.

Claims (2)

1. The operation replay system based on the virtual DCS simulation training system is characterized in that the system comprises: the system comprises an operator online operation module, a graphic editing module, an operation replay module, a dynamic characteristic and interactive characteristic definition script module, a page basic code module, an ActiveX control expansion module and a SimuRTS controller simulation module;

the functions of the operator online operation module: operating a replay function action record; operating replay function playback; synchronously recording by different operators in the same group;

the function of the graphic editing module: generating basic codes for supporting an operation replay function for page scripts in the page saving process;

the function of the operation replay module: the super user level is used for managing the operation replay process;

the dynamic characteristics and the interaction characteristics define the functions of the script module: basic codes for defining dynamic and interactive characteristic functions are defined and maintained by secondary developers, and are used for realizing recording and playback of dynamic interactive characteristics in an operation replay function;

the function of the page basic code module: the script is used for defining the basic function of the page, and is used for cooperatively realizing recording and playback actions in the operation replay function;

the function of the ActiveX control expansion module: in the macs software, components for extending functions are included: the editctrlx and ComboFCtrl controls;

the function of the SimuRTS controller simulation module: the method is used for controller simulation, and is used for simulating synchronous recording and playback of the controller in the operation replay function.

2. The operation method of the operation replay system based on the virtual DCS simulation training system is characterized by comprising the following steps of:

1.1. recording mode:

(1) The dynamic characteristic implementation scheme is as follows:

the characteristics of DCS series software are realized through page scripts, namely, one dynamic characteristic corresponds to a section of VB function, one characteristic of one object configuration corresponds to the call of one VB function, so after the configuration is finished, the dynamic characteristic is recorded and stored in a page, and the execution of the dynamic characteristic on the object is sequentially called and finished in a page timer, so that the script call of the dynamic characteristic of the object stored in the page is directly multiplexed without recording the dynamic characteristic in the recording process, and the replay can be finished automatically according to the logic and point item value conditions operated in the virtual DPU in the replay process; in addition, the operator online program is single-threaded, execution of dynamic characteristics of a plurality of different pages is sequentially completed in turn, and interaction characteristics and incapability of blocking execution of the dynamic characteristics in a replay process of panel operation are required to be ensured, and a specific scheme is described in a replay mode;

(2) The implementation scheme of the interaction characteristics comprises the following steps:

after entering the recording mode, the operator needs to record online:

an operational page;

symbol objects on a page;

a mouse position;

mouse actions, moving paths, keyboard key actions and input contents which are needed in the characteristics;

mouse movement events in the interaction property are used for the tip property, which is not itself supported, and thus this action is not supported. But the movement track of the mouse needs to be recorded and is used for assisting in displaying the movement track of the mouse during playback;

the implementation process comprises the following steps:

1) Mouse action: the execution object of the mouse action is a page symbol, and when the mouse operates the object, an operator judges the specific page symbol operated on line according to the position generated by the mouse action;

2) Recording the content: recording symbol ID, mouse action, relative time of action execution in response function corresponding to mouse action, and assigning an ID to the record for indexing an operation process, and storing the above contents into file;

3) For ejecting a numeric keyboard, secondary confirmation, a function block panel and other operation panels, a right key menu, an edit box, a keyboard event and keyboard input in the interaction characteristics, the independent processing is required, and the recorded content comprises: symbol ID, operation content, control ID, control name, control data and page name of operation;

(3) Operation panel and other non-characteristic operation implementation schemes:

1) An operation panel:

a) The actions of the operation panel of the DCS are basically built by characteristics, the recording of the operation process of the operation panel can be executed according to the implementation scheme of dynamic characteristics and interaction characteristics, and the ejection position of the panel is required to be recorded;

2) Other non-characteristic operations:

other non-characteristic operations include: numeric keypad, secondary confirmation, function block panel, right key menu, edit box operation;

a) The numeric keyboard, the secondary confirmation, the function block panel and the right key menu are realized in a background script of the APC object, and specific actions are recorded into a file on line by an operator;

b) The keyboard input needs to record the keyboard input content in the recording process and is associated with the receiving of the content;

1.2 replay mode:

in order to not influence the operation of an operator on the online main thread, the playback of all actions is uniformly processed by starting one playback thread, and the content processed by the playback thread comprises the following four parts: a mouse action; interaction characteristics; playback of an ActiveX control object; operations other than mouse actions, interaction characteristics, controls;

(1) Replay of dynamic characteristics:

the playback of dynamic characteristics utilizes the characteristic script recorded by the page itself and the periodic call of the page script, and the playback effect of the dynamic characteristics depends on the data of the current working condition because the history station has no concept of working condition;

description: because the history station has no working condition, the related service point items cannot be stored;

(2) Interactive features, control operations, replay of other panel operations:

the interactive characteristic is operation-triggered, the replay process is to play back independently of the operation itself, the recorded operation content is completely dependent on the recording mode, and the recorded playback file is loaded first when the replay mode is entered, and the playback is performed according to the recorded time sequence. The recording modes of the control and other panel operations are the same as the interaction characteristics, so that the playback modes are the same, and the recorded contents of the control, the other panel operations are different;

(3) Exiting the replay mode:

the replay mode is carried out through a combination key, the ESC is tentatively set at present, and if conflict exists, adjustment is carried out again;

1.3, record is saved:

when the record is saved, a saving path can be selected, the time of the record is included in the file name of the record by default, the time is accurate to seconds, the time is used for distinguishing different records, the playback is not influenced, and a user can name the record file by himself;

1.4 load record:

opening a record selection dialog box, clicking replay after selecting the record, and starting playback;

1.5 voice function:

microsoft Speech SDK support is required for text speech, and the SDK includes a speech application design interface SAPI, a microsoft continuous speech recognition engine MCSR, and a microsoft speech synthesis TTS engine. The TTS is used for realizing voice synthesis and is realized based on COM; the implementation of the sounding component is realized by calling a TTS, the sounding component controls the sounding of the text by calling an ISPVoice interface, and once an application program creates an ISPVoice object, the sounding component program only needs to call the ISPVoice: : speaker may generate sound through the entered text;

the API of SAPI provides a high-level interface between an application and a speech engine; SAPI implements all of the low-level details required to control and manage the real-time operation of the various speech engines;

the speech engine then interacts with SAPI (Speech API) through the DDI layer (device driver interface) and the application communicates with the SAPI through the API layer. By using these APIs, it is possible to develop an application program in terms of speech recognition or speech synthesis, realizing the speech function of the replay process;

the sounding component calls an interface ISPVoice to realize a voice function, and the ISPVoice interface belongs to the class of SpVoice; since each SpVoice instance contains its own queue input stream and its own output stream; when an application calls ISPVoice, the text item coming later is added to the end of the SpVoice queue, so the integrity of the current voice is enabled by the self mechanism of SpVoice, so that the current voice is not interrupted by an immediately incoming voice request;

1.6 data interface:

the data interfaces are all provided on-line by an operator, including:

(1) Operation replay interface

(2) WM_WriteRecHSTrigger interface

(3) WM_WriteRecActiveX interface

(4) WM_WriteRecspecials interface

(5) GetRIcinfo interface

(6) The RECHUpLoad interface (7) RECHEDUnLoad interface (8) NotifyGroupOPS interface (9) NotifySimuRTS interface.

Images