CN116663963B

CN116663963B - Management method and system of evaluation supervision expert

Info

Publication number: CN116663963B
Application number: CN202310472884.XA
Authority: CN
Inventors: 彭琦峰; 杨晓东; 张晨; 徐家祥; 陈云鹏; 覃会知; 王建东; 程启
Original assignee: Three Gorges High Technology Information Technology Co ltd
Current assignee: Three Gorges High Technology Information Technology Co ltd
Priority date: 2023-04-28
Filing date: 2023-04-28
Publication date: 2024-01-05
Anticipated expiration: 2043-04-28
Also published as: CN116663963A

Abstract

The invention provides a management method and a system of evaluation supervision specialists, wherein the method comprises the following steps: s1: performing personnel warehousing operation and initial evaluation on the evaluation supervision experts to obtain the initial evaluation grade of each evaluation supervision expert; s2: training record tracking is carried out on the bid evaluation supervision expert to obtain a training track record of the bid evaluation supervision expert; s3: carrying out multidimensional scoring on the annual label records of the label-evaluation supervision expert and updating the corresponding initial grade to obtain an annual grade; s4: determining the priority grade of the bid evaluation supervision expert on the bid evaluation supervision task; s5: based on expert extraction rules of the bid evaluation supervision task, screening out a bid evaluation supervision expert group from all bid evaluation supervision experts; the management quality and management efficiency of the bid evaluation supervision expert are improved through personnel warehousing, initial rating, training tracking, annual assessment scoring, priority scoring of the bid evaluation supervision task and intelligent extraction overall process management.

Description

Management method and system of evaluation supervision expert

Technical Field

The invention relates to the technical field of bid evaluation supervision, in particular to a management method and system of a bid evaluation supervision expert.

Background

In a bid-recruitment purchasing activity, bid evaluation is an important link, and supervision of the bid evaluation process is the role of a bid evaluation supervision expert. The professional skills and comprehensive quality of the bid evaluation supervision expert directly determine the supervision quality of bid and purchase projects. The management of the evaluation supervision expert relates to a plurality of links such as personnel information management, training management, grade evaluation, expert extraction, supervision result evaluation and the like. The existing management method of the evaluation and supervision expert mostly realizes the management of the evaluation and supervision expert by manually inputting the input information of each link, and the grade evaluation or the acquisition of the expert extraction or supervision result mostly adopts a manual evaluation mode or manually setting evaluation conditions and extraction conditions to acquire management information, so that the evaluation and supervision expert mostly adopts an off-line management mode.

However, the offline management mode not only causes management errors due to large data volume, but also causes incapability of forming whole-process flow management due to information difference and time difference among management links due to the fact that a large number of workers are involved in a plurality of links in the management process of evaluation supervision specialists in manual management, and management efficiency is low.

Therefore, the invention provides a management method and a management system for evaluation supervision specialists.

Disclosure of Invention

The invention provides a management method and a system for evaluation and supervision experts, which are used for carrying out overall process management of priority scoring and intelligent extraction on evaluation and supervision tasks through personnel warehousing, initial rating, training tracking and annual assessment scoring on the evaluation and supervision experts, overcoming management errors of manual management, reducing information difference and time difference between management links and improving management quality and management efficiency on the evaluation and supervision experts.

The invention provides a management method of a bid evaluation supervision expert, which comprises the following steps:

s1: performing personnel warehousing operation and initial rating on the evaluation supervision experts to obtain an initial rating of each evaluation supervision expert;

s2: training record tracking is carried out on the bid evaluation supervision expert, and a training track record of the bid evaluation supervision expert is obtained;

s3: carrying out multidimensional scoring on the annual supervision records of the evaluation supervision expert to obtain an annual total score, and updating the corresponding initial evaluation grade based on the annual total score to obtain an annual evaluation grade;

s4: determining the priority grade of the evaluation supervision task by the evaluation supervision expert based on the priority order of all the item attributes of the evaluation supervision task and the adjacent supervision items of the evaluation supervision expert;

S5: and screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on the training tracking record of the bid evaluation supervision experts, the annual evaluation grade, the priority scoring of the bid evaluation supervision tasks and the expert extraction rules of the bid evaluation supervision tasks.

Preferably, the method for managing the bid evaluation supervision expert comprises the following steps of: the personnel warehousing operation and the initial rating are carried out on the evaluation supervision expert, and the initial rating of each evaluation supervision expert is obtained, which comprises the following steps:

s101: receiving a registration application of a bid evaluation supervision expert initiated from a client, and acquiring information from a corresponding client based on the registration application to obtain an information acquisition result;

s102: determining a corresponding auditing flow based on the information acquisition result, auditing and real-name authentication are carried out on the corresponding client and the corresponding information acquisition result based on the corresponding auditing flow, and a personnel warehousing result is obtained;

s103: based on the information category list required by the initial evaluation, extracting personalized information required by the evaluation supervision expert from the personnel warehousing result;

s104: and (5) primarily grading the corresponding rating supervision expert based on the information required by the personalized primary rating to obtain the primary rating.

Preferably, the method for managing the bid evaluation supervision expert comprises the following steps of: training record tracking is carried out on the bid evaluation supervision expert, and a training track record of the bid evaluation supervision expert is obtained, wherein the training record comprises the following steps:

Acquiring an on-line training progress record result of a bid evaluation supervision expert from an on-line training system;

acquiring an offline training progress record result of a bid evaluation supervision expert from an offline training tracking system;

and obtaining a training tracking record of the bid evaluation supervision expert based on the on-line training progress record result and the off-line training progress record result.

Preferably, the method for managing the bid evaluation supervision expert comprises the following steps of: the method for obtaining the annual total score by carrying out multidimensional scoring on the annual supervision records of the evaluation supervision expert, and obtaining the annual evaluation grade based on the corresponding initial evaluation grade updated by the annual total score comprises the following steps:

determining the item types of all the supervision items in the annual supervision record;

determining all scoring dimensions of the prison item based on the item types, acquiring the scoring value of the scoring source end of each scoring dimension of the prison item, and determining the personalized scoring value of each scoring dimension of the prison item based on the scoring weight and the corresponding scoring value corresponding to the scoring source end of each scoring dimension of the prison item;

determining the project weight based on the project information of the prison project;

determining the total grading value of the annual prison record in the corresponding grading dimension based on the item weights and the personalized grading values of all prison items in the same grading dimension in the annual prison record;

Determining the total annual score of the annual prison record based on the dimensionality weights and the total score values of all scoring dimensionalities of all prison items of the annual prison record;

and updating the corresponding initial grade based on the total annual score and the grade grading condition to obtain the annual grade.

Preferably, the method for managing the bid evaluation supervision expert comprises the following steps of: based on the priority order of all item attributes of the bid evaluation supervision task and the adjacent bid items of the bid evaluation supervision expert, determining the priority score of the bid evaluation supervision expert on the bid evaluation supervision task comprises the following steps:

determining item attribute information of all item attributes of the evaluation and supervision task as first item attribute information, and determining priority orders of all item attributes based on the first item attribute information;

determining item attribute information of all item attributes of adjacent supervision items of the evaluation supervision expert as second item attribute information;

determining a place priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on a bid evaluation place interval value between a first bid evaluation place in the first item attribute information and a second bid evaluation place in the second item attribute information;

Determining the time priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on a first bid evaluation time period in the first item attribute information and a second bid evaluation time period in the second item attribute information;

determining a type proximity coefficient between a first service type in the first item attribute information and a second service type in the second item attribute information, and determining a type priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on the type proximity coefficient;

and determining the priority score of the bid evaluation supervision expert on the bid evaluation supervision task based on the place priority score, the time priority score, the type priority score and the priority sequence of all the project attributes of each bid evaluation supervision expert on the bid evaluation supervision task.

Preferably, the method for managing the bid evaluation supervision expert determines a time priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on a first bid evaluation time period in the first item attribute information and a second bid evaluation time period in the second item attribute information, including:

judging whether second evaluation time periods overlapped with first evaluation time periods in the first item attribute information exist in all second item attribute information or not;

If yes, setting the time priority score of the corresponding bid evaluation supervision expert on the bid evaluation supervision task to be 0;

otherwise, determining the time priority grade of each bid evaluation supervision expert on the bid evaluation supervision task based on the time interval of the first bid evaluation time period in the first item attribute information and the second bid evaluation time period in the second item attribute information.

Preferably, the method for managing the comment supervision expert determines a type proximity coefficient between a first service type in the first item attribute information and a second service type in the second item attribute information, including:

based on the first service type in the first item attribute information and the second service type in each second item attribute information, respectively combining to obtain a plurality of service type combinations;

determining a first record total number of massive historical annual ring label records, determining a second record total number of the historical annual ring label records simultaneously containing the service types in the service type combination, and determining the combination weight of the corresponding service type combination based on the first record total number and the second record total number;

determining the type proximity ratio of the corresponding service type combination in the corresponding historical annual ring label record based on the item ordinal interval of the service type contained in the service type combination in the historical annual ring label record containing the service type in the corresponding service type combination and the total number of items of the corresponding historical annual ring label record;

Based on the combination weights of the service type combinations and the type proximity ratio in each historical annual prison record simultaneously containing the service types in the corresponding service type combination, a type proximity coefficient between the service types contained in the service type combination is determined.

Preferably, the method for managing the bid evaluation supervision expert comprises the following steps of: screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on a training tracking record of the bid evaluation supervision experts, a annual evaluation grade, a priority score of the bid evaluation supervision tasks and expert extraction rules of the bid evaluation supervision tasks, including:

determining the to-be-completed training progress of the bid evaluation supervision expert based on the annual evaluation grade, determining the current completed training progress based on the training tracking record, and determining the training progress completion rate of the bid evaluation supervision expert based on the current completed training progress and the corresponding to-be-completed training progress;

determining the comprehensive scoring proportion of the corresponding bid evaluation supervision expert based on the annual evaluation grade, and determining the personalized comprehensive scoring of the bid evaluation supervision expert on the bid evaluation supervision task based on the comprehensive scoring proportion, the training progress completion rate of the corresponding bid evaluation supervision expert and the priority scoring of the bid evaluation supervision task;

And screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on expert extraction rules of the bid evaluation supervision tasks and personalized comprehensive scores of all bid evaluation supervision experts of each annual evaluation grade.

Preferably, the management method of the bid evaluation supervision expert, based on expert extraction rules of the bid evaluation supervision task and personalized comprehensive scores of all bid evaluation supervision experts of each annual evaluation grade, screens out bid evaluation supervision expert groups among all bid evaluation supervision experts, includes:

determining the target number of people of each annual evaluation grade in the evaluation supervision expert group based on expert extraction rules of the evaluation supervision task;

and screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on the personalized comprehensive scores of all bid evaluation supervision experts of each annual evaluation grade and the target number of each annual evaluation grade.

The invention provides a management system of an evaluation supervision expert, which comprises the following components:

the primary evaluation module is used for carrying out personnel warehousing operation and primary rating on the bid evaluation supervision experts to obtain the primary evaluation grade of each bid evaluation supervision expert;

the training tracking module is used for tracking training records of the bid evaluation supervision experts and obtaining training tracking records of the bid evaluation supervision experts;

The annual scoring module is used for carrying out multidimensional scoring on the annual supervision records of the bid evaluation supervision expert to obtain an annual total score, and updating the corresponding initial evaluation grade based on the annual total score to obtain an annual evaluation grade;

the priority scoring module is used for determining the priority scoring of the bid evaluation supervision expert on the bid evaluation supervision task based on the priority sequence of all the item attributes of the bid evaluation supervision task and the adjacent bid evaluation items of the bid evaluation supervision expert;

the intelligent screening module is used for screening out the bid evaluation supervision expert group from all bid evaluation supervision experts based on training tracking records of the bid evaluation supervision experts, annual evaluation grades, priority scores of the bid evaluation supervision tasks and expert extraction rules of the bid evaluation supervision tasks.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.

The technical scheme of the invention is further described in detail through the drawings and the embodiments.

Drawings

The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:

FIG. 1 is a flowchart of a management method of a bid evaluation supervision expert in an embodiment of the invention;

FIG. 2 is a flowchart of a management method of a bid evaluation supervision expert in an embodiment of the present invention;

fig. 3 is a schematic diagram of a management system of an evaluation supervision expert in an embodiment of the invention.

Detailed Description

The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.

Example 1:

the invention provides a management method of an evaluation supervision expert, which comprises the following steps of:

In this embodiment, the bid evaluation supervising expert is a professional having a certain level of compliance with all documents or activities in the bid bidding process during bid bidding and government procurement activities.

In this embodiment, the personnel warehousing operation is an operation of storing basic information, professional information, practice qualification information, title information, biological characteristic information (such as fingerprint, iris, facial facies) and the like of the bid evaluation supervision expert into the bid evaluation supervision expert information base.

In this embodiment, the primary rating is a process of determining the primary rating of the rating supervision expert based on the result obtained after the personnel warehousing operation of the rating supervision expert.

In this embodiment, the initial rating is the initial rating of the bid evaluation supervision expert obtained after the personnel warehousing operation and the initial rating are performed on the bid evaluation supervision expert.

In the embodiment, the training record tracking is the operation of online and offline training record tracking participated by the evaluation supervision expert.

In the embodiment, the training tracking record is a record obtained after training record tracking is performed on the bid evaluation supervision expert.

In this embodiment, the multidimensional grading is an operation of grading the annual label records of the bid evaluation supervision expert from multiple grading dimensions, and for the project implemented by the proxy agency, the grading dimensions include, for example, 60% of the representative grading weight of the signer delegated by the project unit, and 40% of the grading weight of the project manager of the agency; for non-bidding projects such as competitive negotiations, price enquiries and the like implemented by the project unit self-organization, the scoring dimension comprises 60% of scoring weights of panelists assigned by the project unit, and 40% of scoring weights of persons related to bidding purchasing posts are built in.

In this embodiment, the annual bid record is a record containing all bid items that the bid evaluation and supervision expert participates in within the year, and the bid items are the items that the bid evaluation and supervision expert participates in to supervise the bidding process.

In this embodiment, the total annual score is a score value obtained by performing multidimensional scoring on the annual label record of the label-scoring supervision expert.

In this embodiment, the annual rating scale is a new scale obtained after updating the initial rating scale of the corresponding rating scale supervision expert based on the annual total score.

In this embodiment, the bid evaluation and supervision task is the bid evaluation item which is about to be executed and needs to be determined currently for the corresponding bid evaluation and supervision expert group.

In this embodiment, the item attribute is an attribute of the prison item, for example, there are a bid evaluation place, a bid evaluation time period, a business type, and the like.

In this embodiment, the priority order is the order of determining the importance degree of the item attribute to be referred to when the rating supervision expert scores the priority of the rating supervision task on the priority scoring result.

In this embodiment, the adjacent label item is the label item that the label evaluation supervision expert participates in the last time from the current moment.

In this embodiment, the priority score is a score value representing the priority of the member of the bid evaluation and supervision expert group according to which the bid evaluation and supervision expert group of the bid evaluation and supervision task is selected.

In this embodiment, the expert extraction rule is a rule according to which members of the evaluation supervision expert group performing the evaluation supervision task are extracted, for example:

The principle of 3+2 is adopted, namely 3 recommendation expert lists and 2 random expert lists;

or when the threshold value of the item amount is more than or equal to 50 ten thousand, the system only recommends the supervision expert with the expert grade of 'A grade', and when the threshold value is less than 50 ten thousand, the system can recommends all the grades of supervision expert; the supervising expert rated "C" does not recommend.

In this embodiment, the bid evaluation and supervision expert group is a member group formed by bid evaluation and supervision experts executing the corresponding bid evaluation and supervision task.

The beneficial effects of the technology are as follows: the personnel of the bid evaluation supervision expert are subjected to warehousing, initial rating, training tracking, annual assessment and scoring updating, priority scoring of the bid evaluation supervision task is determined, and the whole process management of intelligent extraction is performed, so that the management error of manual management is overcome, the information difference and time difference between management links are reduced, and the management quality and management efficiency of the bid evaluation supervision expert are improved; the intelligent extraction of the evaluation supervision expert group of the evaluation supervision task is realized based on the training tracking record, the annual evaluation grade, the priority grading of the evaluation supervision task and the expert extraction rule of the evaluation supervision task, which are automatically acquired.

Example 2:

based on the embodiment 1, the method for managing the comment supervision expert comprises the following steps of: the personnel warehousing operation and the initial rating are carried out on the evaluation supervision expert, and the initial rating of each evaluation supervision expert is obtained, and referring to fig. 2, the method comprises the following steps:

In this embodiment, the client is a communication end for initiating a registration application.

In this embodiment, the registration application is an application for applying for personnel warehousing of a new bid evaluation supervision expert.

In this embodiment, the information collection is to collect basic information, professional information, practice qualification information, title information, biometric information (such as fingerprint, iris, facial phase) and the like of the comment supervision expert, and specifically includes:

And generating an information acquisition table based on the registration application, sending the information acquisition table to the corresponding client and receiving the information acquisition table fed back by the corresponding client, thus finishing information acquisition.

In this embodiment, the information collection result is a result obtained after information collection is performed on the corresponding client based on the registration application, and includes, for example, basic information, professional information, practice qualification information, title information, biometric information (such as fingerprint, iris, facial phase) and the like of the evaluation supervision expert.

In this embodiment, the auditing process is a process of auditing the bid evaluation supervision expert, and is an auditing process corresponding to a professional or corresponding professional qualification based on professional information or professional qualification information matching in the information acquisition result of the bid evaluation supervision expert, i.e. the auditing process can be distinguished according to the professional or different professional qualifications.

In the embodiment, the auditing and real-name authentication means that the information acquisition result is audited, and real-name authentication is performed on the evaluation supervision expert based on the information acquisition result, for example, real-name authentication in the modes of inputting identity card information or facial information and the like.

In the embodiment, the personnel warehousing result is a result obtained after personnel warehousing is carried out on the evaluation supervision expert.

In this embodiment, the list of information types required for initial evaluation is a list including information types required for initial rating by the rating supervision expert, for example: information types such as professional types, professional qualifications, job titles, total number of participating prison mark projects and the like.

In this embodiment, the information required for personalized initial evaluation is the information required for determining the initial evaluation grade of the corresponding evaluation supervision expert, which is extracted from the personnel warehousing result based on the information type list required for initial evaluation.

In this embodiment, the primary rating of the corresponding rating supervising expert based on the information required for personalized primary rating is obtained, including:

based on preset initial evaluation rules (for example, the initial evaluation grade of the evaluation supervision expert with the highest title and more than 100 total number of the participated supervision items is set as A grade, the initial evaluation grade of the evaluation supervision expert with the next highest title and more than 80 total number of the participated supervision items is set as A grade, and the like) and information required by personalized initial evaluation, the corresponding evaluation supervision expert is initially rated, and the initial evaluation grade is obtained.

The beneficial effects of the technology are as follows: the method comprises the steps of completing information collection of evaluation supervision experts based on registration applications received from clients, matching corresponding auditing flows based on information collection results, auditing and real-name authentication based on the auditing flows, realizing auditing and real-name authentication of different evaluation supervision experts by adopting different auditing modes, improving the diversity and flexibility of the auditing modes, improving the rigor of the auditing results, realizing automatic extraction and automatic initial rating of information required by initial evaluation, realizing automatic input and automatic initial rating of information, and preliminarily reducing management errors.

Example 3:

based on the embodiment 1, the method for managing the comment supervision expert comprises the following steps of: training record tracking is carried out on the bid evaluation supervision expert, and a training track record of the bid evaluation supervision expert is obtained, wherein the training record comprises the following steps:

In this embodiment, the on-line training system is a system for providing on-line training records in which on-line training is measurable and each evaluation supervision expert is counted.

In this embodiment, the on-line training progress recording result is a result of recording the progress of the on-line training course completed by the comment supervision expert obtained from the on-line training system.

In this embodiment, the off-line training tracking system is a system for receiving relevant information (i.e., an off-line training progress record result of the evaluation and supervision expert) of the situation that the evaluation and supervision expert participates in the off-line training, which is input by a special person.

In this embodiment, the offline training progress recording result is a result of recording the measurable progress of offline training completed by the bid evaluation and supervision expert obtained from the offline training tracking system.

In the embodiment, based on the on-line training progress record result and the off-line training progress record result, a training tracking record of a bid evaluation supervision expert is obtained, namely:

and summarizing the on-line training progress record result and the off-line training progress record result to obtain the training tracking record of the bid evaluation supervision expert.

The beneficial effects of the technology are as follows: the on-line training progress and off-line training progress tracking of the bid evaluation supervision expert are realized, the input information quantity is reduced, and the automatic summarization of the training progress information is realized.

Example 4:

based on the embodiment 1, the method for managing the comment supervision expert comprises the following steps of: the method for obtaining the annual total score by carrying out multidimensional scoring on the annual supervision records of the evaluation supervision expert, and obtaining the annual evaluation grade based on the corresponding initial evaluation grade updated by the annual total score comprises the following steps:

In this embodiment, the bid item is a bid supervision item that is included in the annual bid record by a corresponding bid supervision expert.

In this embodiment, the item types include, for example, items implemented by a proxy agency and non-bid items such as competitive negotiations, price queries, etc., implemented by the project organization itself.

In this embodiment, for a project implemented by a proxy agency, the scoring dimension includes, for example, a signer representative scoring weight of 60% for project unit delegation, and a agency project sponsor scoring weight of 40%; for non-bidding projects such as competitive negotiations, price enquiries and the like implemented by the project unit self-organization, the scoring dimension comprises 60% of scoring weights of panelists assigned by the project unit, and 40% of scoring weights of persons related to bidding purchasing posts are built in.

In this embodiment, the scoring source is a source communication end of scoring values of the prison item in the corresponding scoring dimension, such as a communication end of a signer and an agency project manager of the project unit delegation.

In this embodiment, the scoring value is a scoring value obtained from the scoring source.

In this embodiment, the scoring weight characterizes a ratio of the scoring value obtained by the corresponding scoring source to the scoring value of the corresponding scoring dimension.

In this embodiment, determining the personalized score value of each score dimension of the prison item based on the score weight and the corresponding score value corresponding to the score source end of each score dimension of the prison item includes:

the product of the scoring weight corresponding to the scoring source end of each scoring dimension of the prison item and the corresponding scoring value is taken as the personalized scoring value of the corresponding scoring dimension of the prison item;

the personalized evaluation value is the grading value of the prison label item in the corresponding grading dimension.

In this embodiment, the item weight is a value representing the importance degree of the prison item in all the prison items in the annual prison record determined based on the item information, and the item weight is determined based on a preset manner and the item information, for example: and taking the ratio of the sum of the item amount in the item information and the item amount of all the supervision items in the annual supervision record as the item weight.

In this embodiment, the project information is information related to the prison project, such as project amount, bid scale, etc.

In this embodiment, determining the total score value of the yearly monitor record in the corresponding score dimension based on the item weights and the personalized score values of all monitor items in the same score dimension in the yearly monitor record includes:

taking the average value of the products of the item weights and the personalized score values of all the index items with the same score dimension in the annual index record as the total score value of the annual index record in the corresponding score dimension;

the total score value is the score value of the characteristic annual prison record in the corresponding score dimension.

In this embodiment, the dimension weight is the dimension weight of the corresponding scoring dimension, which is the ratio of the total number of the bidding items in the yearly bidding record containing the corresponding scoring dimension to the total number of all the bidding items in the yearly bidding record.

In this embodiment, determining the total annual score of the annual prison record based on the dimension weights and the total score values of all scoring dimensions of all prison items of the annual prison record includes:

taking the average value of the products of the dimension weights of all scoring dimensions and the total scoring values of all the prison items of the yearly prison record as the yearly total scoring of the yearly prison record;

The total annual score is the score value of the annual prison note.

In this embodiment, the evaluation of the grading conditions includes:

the grade of the annual evaluation of the supervision expert is divided into three grades of A (excellent), B (qualified) and C (unqualified), and the comprehensive scores X of the supervision experts corresponding to the grades are respectively as follows:

stage (a): x is more than or equal to 85 and less than or equal to 100;

and (II) B-stage: x is less than or equal to 60 minutes and less than or equal to 85 minutes;

(III) C level: x <60 minutes.

The assessment grade is valid within one year, and a supervision expert without assessment results in the current year defaults to grade B.

In this embodiment, updating the corresponding initial rating level based on the total annual score and the rating level classification condition, obtaining the annual rating level includes:

and determining the evaluation grade corresponding to the score range met by the total annual score as the annual evaluation grade based on the score range corresponding to each evaluation grade in the evaluation grade classification condition.

The beneficial effects of the technology are as follows: and obtaining a grading value from a grading source end corresponding to the grading dimension determined based on the item type of the prison item, and combining the grading weight corresponding to the grading source end, the item weight and the dimension weight to realize grading layer by layer grading of the prison item in the annual prison record, thereby obtaining a systematic annual evaluation system and also realizing systematic evaluation of the annual prison record of the label-evaluating supervision expert.

Example 5:

based on the embodiment 1, the method for managing the comment supervision expert comprises the following steps of: based on the priority order of all item attributes of the bid evaluation supervision task and the adjacent bid items of the bid evaluation supervision expert, determining the priority score of the bid evaluation supervision expert on the bid evaluation supervision task comprises the following steps:

In this embodiment, the item attribute information is specific information of the item attribute of the supervision item of the bid evaluation supervision task, for example, information such as a specific bid evaluation place or a specific bid evaluation time period.

In this embodiment, the first item attribute information is item attribute information of all item attributes of the evaluation and supervision task.

In this embodiment, the second item attribute information is item attribute information of all item attributes of the adjacent prison items of the label-evaluating and supervising expert.

In this embodiment, the first bid evaluation location is a bid evaluation location of a bid evaluation supervision task acquired in the first item attribute information.

In this embodiment, the second bid evaluation location is a bid evaluation location of a neighboring bid item of the bid evaluation supervision expert obtained in the second item attribute information.

In this embodiment, the bid evaluation place distance value is the actual distance between the first bid evaluation place and the second bid evaluation place.

In this embodiment, the location priority score is a score value of the priority degree of the member of the evaluation and supervision expert group, which is determined by the evaluation and supervision expert based on the evaluation and supervision place of the adjacent supervision items of the evaluation and supervision expert when screening the evaluation and supervision expert group of the evaluation and supervision task, and is also a ratio of the evaluation and supervision place interval value corresponding to the adjacent supervision items of the evaluation and supervision expert to the sum of the evaluation and supervision place interval values corresponding to all the evaluation and supervision experts.

In this embodiment, the first bid evaluation period is a bid evaluation process duration period of a bid evaluation supervision task acquired in the first item attribute information.

In this embodiment, the second bid evaluation period is a bid evaluation process duration period of a neighboring bid item of the bid evaluation supervision expert acquired in the second item attribute information.

In this embodiment, the time priority score is a score value of the priority degree of the member of the bid evaluation supervision expert group, where the score value is determined by the bid evaluation time period of the bid evaluation supervision task based on the bid evaluation time period of the neighboring bid evaluation items of the bid evaluation supervision expert when the bid evaluation supervision expert group of the bid evaluation supervision task is screened.

In this embodiment, the first service type is a service type of a bid evaluation and supervision task obtained from the attribute information of the first item, and the service type is, for example: engineering outsourcing bidding, raw material purchasing bidding, and the like.

In this embodiment, the second service type is the service type of the adjacent prison item of the comment supervision expert obtained in the second item attribute information.

In this embodiment, the type proximity coefficient is a coefficient representing the degree of proximity between two service types.

In this embodiment, determining the type priority score of each bid evaluation supervision expert for the bid evaluation supervision task based on the type proximity coefficient includes:

the ratio of the type proximity coefficient corresponding to the proximity supervision items of the bid evaluation supervision expert to the sum of the type proximity coefficients corresponding to the proximity supervision items of all bid evaluation supervision experts is used as the type priority grade of the bid evaluation supervision expert to the bid evaluation supervision task;

the type priority grading is that the characterization evaluation supervision expert determined by the service type of the evaluation supervision task based on the service type of the adjacent supervision project of the evaluation supervision expert according to the service type of the evaluation supervision expert when screening the evaluation supervision expert group of the evaluation supervision task can be used as a grading value of the priority degree of the evaluation supervision expert group member.

In this embodiment, determining the priority score of the bid evaluation supervision expert for the bid evaluation supervision task based on the location priority score, the time priority score, the type priority score, and the priority order of all the item attributes of each bid evaluation supervision expert for the bid evaluation supervision task includes:

wherein P is the priority grade of the bid evaluation supervision expert on the bid evaluation supervision task, P ₁ Scoring the place priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₁ For the sorting ordinal number, log of the item attribute corresponding to the comment place in the priority order ₂ () I.e. as a logarithmic function with base 2, P ₂ Scoring the time priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₂ For the sorting ordinal number, P of the item attribute corresponding to the rating time period in the priority order ₃ Scoring the type priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₃ A sorting ordinal number in a priority order for the item attribute corresponding to the service type;

the priority scores of the bid evaluation supervision experts on the bid evaluation supervision tasks can be accurately calculated by combining the place priority scores, the time priority scores, the type priority scores and the priority orders of all the project attributes of the bid evaluation supervision tasks.

The beneficial effects of the technology are as follows: and accurately determining the place priority score, time priority score and type priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on the priority order of all item attributes of the bid evaluation supervision task and the bid evaluation place, bid evaluation time period and service type in the corresponding first item attribute information and the second item attribute information of the adjacent bid evaluation items of the bid evaluation supervision expert, and further accurately determining the priority score of the bid evaluation supervision expert on the bid evaluation supervision task.

Example 6:

on the basis of embodiment 5, the management method of the bid evaluation supervision expert determines, based on a first bid evaluation time period in the first item attribute information and a second bid evaluation time period in the second item attribute information, a time priority score of each bid evaluation supervision expert on the bid evaluation supervision task, including:

In this embodiment, based on the time interval between the first bid evaluation time period in the first item attribute information and the second bid evaluation time period in the second item attribute information, determining a time priority score of each bid evaluation supervision expert on the bid evaluation supervision task is:

wherein P is ₂ Scoring the time priority of the bid evaluation supervision task by the currently calculated bid evaluation supervision expert, wherein n is the total number of second bid evaluation time periods, delta t _i For the time interval of the first bid time period in the first item attribute information and the second bid time period in the ith second item attribute information, Δt _all The sum of the time intervals of the first bid evaluation time period in the first item attribute information and the second bid evaluation time periods in all the second item attribute information is obtained;

based on the formula, the time priority score of the bid evaluation supervision expert on the bid evaluation supervision task can be accurately calculated based on the time interval of the first bid evaluation time period in the first project attribute information and the second bid evaluation time period in the second project attribute information.

The beneficial effects of the technology are as follows: by judging whether the first bid evaluation time period of the bid evaluation supervision task and the adjacent bid evaluation project of the bid evaluation supervision expert overlap, the time priority scores of the bid evaluation supervision expert on the bid evaluation supervision task are calculated respectively, and further, the time priority scores of each bid evaluation supervision expert on the bid evaluation supervision task are accurately determined based on the time intervals of the first bid evaluation time period in the first project attribute information and the second bid evaluation time period in the second project attribute information.

Example 7:

on the basis of embodiment 5, the method for managing a comment supervision expert determines a type proximity coefficient between a first service type in the first item attribute information and a second service type in the second item attribute information, including:

In this embodiment, the service type combination is a combination including a first service type and a second service type.

In this embodiment, the historical year prison record is the year prison record before the present year.

In this embodiment, the first record total number is the total number of historical year supervision records.

In this embodiment, the second record total number is the total number of historical annual ring records that simultaneously include the service types in the service type combination.

In this embodiment, determining the combining weight of the corresponding service type combination based on the first record total number and the second record total number includes:

taking the ratio of the first record total number to the second record total number as the combination weight of the corresponding service type combination;

the combination weight is a value which is required to characterize the co-occurrence degree of the business types contained in the corresponding business type combination in the massive historical annual supervision records when the type proximity coefficient between the business types contained in the corresponding business type combination is determined.

In this embodiment, the item ordinal interval is the difference between the item ordinals in the historical annual prison records that simultaneously contain the service types in the corresponding service type combination based on the two service types contained in the service type combination.

In this embodiment, the total number of items is the total number of prison items contained in the history annual prison record.

In this embodiment, determining the type proximity ratio of the corresponding service type combination in the corresponding historical yearly monitor record based on the item ordinal interval of the service type included in the service type combination in the historical yearly monitor record simultaneously including the service type in the corresponding service type combination and the total number of items of the corresponding historical yearly monitor record includes:

taking the ratio of the item ordinal interval of the service type in the history annual ring label record simultaneously containing the service type in the corresponding service type combination and the total number of the items in the corresponding history annual ring label record as the type proximity ratio of the corresponding service type combination in the corresponding history annual ring label record;

the type proximity ratio is a numerical value representing the similarity degree of the service types in the historical annual ring label record.

In this embodiment, determining a type proximity coefficient between service types included in a service type combination based on a combination weight of the service type combination and a type proximity ratio in each historical yearly prison record simultaneously including the service types in the corresponding service type combination includes:

that is, the product of the combination weight of the service type combination and the average value of the type proximity ratios in all the historical yearly prison records simultaneously containing the service types in the corresponding service type combination is taken as the type proximity coefficient between the service types contained in the service type combination.

The beneficial effects of the technology are as follows: the method and the system realize accurate calculation of the type proximity coefficient representing the similarity degree of the service types in the service type combination through the co-occurrence degree of the first service type and the second service type in the massive historical yearly supervision records and the interval between the co-occurrence project ordinals.

Example 8:

based on the embodiment 1, the method for managing the comment supervision expert comprises the following steps of: screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on a training tracking record of the bid evaluation supervision experts, a annual evaluation grade, a priority score of the bid evaluation supervision tasks and expert extraction rules of the bid evaluation supervision tasks, including:

In this embodiment, the training progress to be completed is that the training progress to be completed by the rating supervision expert in the year is determined based on the annual rating level, and is generally determined according to a preset rule, for example: when the annual evaluation grade is A, the corresponding training progress to be completed is 60%; when the annual evaluation grade is B grade, the corresponding training progress to be completed is 75%; when the annual evaluation grade is C, the corresponding training progress to be completed is 90%.

In the embodiment, the training progress to be completed of the bid evaluation supervision expert is determined based on the annual evaluation grade

In the embodiment, the current completed training progress is the training progress which is determined based on the training tracking record and is currently completed by the comment supervision expert.

In this embodiment, the training progress completion rate of the comment supervision expert is determined based on the current completed training progress and the corresponding to-be-completed training progress, which is:

and taking the ratio of the time length corresponding to the current completed training progress and the time length corresponding to the corresponding to-be-completed training progress as the training progress completion rate of the comment supervision expert.

In the embodiment, the training progress completion rate is the completion rate of the training progress of the characterization bid evaluation supervision expert.

In this embodiment, the comprehensive scoring proportion is a proportion between the training progress completion rate required when determining the personalized comprehensive score of the corresponding bid evaluation supervision expert and the priority score of the bid evaluation supervision task based on the annual rating level, generally, the higher the annual rating level is, the higher the ratio of the priority score in the comprehensive scoring proportion is, and the specific value of the comprehensive scoring proportion can be specifically set according to the user requirement.

In this embodiment, the comprehensive score proportion of the corresponding rating supervising expert is determined based on the annual rating scale

In this embodiment, determining the personalized comprehensive score of the bid evaluation supervision expert for the bid evaluation supervision task based on the comprehensive score proportion, the training progress completion rate of the corresponding bid evaluation supervision expert, and the priority score for the bid evaluation supervision task includes:

determining a first duty cycle of the training progress completion rate of the bid evaluation and supervision expert and a second duty cycle of the priority score of the bid evaluation and supervision task based on the composite score scale, for example: the comprehensive scoring proportion is as follows: the ratio of the training progress completion rate of the bid evaluation supervision expert to the priority score of the bid evaluation supervision task is 1 to 3, the first ratio of the training progress completion rate of the bid evaluation supervision expert is one fourth, and the second ratio of the priority score of the bid evaluation supervision task is three quarters;

Taking the sum of the product of the training progress completion rate of the bid evaluation supervision expert and the corresponding ratio of the first duty ratio and the product of the priority score of the bid evaluation supervision task and the corresponding second duty ratio as the personalized comprehensive score of the bid evaluation supervision expert on the bid evaluation supervision task;

the personalized comprehensive score is a score value of the priority degree of the member of the bid evaluation and supervision expert group according to the characterization bid evaluation and supervision expert when the bid evaluation and supervision expert group of the bid evaluation and supervision task is screened.

The beneficial effects of the technology are as follows: the training progress to be completed of the bid evaluation supervision expert is determined based on the annual evaluation grade, the training progress completion rate of the bid evaluation supervision expert is calculated based on the annual evaluation grade, the comprehensive scoring proportion is determined based on the annual evaluation grade, the personalized comprehensive scoring of the bid evaluation supervision expert to the bid evaluation supervision task is realized by the annual evaluation grade calculation bid evaluation supervision expert in combination with the priority scoring of the bid evaluation supervision task, and the intelligent extraction of the bid evaluation supervision expert group of the bid evaluation supervision task is realized.

Example 9:

based on embodiment 8, the management method of the bid evaluation supervision expert, based on the expert extraction rule of the bid evaluation supervision task and the personalized comprehensive score of all bid evaluation supervision experts of each annual evaluation grade, screens out the bid evaluation supervision expert group from all bid evaluation supervision experts, includes:

In this embodiment, the target population is the total population of each annual evaluation level in the bid evaluation supervision expert group determined based on the expert extraction rule of the bid evaluation supervision task.

In this embodiment, the bid evaluation supervision expert group is selected from all bid evaluation supervision experts based on the personalized comprehensive score of all bid evaluation supervision experts of each annual evaluation grade and the target number of people of each annual evaluation grade:

and screening out the bid evaluation supervision experts corresponding to the target number of people from the bid evaluation supervision experts of each annual evaluation grade according to the principle of screening bid evaluation supervision experts with higher personalized comprehensive scores, and summarizing to obtain a bid evaluation supervision expert group.

The beneficial effects of the technology are as follows: the method has the advantages that the target number of annual evaluation grades determined based on expert extraction rules is realized, and the accurate and intelligent screening of the evaluation supervision expert group of the evaluation supervision task is realized according to the principle of screening evaluation supervision experts with higher personalized comprehensive scores.

Example 10:

the invention provides a management system of an evaluation supervision expert, which refers to a figure, 3, and comprises:

It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. A method of managing a rating and supervising expert, comprising:

s2: training record tracking is carried out on the bid evaluation supervision expert, and a training track record of the bid evaluation supervision expert is obtained; the online training progress recording method comprises the steps of obtaining online training progress recording results of a bid evaluation supervision expert from an online training system;

based on the on-line training progress record result and the off-line training progress record result, obtaining a training tracking record of the bid evaluation supervision expert;

s3: carrying out multidimensional scoring on the annual supervision records of the evaluation supervision expert to obtain an annual total score, and updating the corresponding initial evaluation grade based on the annual total score to obtain an annual evaluation grade; determining the item types of all the supervision items in the annual supervision record; wherein, the item category includes at least: the project implemented by the proxy agency and the non-bid-inviting project implemented by the project unit self-organization;

Determining all scoring dimensions of the prison item based on the item types, acquiring the scoring value of the scoring source end of each scoring dimension of the prison item, and determining the personalized scoring value of each scoring dimension of the prison item based on the scoring weight and the corresponding scoring value corresponding to the scoring source end of each scoring dimension of the prison item; the scoring source terminal is a source communication terminal of a scoring system of the prison item in a corresponding scoring dimension;

updating the corresponding initial evaluation grade based on the total annual score and the evaluation grade dividing condition to obtain an annual evaluation grade;

s4: determining the priority grade of the evaluation supervision task by the evaluation supervision expert based on the priority order of all the item attributes of the evaluation supervision task and the adjacent supervision items of the evaluation supervision expert; the method comprises the steps of determining item attribute information of all item attributes of a bid evaluation supervision task as first item attribute information, and determining priority orders of all item attributes based on the first item attribute information;

determining a place priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on a bid evaluation place interval value between a first bid evaluation place in the first item attribute information and a second bid evaluation place in the second item attribute information; the first bid evaluation place is the bid evaluation place of the bid evaluation supervision task acquired in the first project attribute information, and the second bid evaluation place is the bid evaluation place of the adjacent bid supervision project of the bid evaluation supervision expert acquired in the second project attribute information;

determining the time priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on a first bid evaluation time period in the first item attribute information and a second bid evaluation time period in the second item attribute information; the first evaluation time period is the evaluation process duration period of the evaluation supervision task acquired in the first item attribute information, and the second evaluation time period is the evaluation process duration period of the adjacent supervision item of the evaluation supervision expert acquired in the second item attribute information;

Determining a type proximity coefficient between a first service type in the first item attribute information and a second service type in the second item attribute information, and determining a type priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on the type proximity coefficient; the first service type is the service type of the bid evaluation supervision task acquired in the first item attribute information, the second service type is the service type of the adjacent supervision item of the bid evaluation supervision expert acquired in the second item attribute information, and the type adjacent coefficient is the coefficient representing the degree of similarity between the two service types;

determining the priority score of the bid evaluation supervision expert on the bid evaluation supervision task based on the place priority score, the time priority score, the type priority score and the priority sequence of all the project attributes of each bid evaluation supervision expert on the bid evaluation supervision task; wherein,

wherein P is the priority grade of the bid evaluation supervision expert on the bid evaluation supervision task, P ₁ For evaluating the place of the supervision task of the supervision expert on the bid evaluationPriority score, q ₁ For the sorting ordinal number, log of the item attribute corresponding to the comment place in the priority order ₂ () I.e. as a logarithmic function with base 2, P ₂ Scoring the time priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₂ For the sorting ordinal number, P of the item attribute corresponding to the rating time period in the priority order ₃ Scoring the type priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₃ A sorting ordinal number in a priority order for the item attribute corresponding to the service type;

s5: screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on training tracking records of the bid evaluation supervision experts, annual evaluation grades, priority scores of bid evaluation supervision tasks and expert extraction rules of the bid evaluation supervision tasks; determining the to-be-completed training progress of the bid evaluation supervision expert based on the annual evaluation grade, determining the current completed training progress based on the training tracking record, and determining the training progress completion rate of the bid evaluation supervision expert based on the current completed training progress and the corresponding to-be-completed training progress; the ratio of the time length corresponding to the current completed training progress to the time length corresponding to the corresponding to-be-completed training progress is taken as the training progress completion rate of the comment supervision expert;

determining the comprehensive scoring proportion of the corresponding bid evaluation supervision expert based on the annual evaluation grade, and determining the personalized comprehensive scoring of the bid evaluation supervision expert on the bid evaluation supervision task based on the comprehensive scoring proportion, the training progress completion rate of the corresponding bid evaluation supervision expert and the priority scoring of the bid evaluation supervision task; the method comprises the steps of determining a first duty ratio of a training progress completion rate of a bid evaluation supervision expert and a second duty ratio of a priority score of a bid evaluation supervision task based on a comprehensive score proportion; taking the sum of the product of the training progress completion rate of the bid evaluation supervision expert and the corresponding ratio of the first duty ratio and the product of the priority score of the bid evaluation supervision task and the corresponding second duty ratio as the personalized comprehensive score of the bid evaluation supervision expert on the bid evaluation supervision task;

2. The method for managing a comment supervision expert according to claim 1, wherein S1: the personnel warehousing operation and the initial rating are carried out on the evaluation supervision expert, and the initial rating of each evaluation supervision expert is obtained, which comprises the following steps:

3. The method of claim 1, wherein determining a time priority score of each bid evaluation supervision expert for a bid evaluation supervision task based on a first bid evaluation time period in the first item attribute information and a second bid evaluation time period in the second item attribute information, comprises:

otherwise, determining the time priority score of each bid evaluation supervision expert on the bid evaluation supervision task based on the time interval of the first bid evaluation time period in the first item attribute information and the second bid evaluation time period in the second item attribute information; wherein,

wherein P is ₂ Scoring the time priority of the bid evaluation supervision task by the currently calculated bid evaluation supervision expert, wherein n is the total number of second bid evaluation time periods, delta t _i For the time interval of the first bid time period in the first item attribute information and the second bid time period in the ith second item attribute information, Δt _all Is the sum of the time intervals of the first bid time period in the first item attribute information and the second bid time periods in all the second item attribute information.

4. The method of claim 1, wherein determining a type proximity coefficient between a first service type in the first item attribute information and a second service type in the second item attribute information comprises:

determining a first record total number of massive historical annual ring label records, determining a second record total number of the historical annual ring label records simultaneously containing the service types in the service type combination, and determining the combination weight of the corresponding service type combination based on the first record total number and the second record total number; wherein, the ratio of the first record total number to the second record total number is taken as the combination weight of the corresponding service type combination;

determining a type proximity coefficient between service types contained in the service type combination based on the combination weight of the service type combination and the type proximity ratio in each historical annual prison record simultaneously containing the service types in the corresponding service type combination; wherein the product of the combination weight of the service type combination and the average value of the type proximity ratios in all the historical yearly prison records simultaneously containing the service types in the corresponding service type combination is taken as the type proximity coefficient between the service types contained in the service type combination.

5. The method according to claim 1, wherein the step of screening out the bid evaluation supervision expert group from among all bid evaluation supervision experts based on expert extraction rules of the bid evaluation supervision task and personalized comprehensive scores of all bid evaluation supervision experts of each annual evaluation level comprises:

6. A management system for a rating and supervising expert, comprising:

the training tracking module is used for tracking training records of the bid evaluation supervision experts and obtaining training tracking records of the bid evaluation supervision experts; the online training progress recording method comprises the steps of obtaining online training progress recording results of a bid evaluation supervision expert from an online training system;

the annual scoring module is used for carrying out multidimensional scoring on the annual supervision records of the bid evaluation supervision expert to obtain an annual total score, and updating the corresponding initial evaluation grade based on the annual total score to obtain an annual evaluation grade; determining the item types of all the supervision items in the annual supervision record; wherein, the item category includes at least: the project implemented by the proxy agency and the non-bid-inviting project implemented by the project unit self-organization;

the priority scoring module is used for determining the priority scoring of the bid evaluation supervision expert on the bid evaluation supervision task based on the priority sequence of all the item attributes of the bid evaluation supervision task and the adjacent bid evaluation items of the bid evaluation supervision expert; the method comprises the steps of determining item attribute information of all item attributes of a bid evaluation supervision task as first item attribute information, and determining priority orders of all item attributes based on the first item attribute information;

In the method, in the process of the invention,p is the priority grade of the bid evaluation supervision expert to the bid evaluation supervision task, P ₁ Scoring the place priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₁ For the sorting ordinal number, log of the item attribute corresponding to the comment place in the priority order ₂ () I.e. as a logarithmic function with base 2, P ₂ Scoring the time priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₂ For the sorting ordinal number, P of the item attribute corresponding to the rating time period in the priority order ₃ Scoring the type priority of the bid evaluation supervision task by the bid evaluation supervision expert, q ₃ A sorting ordinal number in a priority order for the item attribute corresponding to the service type;

the intelligent screening module is used for screening out a bid evaluation supervision expert group from all bid evaluation supervision experts based on training tracking records of bid evaluation supervision experts, annual evaluation grades, priority scores of bid evaluation supervision tasks and expert extraction rules of the bid evaluation supervision tasks; determining the to-be-completed training progress of the bid evaluation supervision expert based on the annual evaluation grade, determining the current completed training progress based on the training tracking record, and determining the training progress completion rate of the bid evaluation supervision expert based on the current completed training progress and the corresponding to-be-completed training progress; the ratio of the time length corresponding to the current completed training progress to the time length corresponding to the corresponding to-be-completed training progress is taken as the training progress completion rate of the comment supervision expert;