KR102239667B1 - An online examination service system based on difficulty of questions - Google Patents

Abstract

The present invention is a difficulty-based online simulation that automatically calculates the difficulty level using the correct answer rate or the incorrect answer rate for individual questions of the question bank, extracts individual questions using the difficulty level, and analyzes the test taker's performance by reflecting the difficulty level. Regarding a test provision system, comprising: an individual question register for registering individual questions to establish a question bank; A mock test questionnaire for extracting individual questions from the question bank to construct and provide mock exam questions; A mock test evaluation unit that receives an answer of each individual question of the mock test question, compares the received answer with the stored correct answer of the individual question, and stores the evaluation result; A test result analysis unit for calculating an average and ranking for each test taker or all test takers according to the evaluation result of the mock test question; And a difficulty level setting unit for setting the difficulty level of each individual question, but reflecting the level of the test taker in the evaluation result of the test taker's correct or incorrect answer for each individual question.
According to the system as described above, by calculating the difficulty level by reflecting the average of the candidates, the difficulty level can be more accurately calculated even if there are not many samples of the candidates for the corresponding problem.

Description

{An online examination service system based on difficulty of questions}

The present invention establishes a question bank by allowing individual questions to be registered in the system from the questionnaire, and when the candidate's application request is made, a mock exam question is constructed and provided with individual questions of the question bank, and the results and analysis results are provided. It relates to a difficulty-based online practice test provision system.

In particular, the present invention automatically calculates the difficulty level using the correct answer rate or the incorrect answer rate for individual questions of the question bank, extracts individual questions using the difficulty level, and analyzes the test taker's performance by reflecting the difficulty level. It relates to an online practice test delivery system.

In general, elementary, middle and high school students and candidates who take various qualification tests improve their learning ability through textbooks or various test books before taking the test. In other words, students study various qualification tests at schools or academies, etc. Students obtain various materials for examinations at academies, etc., and prepare for various tests through a collection of expected questions.

There is a limit in not being able to adequately cope with the test taker's learning ability or qualification verification simply by solving the predicted problems through the test book. In other words, in the SAT and National Qualification Test, various test questions for each subject are not presented in a fixed order, but in different arrangements.

However, because students or candidates for the qualification test do not have access to many test questions that are presented in this way, they are often confused in practice and do not fully demonstrate their ability. In particular, it is difficult to determine which subject and which field to study more because you cannot know the expected score you can receive.

In addition, since the preliminary test of the above method is mainly conducted offline, students and qualification test takers cannot take it often, and it takes a lot of time to check the scoring results after the test.

In order to solve this problem, a technology to service simulation tests on a network has been proposed [Patent Documents 1,2,3]. In particular, the prior art applies a difficulty level, and when the candidate sets the difficulty level, a test question is automatically constructed according to the difficulty level. In addition, a technique for automatically determining the difficulty level of a problem by accumulating distribution data of the candidates' correct and incorrect answers has also been proposed [Patent Document 4].

However, all of the above-described prior arts create and manage problems in the service system, and the administrator sets the difficulty level for each problem. Therefore, the manager has the burden of collecting the problems of the problem bank and evaluating the difficulty level for each problem. In addition, even when the difficulty level is automatically generated using distribution data of the correct and incorrect answers of candidates, there is a problem in that the difficulty level of the problem cannot be accurately set until the distribution data is accumulated.

Korean Registered Patent Publication No. 10-1438756 (announced on September 5, 2014) Korean Registered Patent Publication No. 10-1101177 (announcement on Dec. 30, 2011) Korean Registered Patent Publication No. 10-0432148 (Announcement on May 17, 2004) Korean Laid-Open Patent Publication No. 10-2004-0057219 (announced on July 2, 2004)

An object of the present invention is to solve the above-described problems, to establish a question bank by allowing individual questions to be registered in the system from the candidates, and to construct a mock test question with individual questions of the question bank when the candidate requests the test. It is to provide a system for providing online mock exams based on the difficulty level that provides the results and provides the results and results of analysis.

In addition, an object of the present invention is to provide a system for providing a difficulty-based online simulation test, which automatically calculates the difficulty level of an individual question according to the rate of correct or incorrect answers of candidates, and calculates the level of difficulty by reflecting the average of the candidates.

In order to achieve the above object, the present invention relates to a system for providing online simulation tests based on difficulty, comprising: an individual question register for registering individual questions to establish a question bank; A mock test questionnaire for extracting individual questions from the question bank to construct and provide mock exam questions; A mock test evaluation unit that receives an answer of each individual question of the mock test question, compares the received answer with the stored correct answer of the individual question, and stores the evaluation result; A test result analysis unit for calculating an average and ranking for each test taker or all test takers according to the evaluation result of the mock test question; And a difficulty level setting unit that sets the difficulty level of each individual question, but reflects the level of the test taker in the evaluation result of the test taker's correct or incorrect answer for each individual question.

In addition, in the present invention, in the difficulty-based online practice test provision system, the individual questions are classified into fields, and the practice test questionnaire receives the questionnaire conditions for the field and the difficulty level, and extracts individual questions that satisfy the questionnaire conditions. It is characterized by constructing a simulation test question.

In addition, the present invention is characterized in that in the difficulty-based online simulation test provision system, the test result analysis unit calculates the average m(p) of the candidate p by the following [Equation 1] by reflecting the difficulty level.

[Equation 1]

However, L denotes the number of difficulty, k denotes the index of difficulty or difficulty level, m _k (p) denotes the average of the individual problem of the test taker p's difficulty k, w _k denotes the weight according to the difficulty level, and the degree of difficulty The weight w _k has a higher weight as the difficulty level increases.

In addition, in the present invention, in the difficulty-based online practice test providing system, the difficulty setting unit calculates the difficulty score of the individual question by reflecting the level of the candidate to the correct answer or incorrect answer result of the candidate who solved the individual question. If the answer is correct, the difficulty score is calculated as a value within the level of the test taker, and if the answer is incorrect, the difficulty score is calculated with a value higher than the level of the test taker.

In addition, the present invention is characterized in that in the difficulty-based online simulation test providing system, the difficulty setting unit calculates a difficulty score when the candidate p solves the individual question i by the following Equation 2.

[Equation 2]

However, Q _i (p) represents the difficulty score according to the correct or incorrect answer of the candidate p for each question i, Q _max and Q _min are the maximum or maximum value of the candidate level, and Q _p represents the candidate's level. .

In addition, in the present invention, in the difficulty-based online simulation test provision system, the system calculates a reward score for each questionnaire of the applicant, and calculates the reward amount for each questionnaire, but the reward score for each individual question is sampled. It characterized in that it further comprises a questionnaire compensation calculator for calculating by weighting the difficulty score to the number of times.

As described above, according to the difficulty-based online simulation test provision system according to the present invention, the question bank is established by allowing the questioner to directly register individual questions, thereby obtaining various problems by receiving the problems of the question bank from various sources. The possible effect is obtained.

In addition, according to the difficulty-based online simulation test providing system according to the present invention, by calculating the difficulty level by reflecting the average of the candidates, the effect of more accurately calculating the difficulty level even if there are not many samples of the candidates for the corresponding question is obtained.

1 is a block diagram of an entire system for implementing the present invention.
Figure 2 is a block diagram of the configuration of a difficulty-based online simulation test providing system according to an embodiment of the present invention.
Figure 3 is an exemplary table showing the degree of difficulty according to an embodiment of the present invention in grades.
4 is a view showing the concept of calculating the difficulty of individual questions by reflecting the level of the candidate according to an embodiment of the present invention.

Hereinafter, specific details for the implementation of the present invention will be described with reference to the drawings.

In addition, in describing the present invention, the same portions are denoted by the same reference numerals, and repeated explanations thereof are omitted.

First, a configuration of an entire system for implementing the present invention will be described with reference to FIG. 1.

As shown in FIG. 1, the entire system for implementing the present invention includes a candidate terminal 10 for taking a mock test, a tester terminal 20 for registering individual questions on the server, and a question bank by allowing individual questions to be registered. It consists of a simulation test server 30 that constructs and extracts individual problems from the problem bank to generate and provide a simulation test. Additionally, it may be configured to further include a database 40 that stores question banks, test results of candidates, information of candidates, and the like.

First, the candidate terminal 10 is a computing terminal used by the candidate, and is a terminal equipped with a general computing function such as a smartphone, phablet, tablet PC, PC, and notebook. When the candidate performs the task related to the mock test, the candidate performs the task through the candidate terminal 10. Therefore, it is described below as being performed by the candidate for convenience of explanation, but the tasks are considered to be performed by the candidate terminal 10.

On the other hand, the candidate terminal 10 connects to the mock test server 30 and requests a mock test. At this time, the test conditions, such as the test range and difficulty of the mock exam, are received from the candidate and transmitted to the mock exam server 30.

In addition, the candidate terminal 10 displays the mock exam questions obtained from the mock exam server 30 on the screen on the terminal, and receives answers to each question input by the user. The inputted candidate's answer is transmitted to the mock test server 30.

In addition, the candidate terminal 10 may receive the candidate's simulation test result from the simulation test server 30, and display the result on the screen. At this time, the simulation test results are composed of the individual simulation test analysis results for the corresponding simulation test, or the analysis results of the accumulated simulation test results.

Next, the tester terminal 20 is a computing terminal used by the tester, and is a terminal equipped with ordinary computing functions such as a smart phone, phablet, tablet PC, PC, and notebook. When the applicant performs the task related to the mock test, the candidate performs the task through the examiner terminal 20. Therefore, it will be described below as being performed by the questioner for convenience of explanation, but the tasks are considered to be performed by the questioner terminal 20.

The questioner terminal 20 registers the individual question questioned by the questioner in the mock test server 30. That is, the individual question and the correct answer to the corresponding question are registered in the simulation test server 30 together. Each registered question is registered with the question bank, and can be sampled when constructing a practice test and used as a question for the practice test.

In addition, the number of times and difficulty levels, etc. (hereinafter, information on the use of individual questions) are calculated for each question registered by the applicant. The questioner terminal 20 may request a list of individual questions of the registered questioner and display it on the screen. At this time, usage information, such as the number and difficulty of each individual problem, may also be received and displayed.

On the other hand, individual questions of the applicants are rewarded according to the number of sampling times and difficulty. The rewards of all individual questions of the candidate are summed to calculate the reward of the candidate. The tester terminal 20 may display the tester's reward on the screen at the request of the tester.

Next, the mock test server 30 is a normal service server provided on the web, and registers individual questions for mock exams, and configures and provides mock exams. In addition, the simulation test results are received, the simulation test results are calculated or analyzed, and the analysis results are provided to the candidate.

That is, the simulation test server 30 receives individual questions from the tester terminal 20. At this time, individual questions and their correct answers are received and registered. Also, preferably, the field of an individual problem (or exam subject, unit, etc.) is input. Each individual problem has at least one field, and may have multiple fields.

In addition, the simulation test server 30 converts the registered individual questions into a database and builds it into a question bank. The question bank is composed of a number of individual questions, and each individual question is classified and stored according to field.

In addition, the mock test server 30 configures the mock exam question according to the request of the candidate terminal 10, and provides the corresponding mock exam question to the candidate terminal 10. At this time, the simulation test questions are constructed by randomly extracting individual questions from the question bank.

In particular, when requesting an exam, the field of the mock exam question (exam subject, unit, etc.) is inputted from the candidate terminal 10, and individual questions belonging to the field are extracted from the question bank to construct the mock exam question.

In addition, preferably, the candidate terminal 10 may set the difficulty level of the simulation test question, and configure the simulation test problem according to the difficulty level.

And the mock test server 30 receives the answer of the mock exam question, scores the mock exam question, and provides the result to the candidate terminal 10. That is, scoring is performed by comparing the answer of the received question with the stored correct answer of the question.

In addition, the mock test server 30 analyzes each individual question of the mock exam question, or analyzes the accumulated mock test results of the corresponding candidate. And the analysis result can be transmitted to the candidate terminal 10.

In addition, the simulation test server 30 calculates the usage status (or sampling status) of each individual problem. That is, the number of sampling times and difficulty of each individual problem is calculated. Then, the reward score for each individual problem is calculated using the number of sampling times or difficulty level. In addition, the reward points of the candidates are calculated by summing the reward points of all individual questions of each candidate. The applicant's reward points are summed to determine the applicant's reward amount.

Next, the database 40 is a question bank DB 41 that stores individual questions for the mock exam, an exam result DB 42 that stores the mock exam results and analysis results of each candidate, and information on the use of each individual question, and It may be composed of a questionnaire compensation DB 43 that stores compensation information and the like. However, the configuration of the database 40 is only a preferred embodiment, and may be configured in a different structure according to the database construction theory in consideration of the ease and efficiency of access and search in developing a specific device.

Next, a system for providing a difficulty-based online simulation test according to an embodiment of the present invention will be described with reference to FIG. 2.

As shown in FIG. 2, the difficulty-based online simulation test provision system 30 according to the present invention includes a user information collection unit 31 that collects information on a user, and a clothing information collection unit 32 that collects information on clothing. ; A motion index calculation unit 33 that calculates the degree of movement of the user; A clothing index calculation unit 34 that calculates a degree of activity of the clothing; And a clothing recommendation unit 35 that recommends clothing having a clothing index matching the user's motion index.

First, the individual question register 31 receives the individual question from the questioner terminal 20 and registers the individual question in the question bank.

That is, each question and the correct answer to the question are received and registered. Also, the field of the individual problem is input. Fields are classified into subjects (test subjects) and units. Preferably, the fields may be classified in stages, such as subject-unit-unit-break-unit-small unit, and so on. In addition, a plurality of fields for individual problems may be input and set.

In addition, the individual question registration unit 31 also stores questioner information for each individual question. Therefore, with reference to the database 40, individual questions submitted by the corresponding questioner can be managed for each questionnaire.

In addition, the individual problem registration unit 31 initializes and sets the difficulty level for each individual problem. Preferably, the initial value may be set as an average value of difficulty, or may be set to a difficulty value set by the questioner.

Next, when the mock exam questionnaire 32 receives a mock exam request from the candidate terminal 10, individual questions are extracted from the question bank to construct a mock exam question.

That is, the mock test questionnaire 32 receives the questionnaire conditions of the mock exam from the candidate terminal 10, and randomly extracts individual questions matching the exam conditions from the question bank.

The exam conditions include the test range that limits the field of each question, and the difficulty condition that determines the difficulty level of the individual question. In addition, the number of problems may be further included.

The test range is set to at least one field and may be selected in plurality.

As shown in FIG. 3, the degree of difficulty is divided into grades and can be classified according to grades. In other words, if the difficulty score falls within a certain range, the difficulty level is set as a grade within the range. In this case, when the difficulty level is composed of grades, the candidate selects a specific difficulty level (difficulty level).

The simulation test questionnaire 32 randomly extracts individual questions belonging to the corresponding difficulty level (or grade), and generates (presents) a simulation test question composed of a plurality of extracted individual questions.

The mock exam questionnaire 32 provides the generated (questioned) mock exam question to the candidate terminal 10.

Next, the mock test evaluation unit 33 receives the answer of the mock exam question from the candidate terminal 10, and evaluates the result of the mock exam question of the candidate. That is, the input answer is compared with the correct answers of the stored questions, and if they are the same, they are judged as correct and if they are different, they are judged as incorrect.

That is, by determining whether each individual question of the simulation test question of the simulation test evaluation unit 33 is answered correctly, the score of the entire simulation test question is calculated.

In addition, the mock test evaluation unit 33 stores the evaluation results of the candidate's mock exam questions. In this case, in addition to the total score, the correct answer or incorrect answer for each individual question is recorded and stored.

Next, the test result analysis unit 34 analyzes the evaluation result of the mock test question for each candidate, stores the analysis result, or provides the analysis result at the request of the candidate terminal 10.

In particular, the test result analysis unit 34 analyzes an individual test for a specific mock test question, or analyzes the accumulated mock test results of a corresponding candidate. The former is referred to as individual analysis, and the latter is referred to as cumulative analysis.

First, the analysis result includes results such as an average score, a correct answer rate, and a ranking, and each result may include a result subdivided according to field, difficulty, and the like. In addition, each result can be analyzed against the grades of all other candidates.

In other words, the results such as the overall average score, correct answer rate, and ranking are calculated for each simulation test. In addition, results such as average score, correct answer rate, and ranking can be calculated for the tests accumulated so far. The ranking is calculated by the average score compared to the average score of other candidates. In addition to the percent correct, ranking, and average, other statistics such as standard deviation and variance can be calculated. In addition, it is possible to obtain a comparison analysis result compared to the overall average score of all other candidates or the percentage of correct answers.

In addition, the results of simulation tests for each field can be analyzed and provided. In other words, the average score, correct answer rate, ranking, etc. within a specific field (specific subject and unit) can be calculated. That is, by extracting the correct or incorrect answers of individual questions belonging to a specific field, the average of these results is calculated to obtain a score (average), a correct answer rate, or a ranking.

In addition, it is possible to analyze and provide the results of the simulation test for each difficulty level. In other words, results such as average score, correct answer rate, and ranking within a specific difficulty level (eg, difficulty level B) are calculated.

In addition, by accumulating the evaluation results of all simulation tests, the cumulative results such as average score, correct answer rate, and ranking for the accumulated results can be calculated. In addition, it is possible to calculate the analysis result (average score, correct answer rate, ranking, etc.) by subdividing the accumulated results into fields (specific subjects and units) or by difficulty. That is, for all individual questions, the difficulty level is set, there is a correct answer rate for each difficulty level, and a ranking for each level of difficulty can be calculated.

For example, if a high school 3 examinee is taking a math mock test, and the equation in a math subject is classified as a unit, the examinee will have grade statistics (graduation statistics) such as high school grades, math grades, averages for equation grades, and rankings. Able to know. In addition, the questions in the above three areas are classified as difficulty A, B, C, D type problems, and the correct answer rate of all candidates can be compared with the correct answer rate of the corresponding candidate.

Meanwhile, the test result analysis unit 34 calculates a result of the average, correct answer rate, and ranking of each candidate by reflecting the difficulty level. This result will be referred to as the evaluation result (analysis result) reflecting the difficulty level.

In particular, the average m(p) reflecting the difficulty level of the candidate p is calculated by the following equation.

[Equation 1]

Here, L denotes the number of difficulty, and k denotes an index of difficulty or difficulty grade. In the example of FIG. 3 above, since 4 difficulty levels are indicated, L = 4. Preferably, the higher the value of k, the higher the degree of difficulty.

m _k (p) represents the average of the individual questions of the candidate p's difficulty k, and w _k represents the weight according to the difficulty level. The difficulty weight w _k has a higher weight as the difficulty level increases. Therefore, as the k index value of the difficulty level is higher, the difficulty level is higher, and the difficulty weight w _k satisfies the following equation.

[Equation 2]

w ₁ <w ₂ <w ₃ <... <w _L

The percentage of correct answers reflecting the difficulty level is also calculated by assigning a weight according to the difficulty level, as shown in Equation 1 above.

In addition, the difficulty level reflection ranking is obtained by calculating the difficulty level reflection average of all candidates based on the difficulty level reflection average. Then, the ranking of each candidate is determined based on the average of the difficulty level. The ranking determined at this time is the ranking that reflects the difficulty level.

Like the general analysis result calculation method described above, the analysis result (average, correct answer rate, ranking) reflecting the difficulty level may be calculated for each field (subject and unit).

Next, the difficulty level setting unit 35 sets the difficulty level for each individual problem.

The method of obtaining the difficulty or difficulty score (hereinafter, referred to as the first difficulty score) of the individual question according to the first embodiment uses the incorrect answer rate of the corresponding individual question. In other words, for each question, the percentage of incorrect answers of all candidates who solved the question is calculated as the difficulty score.

For example, if there are 1,000 candidates who solved individual question A and 350 of them were incorrect, the incorrect answer rate of 35% or 35 is the difficulty score. In addition, if all 2,000 candidates who solved individual question B and 1,500 of them answered incorrectly, the incorrect answer rate of 75% or 75 is the difficulty score.

And, as shown in FIG. 3, in the plurality of difficulty levels, the corresponding level is set as the level of difficulty. In the previous example, since individual question A has a difficulty score of 35, the difficulty level is grade B, and individual question B has a difficulty score of 75, so the difficulty level is grade D.

However, the number of test takers (or sampling number of individual questions) must be more than a certain number of times for the incorrect answer rate. That is, in order to be meaningful as a probability, the sampling size must be at least a reference value or more. Here, sampling means that the corresponding individual question is extracted as a simulation test question, and the individual question is solved by the candidate and the result of the correct answer or incorrect answer comes out. That is, if the individual question is adopted as a simulation test by 10 candidates, and 10 correct or incorrect answers are obtained, the number of samples or the sample size is 10.

Next, the method of obtaining the difficulty or difficulty score (hereinafter referred to as the second difficulty score) of the individual question according to the second embodiment reflects the test taker's level in the test taker's correct or incorrect answer result.

As shown in Fig. 4, it is assumed that the level of candidate A is Q. If the minimum level is 0 and the maximum level is 100, as shown in FIG. 4, Q will be positioned at any one point between 0 and 100.

Here, the test taker level is a level according to the test result of the test taker, preferably, it is calculated by the average score of the test taker. More preferably, the test taker level is set to an average reflecting the difficulty level.

In Fig. 4(a), if candidate A solves an individual question and the answer is correct, the difficulty (or level) of the individual question will be any point between 0 and Q. That is, if the candidate corrects the answer, the difficulty score is calculated with a value within the candidate's level. In Fig. 4(a), the thick black point X will be the average predicted difficulty.

In addition, in FIG. 4(b), if candidate A incorrectly answers each individual question, the difficulty (or level) of the individual question will exceed the candidate's level Q. That is, if the answer is incorrect, the difficulty score is calculated with a value higher than the test taker's level. Therefore, in FIG. 4(b), the thick black point X will be the average predicted difficulty level.

Therefore, preferably, the difficulty score of the individual question when a candidate solves the individual question can be defined by the following equation.

[Equation 3]

Here, p represents the candidate and i is an index representing individual questions.

Q _i (p) represents the difficulty score according to the correct or incorrect answer of the candidate p for each question i. Q _max and Q _min represent the maximum or maximum value of the candidate level, and preferably, 100 or 0. In addition, Q _p represents the test taker's level. Preferably, the test taker's level is an average of test takers.

If N candidates solved each question i and yielded a correct or incorrect result, the average of the difficulty scores of the N individual questions is set as the difficulty level of the individual question.

Meanwhile, the difficulty setting unit 35 calculates a final difficulty score by weighting and adding the first difficulty score and the second difficulty score. Preferably, weights are assigned according to the sampling size to obtain a final difficulty score.

That is, the smaller the sampling size, the higher the weight of the second difficulty score, and the larger the sampling size, the higher the weight of the first difficulty score is set.

Next, the questionnaire compensation calculation unit 36 calculates a compensation score for each question of the questionnaire, and calculates the amount of compensation for each questionnaire.

The reward score for each individual problem is calculated by weighting the difficulty score to the number of sampling times. That is, the reward score is proportional to the number of sampling and the difficulty score.

The more individual questions asked are sampled, the more rewards should be given to the questioners. Therefore, the compensation score is calculated in proportion to the number of sampling.

In addition, since it is difficult to ask questions with high difficulty, more reward points are given for individual problems with high difficulty.

In the above, the invention made by the present inventor has been described in detail according to the above embodiment, but the invention is not limited to the above embodiment, and it goes without saying that various changes can be made without departing from the gist of the invention.

10: test taker terminal 20: test taker terminal
30: practice test server 31: individual question register
32: Mock exam questionnaire 33: Mock exam evaluation section
34: test result analysis unit 35: difficulty setting unit
36: exam compensation calculation unit
40: database 80: network

Claims (6)

In the difficulty-based online practice test provision system,
An individual question register that registers an individual question and establishes a question bank;
A mock test questionnaire for extracting individual questions from the question bank to construct and provide mock exam questions;
A mock test evaluation unit that receives an answer of each individual question of the mock test question, compares the received answer with the stored correct answer of the individual question, and stores the evaluation result;
A test result analysis unit for calculating an average and ranking for each test taker or all test takers according to the evaluation result of the mock test question; And,
It sets the difficulty level of each individual question, but includes a difficulty level setting unit that sets the level of difficulty by reflecting the level of the candidate in the evaluation result of the candidate's correct or incorrect answer for each individual question,
The difficulty setting unit calculates the wrong answer rate of the candidate who solved the individual question for an individual question as a first difficulty score,
The difficulty setting unit calculates the second difficulty score of the individual question by reflecting the candidate's level on the correct or incorrect answer result of the candidate who solved the individual question. 2 Calculate the difficulty score, and if the answer is incorrect, calculate the second difficulty score with a value higher than the test taker's level,
The difficulty setting unit calculates a second difficulty score when the candidate p solves the individual question i according to the following [Equation 2],
The difficulty setting unit sets the average value of the second difficulty score of the N individual questions as the second difficulty score of the corresponding individual question, if N candidates solved each question i for a correct answer or an incorrect result,
The difficulty setting unit weights the first difficulty score and the second difficulty score to calculate a final difficulty score, but the smaller the sampling size, which is the size of the candidate who solved the problem, increases the weight of the second difficulty score, and the sampling size is Difficulty-based online simulation test providing system, characterized in that the higher the weight of the first difficulty score is set.
[Equation 2]

However, Q _i (p) represents the second difficulty score according to the correct or incorrect answer of the candidate p for each question i, Q _max and Q _min are the maximum or maximum value _{of the candidate's level, and Q p} is the candidate's level. Represents.
The method of claim 1,
The individual problems are classified into fields,
The simulation test questionnaire unit receives question conditions for a field and difficulty level, and extracts individual questions that satisfy the questionnaire conditions to construct a mock exam question.
The method of claim 1,
The test result analysis unit reflects the difficulty level and calculates the average m(p) of the candidates p by the following [Equation 1].
[Equation 1]

However, L denotes the number of difficulty, k denotes the index of difficulty or difficulty level, m _k (p) denotes the average of the individual problem of the test taker p's difficulty k, w _k denotes the weight according to the difficulty level, and the degree of difficulty The weight w _k has a higher weight as the difficulty level increases.
delete delete The method of claim 1,
The system further includes a questionnaire compensation calculator that calculates a reward score for each questionnaire of the questioner, and calculates the compensation amount for each questioner, but the compensation score for each individual question is calculated by weighting the difficulty score to the number of sampling. Difficulty-based online practice test providing system, characterized in that.

Images