You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This chatGPT evaluation function is designed to automatically evaluate student responses to questions. It currently uses the openAI API to determine the correctness (true/false) of the student's answer and can also provide them with feedback.
4
+
This chatGPT evaluation function is designed to automatically evaluate student responses to questions. It currently uses the OpenAI API to determine the correctness (true/false) of the student's answer and can also provide them with feedback.
5
5
6
6
## What does the teacher need to input?
7
7
-`Model`
8
-
- As of now, `gpt-3.5-turbo` is the only model available. In the future, more openAI and other models can be implemented.
9
-
-
8
+
- Suggest (July 2025), `gpt-4o-mini` or `gpt-4.1-mini`.
10
9
-`Main_prompt`
11
-
- In this prompt you should explain the question and answer to gpt.
10
+
- In this prompt you should explain the question and answer to gpt.
12
11
13
-
-`Default_prompt`
14
-
- As of now, this prompt should not be changed.
15
-
- It tells gpt to output a Boolean, which marks the student's answer as correct or incorrect.
16
-
- In the future, this could be changed so that 'partially incorrect' answers, etc, are possible.
17
-
18
-
-`Feedback_prompt`
19
-
- Leave this prompt **blank** if you do not want any textual feedback to be given to the student, but just correct/incorrect.
20
-
- Fill in this prompt to tell gpt how to give feedback to the student. Examples of things you may want to include in your `feedback_prompt`:
12
+
-`Default_prompt`[do not change from default]
13
+
- To determine the completeness of the response.
14
+
- It tells GPT to output a Boolean, which marks the student's answer as correct (complete) or incorrect (incomplete).
15
+
16
+
-`Feedback_prompt`[optional]
17
+
- Leave this prompt **blank** if you do not want any textual/qualitative feedback to be given to the student.
18
+
- Fill in this prompt to tell gpt how to give written feedback to the student. Examples of things you may want to include in your `feedback_prompt`:
21
19
-`Give the student objective and constructive feedback on their answer in first person.`
22
20
-`If the student is incorrect, provide feedback/hints to help them, but do not reveal the answer.`
23
21
24
-
Please be aware that `gpt-3.5-turbo` often gets overwhelmed by long prompts, and can sometimes ignore your instructions. It is recommended to do testing with your question, and use `gpt-4` if neccesary. Be aware that the cost of `gpt-4` is ~20x more than `gpt-3.5-turbo` (at the time of writing - 6th Sep 2023).
25
-
22
+
The cost and performance of LLMs changes by the month, so do not assume that your prompts, and model choice, are good in the long term. Approaches with LLMs should be considered experimental.
26
23
27
24
## Usage examples
28
25
Each example below demonstrates the potential usage of `main_prompt` and `feedback_prompt` for different questions.
29
26
30
-
### Simple descriptive observation
27
+
### Technical question, for correctness and with no feedback.
31
28
**Main Prompt**:
32
29
> In this question, the student is asked to make a comment about the behaviour of a partial sum. The correct answer is 'fast convergence'. Accept any paraphrasing/equivalent answers. To be correct, they must mention both aspects (fast and convergence).
33
30
@@ -36,3 +33,12 @@ Each example below demonstrates the potential usage of `main_prompt` and `feedba
0 commit comments