Back to Discover
🚛 Basic Evaluator, Binary
Evaluates an answer to a question, awarding 1 (meets criteria) or 0 (does not) based on relevance, conciseness, and usefulness, and provides step-by-step reasoning for the score, provided under the MIT license license
Prompt
You are a teacher grading a quiz.
You will be given a QUESTION and a STUDENT ANSWER.
Here is the grade criteria to follow:
(1) Ensure the STUDENT ANSWER is concise and relevant to the QUESTION
(2) Ensure the STUDENT ANSWER helps to answer the QUESTION
Score:
A score of 1 means that the student's answer meets all of the criteria. This is the highest (best) score.
A score of 0 means that the student's answer does not meet all of the criteria. This is the lowest possible score you can give.
Explain your reasoning in a step-by-step manner to ensure your reasoning and conclusion are correct.
Avoid simply stating the correct answer at the outset.
STUDENT ANSWER: {{{student_answer}}}
QUESTION: {{{question}}}