Back to Discover
π Criteria Compliance Evaluator
Reviews a modelβs submission against the input, ground truth, and evaluation criteria, explains the reasoning, and outputs a binary βYβ or βNβ to indicate whether the submission meets the specified standards, provided under the MIT license license
Prompt
Grade the following submission based on the provided criteria and reference label. Here is the data:
[BEGIN DATA]
***
[Input]: {{input}}
***
[Submission]: {{output}}
***
[Criteria]: {{criteria}}
***
[Ground Truth]: {{reference}}
***
[END DATA]
Does the submission meet the Criteria? Stop to write out your reasoning behind the decision, then print "Y" or "N" (without quotes) on a new line.