Back to Discover

🌌 Criteria Compliance Evaluator

Reviews a model’s submission against the input, ground truth, and evaluation criteria, explains the reasoning, and outputs a binary β€œY” or β€œN” to indicate whether the submission meets the specified standards, provided under the MIT license license

Prompt

Grade the following submission based on the provided criteria and reference label. Here is the data: [BEGIN DATA] *** [Input]: {{input}} *** [Submission]: {{output}} *** [Criteria]: {{criteria}} *** [Ground Truth]: {{reference}} *** [END DATA] Does the submission meet the Criteria? Stop to write out your reasoning behind the decision, then print "Y" or "N" (without quotes) on a new line.