{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8879a7ff-de1e-56ad-86d9-f3b46d644d71","task_key":"all--test--8879a7ff-de1e-56ad-86d9-f3b46d644d71","task_revision_id":"1","upstream_id":"","short_description":"A retailer brought a federal diversity action against a wholesaler, alleging…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because a determination of the sufficiency of the evidence is solely within sufficiency of the evidence is solely within the jury's province.\\\", 'No, because the wholesaler did not raise the sufficiency-of-the-evidence issue in a motion for judgment as a matter of law before the case went to the jury.', 'Yes, because the challenge was raised and ruled on by the trial court before the wholesaler filed the appeal.', 'Yes, because, as the trial court acknowledged, the wholesaler has strong arguments on the challenge.']\",\"question\":\"A retailer brought a federal diversity action against a wholesaler, alleging breach of contract and fraudulent misrepresentation. After the parties presented their evidence at trial, the court instructed the jury on the law. Neither party filed a motion for judgment as a matter of law before the case went to the jury. The jury found for the retailer on both claims. After the court entered judgment on the verdict, the wholesaler moved for a new trial and for judgment as a matter of law, arguing that the evidence was insufficient to support the jury verdict on either claim. The court acknowledged that there had been problems with some of the evidence, but it denied the motions. The wholesaler appealed, challenging the sufficiency of the evidence. Should the appellate court consider the wholesaler's challenge?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}