{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abe49f34-f287-5c99-ad30-395b9c863a49","task_key":"default--test--1767","task_revision_id":"1","upstream_id":"1767","short_description":"An employer and employee had an employment contract that contained an \"at will\"…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['No, because there was inadequate consideration for the covenant.', \\\"No, because the employee didn't receive additional compensation for the covenant.\\\", \\\"Yes, because the employer's providing of continued employment for a substantial period after signing the covenant is adequate consideration.\\\", 'Yes, because the covenant was signed voluntarily by the employee.', 'No, because the \\\"at will\\\" provision in the initial contract negates the enforceability of the covenant.', 'Yes, because the employer has a right to protect its business interests.', 'Yes, because the courts never question the adequacy of consideration in an agreement.', 'Yes, because modification of an existing contract does not require consideration.', 'Yes, because the covenant was part of the original employment contract.', 'No, because the covenant is unreasonable and therefore unenforceable.']\",\"question\":\"An employer and employee had an employment contract that contained an \\\"at will\\\" provision allowing either party to terminate the employment upon reasonable notice. One year later, the employer had the employee sign a covenant not to compete for a two-year period after termination. Two years later, the employee quit and went to work for a competitor company. The prior employer sued, asking for a preliminary injunction to enforce the covenant. The employee argued that the covenant was invalid because no consideration passed to her €“ she could be fired at any time and did not receive anything for signing. The employer argued that it provided her with continued employment when it did not have to do so. Does the employer have a legal right to enforce the covenant?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}