{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"878be5ee-402a-52bb-9dc3-3e470dfa51ed","task_key":"default--test--1804","task_revision_id":"1","upstream_id":"1804","short_description":"A manufacturer of electric motors formerly produced motors that utilized as a…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The manufacturer cannot be held liable for negligence because the toxic substance was not known to be harmful at the time of the leakage.', 'The manufacturer cannot be held liable because the EPA is responsible for the decontamination process.', 'The employee cannot sue the manufacturer because she was not exposed to the toxic substance directly from the manufacturer.', \\\"The repair shop employee's emotional distress is not alleged to be severe.\\\", 'The complaint does not allege that the manufacturer was aware of the toxicity of the substance at the time of the leakage.', \\\"The complaint does not allege that the manufacturer's conduct was extreme and outrageous.\\\", 'The complaint does not allege that the employee suffered any financial loss due to the emotional distress.', 'The complaint does not allege that the repair shop employee suffered any physical consequences.', \\\"The repair shop employee's proper remedy is in a claim against the repair shop, the occupier of thepremises during the period of her alleged exposure.\\\", 'The employee cannot sue the manufacturer because she was not employed by the manufacturer at the time of the exposure.']\",\"question\":\"A manufacturer of electric motors formerly produced motors that utilized as a coolant a chemical substancethat was later discovered to be highly toxic. During its manufacturing operations, the manufacturer negligentlyallowed quantities of this substance to leak into the soil. The Environmental Protection Agency (EPA) orderedthat the premises, now owned by an appliance repair shop, be decontaminated. This order, and the subsequent cleanup efforts, received a high level of attention in the local media. An employee of the appliance repair shop has sued the manufacturer in negligence for damages for emotionaldistress. The employee claims to have suffered the distress as a consequence of learning that she has beenexposed for five years, while employed by the appliance repair shop at the premises affected by the EPA order,to the toxic contamination that has existed there. Her complaint does not allege that her emotional distress issevere, that the manufacturer's conduct was extreme and outrageous, or that she has suffered any physicalconsequences. In that action the manufacturer has filed a motion to dismiss for failure to state a claim upon which relief maybe granted. What is the manufacturer's best argument in support of that motion?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}