{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9dfc2fa9-2abc-57a6-8bb3-893c6558ba65","task_key":"default--test--1176","task_revision_id":"1","upstream_id":"1176","short_description":"A man with a long history of criminal violence who is a psychopathic…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['No, because the perpetrator did not directly inflict emotional distress on the victim.', 'Yes, because the perpetrator had a history of violent behavior.', 'No, because victim was not present at the time that the outrageous behavior occurred.', 'Yes, because in torture cases there is strict liability imposed on the perpetrator.', 'No, because perpetrator did not know that the father had immediate family members.', 'No, because the victim did not suffer any physical injuries.', \\\"Yes, because the father's hospitalization was a direct result of the perpetrator's actions.\\\", 'No, because the victim learned about the incident through a third party.', 'Yes, because the victim had to seek medical treatment due to the emotional distress caused.']\",\"question\":\"A man with a long history of criminal violence who is a psychopathic personality, often enjoys the act of mercilessly brutalizing innocent elderly people by physical torture that is heinous and shocking. He decides to torture the victim's father for no good reason. After the beating, the father is hospitalized and in intensive care. The victim was not present but read about it in the newspaper and heard about it from the authorities. Victim suffered extreme emotional distress and required medical treatment. Can victim bring a successful action against perpetrator for intentional infliction of emotional distress? (IIED)\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}