{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2246ad5-9e4e-5da9-a92d-f6631bdba776","task_key":"default--test--2018","task_revision_id":"1","upstream_id":"2018","short_description":"Abraham Maslow's hierarachy of needs theorizes that each person is motivated by…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['solely by their physical needs', 'striving for self-actualization and personal growth', 'primary (physical) and secondary (emotional) needs', 'a constant state of dissatisfaction', 'desire for power and dominance over others', 'need to fulfill societal expectations', 'homeostasis needs determined by our inner self', 'motivation is derived from the fear of failing to meet needs', 'desire to achieve in the eyes of others', 'satisfying needs from the next step in the hierarchy']\",\"question\":\"Abraham Maslow's hierarachy of needs theorizes that each person is motivated by what?\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}