{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"698e0bca-ad0d-537f-8a4c-a7b98ef471fe","task_key":"default--test--621","task_revision_id":"1","upstream_id":"621","short_description":"Cognitive ______ models such as the Theory of _________ serve to try and explain…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Attitudinal, Social Identity, Group norms', 'Behavioral, Cognitive Dissonance, Emotions', 'Attitudinal, Planned Behaviour, Social pressures', 'Attitudinal, Cognitive Dissonance, Rationality', 'Decision, Social Identity, Emotions', 'Decision, Market equilibrium, Rationality', 'Decision, Planned behaviour, Rationality', 'Decision, Social Identity, Group norms', 'Behavioral, Planned Behaviour, Social pressures', 'Attitudinal, Market equilibrium, Social pressures']\",\"question\":\"Cognitive ______ models such as the Theory of _________ serve to try and explain consumer behaviour, but arguably somewhat oversimplify and overestimate individual ________.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}