{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e9ad363-319d-50cf-9909-efda324a6427","task_key":"default--test--2549","task_revision_id":"1","upstream_id":"2549","short_description":"What is the difference between discrete andcontinuous motortasks?Which is easier…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Discrete skills are more difficult to remember due to their complexity', 'Continuous skills require more cognitive effort to recall', 'Neither are easy to remember', 'Continuous skills are not easily forgotten', 'Continuous skills are easier to remember because they are always performed in a consistent environment', 'Continuous skills are more difficult to remember because they are less repetitive', 'Both are equally easy to remember', 'Discrete skills become more precise over time', 'Discrete skills are easier to remember because they involve a sequence of movements', 'Discrete skills are not easily forgotten']\",\"question\":\"What is the difference between discrete andcontinuous motortasks?Which is easier to remember after an interval oftime?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}