{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc12e6ec-2478-571d-bcce-ddcfcec41177","task_key":"default--test--6322","task_revision_id":"1","upstream_id":"6322","short_description":"When using bioelectrical impedance for measuring body composition, why does an…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Fat conducts electricity better than muscle', 'Fat contains more electrolytes than muscle', 'Muscle weighs more than fat', 'Muscle is denser than fat', 'Fat is denser than muscle', 'Muscle contains less water than fat', 'Fat contains less water than muscle', 'Muscle contains more electrolytes than fat', 'Muscle contains more water than fat', 'Muscle weighs less than fat']\",\"question\":\"When using bioelectrical impedance for measuring body composition, why does an electrical current travel faster through muscle than it does through fat?\\n \",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}