{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab6784ce-fba5-50db-9afb-5fe4144fb1e1","task_key":"default--test--3331","task_revision_id":"1","upstream_id":"3331","short_description":"Which of the following adaptive features would least likely be found in an…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['High metabolic rate to generate heat', 'Storage of water in fatty tissues', 'Long loops of Henle to maximize water reabsorption', 'Short loops of Henle to maximize water secretion', 'Large amounts of body hair to trap heat', 'A thick layer of fur to retain heat', 'A body structure that minimizes surface area to volume ratio to conserve heat', 'Small ears to minimize heat loss', 'Large ears to aid in heat dispersion', 'Fat stored around the body to insulate from cold']\",\"question\":\"Which of the following adaptive features would least likely be found in an animal living in a hot arid environment?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}