{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b32e397d-e0fc-5ee7-9f49-b6d4aff3ef15","task_key":"default--test--2979","task_revision_id":"1","upstream_id":"2979","short_description":"Explain three ways in which a person's basal metabolic rate maybe determined.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['BMR can be measured by the duration and quality of sleep', 'BMR can be estimated by the level of physical activity in a daily routine', 'BMR can be determined by measuring heart rate', 'BMR can be determined by the amount of sweat produced during physical activity', 'BMR can be estimated by the frequency of urination', 'BMR can be determined by calculating body mass index (BMI)', 'BMR can be measured by the amount of caloric intake', 'BMR can be determined by measuring brain activity', \\\"BMR can be determined by measuring the amount of heat given off, indirectly measuring the amount of oxygen used, or measuring the amount of thyroxine present in a person's blood\\\", 'BMR can be measured by the amount of carbon dioxide exhaled during rest']\",\"question\":\"Explain three ways in which a person's basal metabolic rate maybe determined.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}