{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed299873-7d5f-50d0-8f03-b0309be68289","task_key":"default--test--2125","task_revision_id":"1","upstream_id":"2125","short_description":"Define a hormone. How would you go about proving that a particular gland is…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['A hormone is a type of organ', 'A hormone is a type of tissue', 'A hormone is an electrical signal sent through the nervous system to communicate between different parts of the body.', 'A hormone is a mineral that is involved in maintaining the balance of water in the body.', 'A hormone is a chemical substance synthesized by a specific organ or tissue and secreted directly into the blood.', 'A hormone is a structural protein that makes up the components of muscles and tissues.', 'A hormone is a digestive enzyme that breaks down food in the stomach and intestines.', 'A hormone is a type of vitamin that the body needs in small amounts to function properly.', 'A hormone is a type of cell', 'A hormone is a biological molecule that remains within the organ it is produced in and affects only that specific organ.']\",\"question\":\"Define a hormone. How would you go about proving that a particular gland is responsible for a specific function?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}