{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4e7a82c-c9f5-5e08-b6cb-9452b63182f1","task_key":"default--test--3031","task_revision_id":"1","upstream_id":"3031","short_description":"The hormone which brings about metamorphosis of the cecropia moth is secreted by…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The gland in the thorax is the only gland involved, but it requires a signal from the head to start metamorphosis.', 'Only the gland in the head is necessary for metamorphosis.', 'The gland in the head secretes a different hormone necessary for the initiation of the metamorphosis process.', 'The gland in the thorax secretes the hormone, but the head must be present to activate it.', 'Metamorphosis is triggered by environmental factors, not by hormones secreted by glands.', 'Metamorphosis is controlled by a gland in the abdomen, not the thorax or the head.', 'The head contains an inhibitor that prevents the gland in the thorax from inducing metamorphosis.', 'Neither the gland in the head nor the gland in the thorax are necessary for metamorphosis.', 'Both the gland in the head and the gland in the thorax of the cecropia moth are necessary for the process of metamorphosis.', 'Only the gland in the thorax is necessary for metamorphosis.']\",\"question\":\"The hormone which brings about metamorphosis of the cecropia moth is secreted by a gland in the thorax. However, no metamorphosis takes place if the head is cut off, even though the larva continues to live. Explain.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}