{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f20b8dbc-25e8-50a1-b640-b4f168092783","task_key":"default--test--2832","task_revision_id":"1","upstream_id":"2832","short_description":"A group of students were invited to taste phenylthiocarbamide (PTC). The ability…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Frequency of T is .371, Frequency of t is .629, Number of students with TT is 109, Tt is 373, tt is 316', 'Frequency of T is .396, Frequency of t is .604, Number of students with TT is 150, Tt is 348, tt is 300', 'Frequency of T is .533, Frequency of t is .467, Number of students with TT is 200, Tt is 398, tt is 200', 'Frequency of T is .440, Frequency of t is .560, Number of students with TT is 220, Tt is 358, tt is 220', 'Frequency of T is .629, Frequency of t is .371, Number of students with TT is 180, Tt is 418, tt is 200', 'Frequency of T is .604, Frequency of t is .396, Number of students with TT is 373, Tt is 316, tt is 109', 'Frequency of T is .467, Frequency of t is .533, Number of students with TT is 250, Tt is 298, tt is 250', 'Frequency of T is .560, Frequency of t is .440, Number of students with TT is 180, Tt is 438, tt is 180', 'Frequency of T is .467, Frequency of t is .533, Number of students with TT is 109, Tt is 373, tt is 316', 'Frequency of T is .629, Frequency of t is .371, Number of students with TT is 316, Tt is 373, tt is 109']\",\"question\":\"A group of students were invited to taste phenylthiocarbamide (PTC). The ability to taste PTC is inherited by a single pair of genes and tasting (T) is dominant to non-tasting (t). Among 798 students, 60.4 percent were tasters, a) Calculate the allelic frequency of T and t. b) How many of the students were TT? Tt? tt?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}