{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9eedc46-674b-53bd-8ebc-8337d27f8965","task_key":"default--test--3409","task_revision_id":"1","upstream_id":"3409","short_description":"Explain the mechanism of the genetic determination of sex in humans.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The presence of two X chromosomes in the absence of a Y chromosome has no impact on the sex of an individual.', 'The number of autosomes determines the sex of an individual.', 'The sex of an individual is determined by the number of X chromosomes, irrespective of the Y chromosome.', 'The combination of two Y chromosomes determines that an individual will be female.', 'The presence of an X chromosome and an additional chromosome other than Y determines that an individual will be male.', 'Environmental factors determine the genetic sex of an individual.', 'The presence of the X chromosome determines that an individual will be male.', 'The presence of the Y chromosome determines that an individual will be male.', 'The process of meiosis determines the sex of an individual.', 'The total number of chromosomes in an individual dictates their sex.']\",\"question\":\"Explain the mechanism of the genetic determination of sex in humans.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}