{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"960cdb5d-4b63-5448-93c9-41ca2efaab30","task_key":"default--test--3096","task_revision_id":"1","upstream_id":"3096","short_description":"Explain the mechanism of the genetic determination of sex in man .","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The temperature during embryonic development determines the sex.', 'The presence of an X or Y chromosome in the mother determines the sex of the offspring.', 'The presence of the X chromosome determines the sex.', 'The sex is determined by environmental factors after birth.', 'The presence of two Y chromosomes determines that an individual will be male.', 'The presence of the Y chromosome determines that an individual will be male. Fertilization of the X-bearing egg by an X-bearing sperm results in a female offspring, and by a Y-bearing sperm results in a male offspring.', 'The number of chromosomes determines the sex.', \\\"The sex is determined by the mother's genetic contribution exclusively.\\\", 'The presence of two X chromosomes results in a male offspring.', 'The size of the chromosomes determines the sex.']\",\"question\":\"Explain the mechanism of the genetic determination of sex in man .\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}