{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3673e33-cd28-5d5c-ab1f-7d70ce9a9f1e","task_key":"default--test--3305","task_revision_id":"1","upstream_id":"3305","short_description":"How do chromosomal variations influence sex determination in humans?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Chromosomal variations can lead to the development of extra limbs', 'Chromosomal variations cause individuals to change sex spontaneously later in life', 'Chromosomal variations lead to increased intelligence', 'Chromosomal variations determine hair and skin color but are unrelated to sex determination', 'Chromosomal variations result in physical abnormalities', 'Chromosomal variations only affect eye color, not sex determination', 'Chromosomal variations can result in individuals being born with both fully functional male and female reproductive systems', 'Chromosomal variations have no effect on sex determination', 'Chromosomal variations in humans result in intermediate sex individuals. Most of the variants are associated with chromosomal abnormalities involving either an excess or a deficiency of sex chromosomes.', 'Chromosomal variations affect height and weight without impacting sex determination']\",\"question\":\"How do chromosomal variations influence sex determination in humans?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}