{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee637444-ae27-5ada-84b8-a417b4f964f4","task_key":"default--test--2851","task_revision_id":"1","upstream_id":"2851","short_description":"Occasionally a boy is born withundescendedtestes (cryptorchidism), and he will…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Human sperm cannot develop at the high temperature found within the body cavity.', 'The testes require the lower pressure environment of the scrotum for sperm maturation', 'Testes must be in the scrotum to properly attach to the vas deferens', 'The scrotum provides the necessary nutrients for sperm development', 'Gravity is required for the testes to function properly', 'Undescended testes result in hormonal imbalances that prevent sperm production', 'The testes need to be in the scrotum for aesthetic reasons', 'Undescended testes can lead to cancer', 'The scrotum is the only place where the testes can receive oxygen', 'Testes descend into the scrotum to make room for other organs']\",\"question\":\"Occasionally a boy is born withundescendedtestes (cryptorchidism), and he will be sterile unless they are surgically caused to descend into the scrotum. Explain the reason for this.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}