{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c56ff65-ba84-5317-a4a6-89f92a8b87d4","task_key":"default--test--3448","task_revision_id":"1","upstream_id":"3448","short_description":"How is the human eye regulated for far and near vision? In what respects does…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"The human eye uses the cornea to focus for far and near vision, while the frog's eye uses the lens.\\\", \\\"The human eye moves the lens forward or backward for focus, while frog's eye changes the curvature of the lens.\\\", \\\"Both human and frog's eyes focus objects by moving the lens forward or backward.\\\", \\\"The human eye adjusts the pupil size for focus, while the frog's eye uses the retina.\\\", \\\"Both human and frog's eyes use the adjustment of pupil size to regulate vision for far and near objects.\\\", \\\"Both human and frog's eyes focus objects by changing the shape of the lens.\\\", \\\"The human eye changes the curvature of the lens to focus, while frog's eye moves the lens forward or backward for focus.\\\", \\\"The human eye relies on the eyelids to focus, while the frog's eye alters the light intensity.\\\", \\\"The human eye utilizes a secondary lens for focus, while the frog's eye relies solely on the primary lens.\\\", \\\"The human eye changes the distance between the lens and the retina, while the frog's eye uses the iris to focus.\\\"]\",\"question\":\"How is the human eye regulated for far and near vision? In what respects does the frog eye differ in these regulatory mechanisms ?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}