{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7592c16-33eb-5c1d-b6be-be18022bd4fb","task_key":"default--test--9870","task_revision_id":"1","upstream_id":"9870","short_description":"The cornea of the eye is a convex mirror, and the high-light usually seen in it…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['6 mm inside the cornea, 3 mm in diameter', '3 mm inside the cornea, 1 mm in diameter', '5 mm outside the cornea, 1.5 mm in diameter', '4 mm outside the cornea, 2 mm in diameter', '5 mm inside the cornea, 2 mm in diameter', '5 mm inside the cornea, 2.5 mm in diameter', '4 mm inside the cornea, 2 mm in diameter', '8 mm inside the cornea, 2.5 mm in diameter', '4 mm inside the cornea, 3 mm in diameter', '2 mm outside the cornea, 2 mm in diameter']\",\"question\":\"The cornea of the eye is a convex mirror, and the high-light usually seen in it is a reflected image. Suppose that a circular object 20 cm in diameter is located 40 cm from the eye. If the radius of the cornea is 0.8 cm, how far is the virtual image from the cornea and what is its size?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}