{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e12188c2-88df-5162-9633-2f314e949b56","task_key":"default--test--9341","task_revision_id":"1","upstream_id":"9341","short_description":"A lens is required to form a virtual image with a magnification of 5 at a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['5.5 cm', '4 cm', '2.5 cm', '3.75 cm', '2 cm', '6 cm', '5 cm', '3.5 cm', '7 cm', '4.5 cm']\",\"question\":\"A lens is required to form a virtual image with a magnification of 5 at a distance of 25 cm from the lens. If the glass selected for its construction has a refractive index of 1.60 for the frequency of the light to be used, and one surface is to be plane, what must be the radius of curvature of the other surface of the lens?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}