{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30e0d685-c0d5-5add-9e0f-60eaf9d4ae4f","task_key":"default--test--10080","task_revision_id":"1","upstream_id":"10080","short_description":"A beam of parallel rays, parallel to the axis, falls on the objective of a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['35 cm', '10 cm', '12 cm', '20 cm', '30 cm', '25 cm', '24 cm', '15 cm', '28 cm', '18 cm']\",\"question\":\"A beam of parallel rays, parallel to the axis, falls on the objective of a telescope equipped with aRamsdeneyepiece and adjusted so that the final image is at infinity. If the focal length of the objective is 30.00 cm and the common focal length of each of the lenses of the eyepiece is 6.0 cm, find the diameter of the beam of light emerging from the telescope. (Diameter of objective is 3.0 cm.)\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}