{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9e244b4f-645b-55e5-b9e8-27d38bf0c246","task_key":"default--test--9762","task_revision_id":"1","upstream_id":"9762","short_description":"A thick lens, which has principal points at \\alpha = 1.2 cm and \\beta = - 0.8…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['20 cm', '39.2 cm', '38.8 cm', '-20 cm', '-38.8 cm', '19.2 cm', '58.8 cm', '40 cm', '50 cm', '30 cm']\",\"question\":\"A thick lens, which has principal points at \\\\alpha = 1.2 cm and \\\\beta = - 0.8 cm, forms an image of a distant object 19.2 cm from the second surface of the lens. Find the position of the image of an object placed 38.8 cm from the first face. The sign convention used is that distances are positive if measured in the direction of light propagation and negative if measured in the opposite direction; \\\\alpha is measured from the first surface of the lens and \\\\beta from the second.\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}