{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66563655-0e5a-5602-b7b8-aa4840a6cc1a","task_key":"default--test--9538","task_revision_id":"1","upstream_id":"9538","short_description":"What happens to the image formed by a concave mirror as the object is moved from…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The image disappears as it moves toward the mirror.', 'The image moves away from the mirror and gets taller.', 'The image stays at the same distance from the mirror and gets shorter.', 'The image moves toward the mirror and gets shorter.', 'The image moves toward the mirror and gets taller.', 'The image stays at the same distance from the mirror and gets taller.', 'The image moves toward the mirror and stays the same height.', 'The image flips upside down as it moves toward the mirror.', 'The image moves away from the mirror and stays the same height.', 'The image moves away from the mirror and gets shorter.']\",\"question\":\"What happens to the image formed by a concave mirror as the object is moved from far away to near the focal point?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}