{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3f8c60c9-d4c2-597b-a2ce-baa8a4b37c46","task_key":"default--test--9976","task_revision_id":"1","upstream_id":"9976","short_description":"A large telescope is focused on a double star and the interference pattern is…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.35 second of arc', '0.25 second of arc', '0.05 second of arc', '0.5 second of arc', '0.1 second of arc', '0.4 second of arc', '0.01 second of arc', '0.15 second of arc', '0.3 second of arc', '0.2 second of arc']\",\"question\":\"A large telescope is focused on a double star and the interference pattern is observed when an adjustable double slit is placed in front of the objective. The distance between the centers of the components of the double slit is gradually increased until the fringes disappear. If this distance is 57.5 cm, find the angular separation of the two components of the double star. (Take mean \\\\lambda = 5550A°.)\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}