{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64fefe95-e230-5539-9e75-ba6d879fc3db","task_key":"default--test--9393","task_revision_id":"1","upstream_id":"9393","short_description":"A student sets up a Young's experiment using a sodium vapor lamp as a light…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['3.025 mm', '3.525 mm', '2.025 mm', '2.525 mm', '1.025 mm', '2.225 mm', '4.025 mm', '0.525 mm', '4.525 mm', '1.525 mm']\",\"question\":\"A student sets up a Young's experiment using a sodium vapor lamp as a light source and placing his slits 1 m from a screen. He is unsure of the slit separation and, standing beside the slits, he varies the separation and finds the interference pattern vanishes if the slits are too far apart. If the angular resolution of his eye is 1 minute of arc, how far apart are the slits when he just cannot see the interference fringes ?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}