{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b582a5f0-5105-5ace-97e7-5f64fd2ee558","task_key":"default--test--4036","task_revision_id":"1","upstream_id":"4036","short_description":"In 1932, many cities showed higher sunlight levels than in the previous year.…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"[\\\"The Earth's magnetic field weakened, allowing more solar radiation to reach the surface.\\\", 'Improved measurement techniques provided more accurate readings of sunlight levels.', 'Fewer particles were released that could scatter or absorb the sunlight due to reduced industrial activity.', \\\"A change in Earth's orbit resulted in longer days and more sunlight during the year.\\\", 'There were fewer tall buildings blocking the sunlight in 1932.', \\\"The Earth's atmosphere had an unusually low amount of ozone, allowing more sunlight to pass through.\\\", 'There was a large-scale removal of forests, which previously blocked sunlight in many cities.', 'The sun was closer to the Earth in 1932.']\",\"question\":\"In 1932, many cities showed higher sunlight levels than in the previous year. Explain this observation.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}