{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ade3c1d-f174-5e60-b6e2-8e8cb427c9a1","task_key":"default--test--3247","task_revision_id":"1","upstream_id":"3247","short_description":"In the early 1900's, many fruit growers made a practice of ripening fruits by…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The ripening was caused by the soot from the kerosene stove settling on the fruits.', 'The fruits ripened due to the carbon dioxide produced by the kerosene stove.', 'The fruits ripened faster due to increased humidity from the kerosene stove.', 'It was the incomplete combustion products of the kerosene, identified as ethylene, that ripened the fruits.', 'The fruits ripened naturally without any influence from the kerosene stove.', 'It was the light emitted by the kerosene stove that accelerated the ripening process.', 'The fruits ripened due to the ozone produced by the kerosene stove.', 'The ripening was facilitated by the slight increase in temperature, not directly related to the heat of the stove.', 'The kerosene stove released a specific ripening hormone that caused the fruits to ripen.', 'It was the heat from the kerosene stove that ripened the fruits.']\",\"question\":\"In the early 1900's, many fruit growers made a practice of ripening fruits by keeping them in a room with a kerosene stove. They believed it was the heat that ripened the fruits. Was this belief based on correct facts? Explain your answer.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}