{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c28b6258-2e31-5361-ba36-fdde63df0f9c","task_key":"default--test--4284","task_revision_id":"1","upstream_id":"4284","short_description":"An excellent method of making alcohols is the reaction of an aldehydeon a…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"[\\\"The aldehyde's structure is altered by the presence of water\\\", 'The aldehyde can react with other components if not dried', 'Water increases the viscosity of the reaction mixture, reducing the efficiency', 'Water can initiate a side reaction with the Grignard reagent, forming an unwanted byproduct', 'Water can cause the Grignard reagent to decompose into a hydrocarbon', 'The dry aldehyde can absorb moisture from the air, which can slow down the reaction', 'The Grignard reagent is sensitive to temperature changes', 'The aldehyde will polymerize if not dried', 'The aldehyde needs to be in a dry state for the reaction to occur', 'The presence of water reduces or eliminates the Grignard reagent from solution']\",\"question\":\"An excellent method of making alcohols is the reaction of an aldehydeon a Grignard reagent. If you perform this reaction, you must scrupulously dry thealdehydebefore adding it to the Grignard reagent. Why?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}