{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb94c515-aa93-5ab9-83a9-636e3878a8a4","task_key":"default--test--2327","task_revision_id":"1","upstream_id":"2327","short_description":"Do different emotional states produce different patterns of physiological…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Directional fractionation is a mental response to emotional changes', 'Directional fractionation is the increase in heart rate and skin conductance', 'Directional fractionation is the synchronization of all physiological responses, such as heart rate and skin conductance, in response to an emotional state', 'Directional fractionation is a decrease in both heart rate and skin conductance', 'Directional fractionation is an autonomic reaction in which heart rate decreases, while other changes occur in an opposite direction, such as increased skin conductance', 'Directional fractionation is the uniform increase in all physiological responses under any emotional stress', 'Directional fractionation refers to the random variation of physiological responses independent of emotional states', 'Directional fractionation is a psychological state where the perception of emotion is separated from physiological responses', 'Directional fractionation is a phenomenon where all physiological responses are diminished in reaction to different emotions', 'Directional fractionation is the consistent decrease in physiological responses like heart rate and skin conductance across various emotional states']\",\"question\":\"Do different emotional states produce different patterns of physiological change? Define directional fractionation.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}