{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec6d1346-4109-5e76-8b8f-ed2e1fabc9fd","task_key":"default--test--2742","task_revision_id":"1","upstream_id":"2742","short_description":"Describe the use of thresholds and their relationship to Weber's law.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"Thresholds are the point at which a stimulus becomes harmful, which is not related to Weber's law.\\\", \\\"Weber's law is about the upper limit of stimulus\\\", \\\"Weber's law implies that multiple thresholds exist for each sense, and the j.n.d. for each is a constant amount.\\\", \\\"According to Weber's law, the threshold of detection is a fixed amount of intensity change regardless of the baseline intensity.\\\", \\\"A threshold is the maximum stimulus intensity that can be perceived, and Weber's law suggests this threshold diminishes over time.\\\", \\\"Thresholds are irrelevant to Weber's law\\\", \\\"Weber's law states that the threshold is the minimum stimulus intensity needed to detect a stimulus 50% of the time.\\\", \\\"A threshold is a boundary which separates different stimuli responses. The just noticeable difference (j.n.d.) is a percentage of a standard value, known as Weber's law.\\\", 'Thresholds are fixed values', \\\"Thresholds decrease as the intensity of a stimulus increases, in direct proportion to the stimulus size, as per Weber's law.\\\"]\",\"question\":\"Describe the use of thresholds and their relationship to Weber's law.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}