{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c69fed59-32e2-598c-bad3-54c63646ec2d","task_key":"default--test--2316","task_revision_id":"1","upstream_id":"2316","short_description":"LSD used to be called a \"psychomimetic\" drug because it caused effects similar…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['LSD has been found to improve mental health in patients', 'The effects of LSD and the schizophrenic state are different', 'LSD and schizophrenia have identical symptoms', 'LSD does not cause hallucinations', 'Schizophrenia is caused by LSD use', 'The effects of LSD are universally the same for all individuals', 'LSD only affects the visual cortex of the brain', 'LSD causes permanent mental illness', \\\"LSD's effects last for the duration of the drug's presence in the body\\\", \\\"LSD's effects are only physical, not psychological\\\"]\",\"question\":\"LSD used to be called a \\\"psychomimetic\\\" drug because it caused effects similar to those of mental illness. Why has this explanation been refuted?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}