{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8f9dbe4-96a1-538a-b09c-ef4cfaa7ac2a","task_key":"default--test--2458","task_revision_id":"1","upstream_id":"2458","short_description":"The body’s stress response system:","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Can be permanently damaged if a person experiences a traumatic event', 'Can mainly be regulated through prescribed selective serotonin reuptake inhibitors (SSRIs)', 'Only impacts physical health, not mental or emotional health', 'Is not linked to mental health disorders', 'Is fully developed and functional at birth, with no changes occurring in later life', 'Can impact genetic predispositions to developmental disorders', 'Is only active during periods of extreme stress', 'Can be completely controlled through meditation and yoga', 'Is vulnerable to influence during childhood, but not before birth', 'Cannot be affected by outside influences']\",\"question\":\"The body’s stress response system:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}