{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b2207c5c-b0a5-51bc-8a17-e9d7acf74db1","task_key":"default--test--2558","task_revision_id":"1","upstream_id":"2558","short_description":"According toJellinek(1952) what progression does thelife ofan alcoholic usually…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Onset phase, abuse phase, dependency phase, abstinence phase', 'Prealcoholic phase, alcoholic phase, recovery phase, relapse phase', 'Initial phase, adaptive phase, dependent phase, deteriorative phase', 'Experimental phase, social use phase, intensive use phase, compulsive use phase', 'Initial phase, middle phase, crucial phase, termination phase', 'Experimental phase, regular use phase, risky use phase, dependence phase', 'Early stage, middle stage, late stage, recovery stage', 'Prodromal phase, crucial phase, chronic stage, recovery phase', 'Induction phase, maintenance phase, deterioration phase, rehabilitation phase', 'Prealcoholic phase, prodromal phase, crucial phase, chronic stage']\",\"question\":\"According toJellinek(1952) what progression does thelife ofan alcoholic usually follow ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}