{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25594c2a-4146-5e78-8137-bdadbc22b467","task_key":"default--test--5953","task_revision_id":"1","upstream_id":"5953","short_description":"Shaggy has a fantasy about digging up a recently buried woman and having sex…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['aversive conditioning', 'flooding therapy', 'behavioral activation therapy', 'covert sensitization', 'sexual addiction therapy', 'orgasmic reconditioning', 'biofeedback therapy', 'cognitive behavioral therapy', 'desensitization therapy', 'exposure therapy']\",\"question\":\"Shaggy has a fantasy about digging up a recently buried woman and having sex with her. He told his friends this and they encouraged him to get therapy. As part of the treatment he masturbates to his fantasy and at the last moment before orgasm he switches to a fantasy about having sex with a living woman. This procedure is part of the process of:\",\"src\":\"ori_mmlu-human_sexuality\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}