{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac3c178a-d67d-5af0-bd82-cdbac13dbefd","task_key":"default--test--5527","task_revision_id":"1","upstream_id":"5527","short_description":"What are the three dimensions of intimacy in romantic relationships that outline…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['mutual self-disclosure, sexuality, and trusting', 'becoming emotional, caring, and physical', 'affective, emotional, and sexual', 'emotional, caring, and trustful', 'affective, trusting, and friendship', 'cognitive, physical, and emotional', 'trust, caring, and sexuality', 'affective, cognitive, and physical', 'affective, cognitive, and sexual', 'emotional, rational, and friendship']\",\"question\":\"What are the three dimensions of intimacy in romantic relationships that outline closeness and sharing?\",\"src\":\"ori_mmlu-human_sexuality\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}