{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d096555c-c69a-59c6-bc9c-4cbbe85ddaa9","task_key":"default--test--2323","task_revision_id":"1","upstream_id":"2323","short_description":"Define the motive to avoid success according to Horner. How did she go about…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['A motive to avoid success in occupational and intellectual pursuits in order to insure success in emotional and relational pursuits', 'The idea that women are naturally less ambitious than men', 'Success leads to negative results', 'The belief that success is inherently unattainable for women']\",\"question\":\"Define the motive to avoid success according to Horner. How did she go about studying this motive in women?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}