{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72a8a726-3e43-543e-82c7-a1c87d84a4a1","task_key":"default--test--2307","task_revision_id":"1","upstream_id":"2307","short_description":"How is Achievement Motive (nAch) measured in both individuals and countries ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"By observing individual's behaviors and actions\\\", 'Through the analysis of social media usage and engagement patterns', \\\"By analyzing the country's economic factors\\\", 'By examining the literacy and numeracy rates', 'Through standardized achievement tests in educational institutions', 'By calculating the Gross Domestic Product (GDP) per capita', 'Using a Global Achievement Motivation Index', 'By assessing the number of patents and innovations per capita', 'Administer a Thematic Apperception Test (TAT) and study the basic themes of childhood stories and folktales']\",\"question\":\"How is Achievement Motive (nAch) measured in both individuals and countries ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}