{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"731549e9-716b-5088-9aea-eb22231bf559","task_key":"default--test--6922","task_revision_id":"1","upstream_id":"6922","short_description":"List the three main characteristics of monopolistic competition and discuss…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Large number of competitors, product differentiation, free entry and exit', 'Unlimited competitors, product uniqueness, blocked entry and exit', 'High barriers to entry, perfect information, homogeneous products', 'Few competitors, product similarity, restricted entry']\",\"question\":\"List the three main characteristics of monopolistic competition and discuss briefly the implications of these characteristics.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}