{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0130827b-dffe-5a9b-ae64-ec130a249c7d","task_key":"default--test--7588","task_revision_id":"1","upstream_id":"7588","short_description":"Give the significance of the \"most favored nation clause\" in the Gatt agreement.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"[\\\"The 'most favored nation clause' is the agreement that no member of GATT will be treated worse than the 'most favored nation', meaning that no member country's imports can be charged a higher tariff than any other member country, unless special exceptions have been made.\\\", 'It is a clause that allows for the imposition of high tariffs on certain goods', 'It is a provision that allows for the exemption of certain countries from tariff reduction', 'It is an agreement that allows for preferential treatment of a particular country']\",\"question\":\"Give the significance of the \\\"most favored nation clause\\\" in the Gatt agreement.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}