{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51ed0040-5a0e-5a63-a132-8d8a2d5f9a16","task_key":"default--test--7455","task_revision_id":"1","upstream_id":"7455","short_description":"How is the use of land a cost, not counting the rent onehas topay to use the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The cost of land is the price one pays to purchase it.', 'The cost of land refers to the taxes one has to pay for owning it.', 'The cost of land is the cost of maintaining it.', 'The use of land also constitutes a cost, in this sense an implicit cost, that is the money payments which the land resource could have earned in their best alternative employments.']\",\"question\":\"How is the use of land a cost, not counting the rent onehas topay to use the land?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}