{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51555799-f9f4-5eba-92b6-f47fc9375244","task_key":"default--test--7673","task_revision_id":"1","upstream_id":"7673","short_description":"Using a marginal utility approach, explain why air, so vitally important to the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Air is free because it regenerates itself too quickly to be priced.', \\\"Air is free because it can't be packaged and sold\\\", \\\"Air is free because it's abundant\\\", 'Air is free because its marginal utility remains constant, regardless of consumption.', 'Air is free because its marginal utility is zero, it is not a scarce good.', 'Air is free because the cost of production is zero.', 'Air is free because no one owns it', 'Air is free because the technology to control its distribution does not exist.', 'Air is free because it is impossible to measure its utility.', 'Air is free because it is a fundamental human right.']\",\"question\":\"Using a marginal utility approach, explain why air, so vitally important to the maintenance of life, is free.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}