{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fc01221-66d9-5d08-93f1-f0cc291d4d08","task_key":"default--test--7598","task_revision_id":"1","upstream_id":"7598","short_description":"How does labor fit in the circular flowmodel ?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Labor is created by businesses and shared among households', 'Labor is a type of good that households export to other countries', 'Labor is supplied by businesses and demanded by households', 'Labor is a finished article demanded by households', 'Labor is a scarce resource, furnished by households and demanded by businesses', 'Labor is a renewable resource generated by households for personal use', 'Labor is an abundant resource, supplied by households', 'Labor is an unlimited resource that businesses provide to each other', 'Labor is a service provided by the government to businesses', 'Labor is a form of capital that businesses lend to households']\",\"question\":\"How does labor fit in the circular flowmodel ?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}