{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4882778c-a458-50ed-9729-5190ce504a36","task_key":"default--test--7533","task_revision_id":"1","upstream_id":"7533","short_description":"What is meant by the term \"normal goods\"?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Normal goods are those whose demand is independent of income.', 'Normal goods are those whose demand curve shifts downward with an increase in income.', 'Normal goods are those whose consumption is deemed socially unacceptable as income rises.', 'Normal goods are those whose demand curve shifts upward with a decrease in income.', 'Normal goods are those whose demand curve varies directly with income.', 'Normal goods are those that are replaced by inferior goods as income increases.', 'Normal goods are those whose demand decreases as income increases.', 'Normal goods are those for which demand does not change regardless of changes in the prices of related goods.', 'Normal goods are those that are only purchased by consumers with above-average income.', 'Normal goods are those whose demand increases only with a decrease in the price of complementary goods.']\",\"question\":\"What is meant by the term \\\"normal goods\\\"?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}