{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff3834e8-ee3d-57f1-af6d-6ef8d744da02","task_key":"default--test--547","task_revision_id":"1","upstream_id":"547","short_description":"A firm produces three different products. They have determined the total cost…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Product A: decreasing, Product B: increasing, Product C: constant', 'Product A: increasing, Product B: constant, Product C: decreasing', 'Product A: increasing, Product B: decreasing, Product C: constant', 'Product A: decreasing, Product B: decreasing, Product C: constant', 'Product A: constant, Product B: constant, Product C: decreasing', 'Product A: increasing, Product B: increasing, Product C: decreasing', 'Product A: constant, Product B: decreasing, Product C: increasing', 'Product A: constant, Product B: increasing, Product C: decreasing', 'Product A: decreasing, Product B: increasing, Product C: increasing', 'Product A: decreasing, Product B: constant, Product C: increasing']\",\"question\":\"A firm produces three different products. They have determined the total cost function of each to be as follows: Product A: Total Cost = $56 + 2X Product B: Total Cost = $56 + 2X + 4X^2 Product C: Total Cost = $56 + 2X -4X^2 4X^2 where X is the number of units produced. Determine from each products cost function whether its productivity is contant, increasing, or decreasing.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}