{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4cb5337-64ca-5c47-983c-c3f2e66ece4a","task_key":"default--test--7258","task_revision_id":"1","upstream_id":"7258","short_description":"How are fixed and variable costs different?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Fixed costs are associated with marketing and sales, while variable costs are associated with production and materials.', 'Fixed costs are unpredictable and change every month, while variable costs are consistent and do not change.', 'Variable costs decrease as the level of output increases, while fixed costs increase with the level of output.', 'Variable costs are incurred only at high levels of output, while fixed costs are incurred at all levels of output.', 'Fixed and variable costs are the same.', 'Fixed costs vary with the level of output, while variable costs do not.', 'Fixed costs are determined by the amount of production, while variable costs are set and do not change.', 'Fixed costs are directly tied to the level of production efficiency, while variable costs remain constant per unit of output.', 'Variable costs are always the same regardless of the level of output.', 'Fixed costs do not vary with the level of output, while variable costs vary with the level of output.']\",\"question\":\"How are fixed and variable costs different?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}