{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dee9d124-6601-53e7-a6fa-730fa3557276","task_key":"default--test--7464","task_revision_id":"1","upstream_id":"7464","short_description":"At Price = $q, quantity demanded, Q_D = 11. At Price = $11, QD = 9. Find the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['a) demand is perfectly inelastic, b) demand is unitarily elastic, c) demand is inelastic', 'a) demand is unitarily elastic, b) demand is inelastic, c) demand is elastic', 'a) demand is perfectly elastic, b) demand is perfectly inelastic, c) demand is unitarily elastic', 'a) demand is perfectly inelastic, b) demand is elastic, c) demand is perfectly elastic', 'a) demand is inelastic, b) demand is perfectly elastic, c) demand is perfectly inelastic', 'a) demand is elastic, b) demand is unitarily elastic, c) demand is inelastic', 'a) demand is perfectly elastic, b) demand is inelastic, c) demand is unitarily elastic', 'a) demand is inelastic, b) demand is elastic, c) demand is unitarily elastic', 'a) demand is unitarily elastic, b) demand is perfectly inelastic, c) demand is elastic', 'a) demand is elastic, b) demand is inelastic, c) demand is perfectly elastic']\",\"question\":\"At Price = $q, quantity demanded, Q_D = 11. At Price = $11, QD = 9. Find the elasticity of demand using a) P = 9, Q_D = 11 as a base b) P = 11, Q_D = 9 as a base c) average values as a base.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}