{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"37ea30ad-6b81-5993-9e09-4a3e0b985e44","task_key":"all--test--37ea30ad-6b81-5993-9e09-4a3e0b985e44","task_revision_id":"1","upstream_id":"","short_description":"Every day Melanie spends her lunch money consuming apples, at $1 each, and…","config":"all","split":"test","body":"{\"choices\":\"['She should make no changes; she is consuming the utility maximizing combination of apples and oranges.', 'She should increase her apple consumption and decrease her orange consumption until the marginal utility per dollar is equal for both.', 'She should decrease her apple consumption and increase her orange consumption until the marginal utility per dollar is equal for both.', 'She should increase her apple consumption and decrease her orange consumption until the marginal utility is equal for both.']\",\"question\":\"Every day Melanie spends her lunch money consuming apples, at $1 each, and oranges, at $2 each. At her current level of consumption, Melanie's marginal utility of apples is 12 and her marginal utility of oranges is 18. If she has already spent all of her lunch money, how should Melanie change her consumption decision to maximize utility?\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}