{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff440c08-2e0d-5cc3-9ccc-2a75a5a2a74a","task_key":"default--test--7676","task_revision_id":"1","upstream_id":"7676","short_description":"Marx (and the classical school) held that a commodity's value is determined by…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Marx differentiates between skilled and unskilled labor by the duration of labor, not by the type or quality of the work.', \\\"Marx computes the value of skilled labor from training costs and measures it in terms of units of unskilled labor. He averages differences in natural abilities into the term 'socially necessary labor'.\\\", 'Marx equalizes the value of all commodities by the average amount of labor, without considering individual skill differences.', 'Marx ignores the varied skills and natural abilities of people.', 'Marx believes that the value of a commodity is determined solely by the skill level of the labor.', 'Marx suggests that natural abilities are irrelevant, as all labor is inherently equal in the creation of value.', 'Marx treats the value of labor as a reflection of the social status of the laborer, rather than the labor itself.', 'Marx uses only the most skilled labor as a benchmark for determining the value of a commodity.', 'Marx attributes a fixed value to each type of labor regardless of skill level or natural ability.', 'Marx proposes that the market adjusts the value of commodities according to the rarity of the skills required to produce them.']\",\"question\":\"Marx (and the classical school) held that a commodity's value is determined by the amount of homogenous labor enbodied in the commodity. How does he reconcile thiswith the varied skills and natural abilities of people?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}