{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb361b6b-9236-549f-a017-35856b40a70c","task_key":"default--test--9528","task_revision_id":"1","upstream_id":"9528","short_description":"A rifle weighing 7 pounds shoots a bullet weighing 1 ounce, giving the bullet a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Recoil speed: 6 ft/sec backwards, 0.2 ft/sec backwards, 12 ft/sec forwards', 'Recoil speed: 14 ft/sec backwards, 0.8 ft/sec backwards, 22 ft/sec forwards', 'Recoil speed: 15 ft/sec backwards, 1 ft/sec backwards, 30 ft/sec forwards', 'Recoil speed: 9 ft/sec backwards, 0.6 ft/sec backwards, 24 ft/sec forwards', 'Recoil speed: 10 ft/sec backwards, 0.5 ft/sec backwards, 20 ft/sec forwards', 'Recoil speed: 7 ft/sec backwards, 0.3 ft/sec backwards, 17 ft/sec forwards', 'Recoil speed: 20 ft/sec backwards, 0.7 ft/sec backwards, 25 ft/sec forwards', 'Recoil speed: 8 ft/sec backwards, 0.6 ft/sec backwards, 15 ft/sec forwards', 'Recoil speed: 12 ft/sec backwards, 0.4 ft/sec backwards, 18 ft/sec forwards', 'Recoil speed: 5 ft/sec backwards, 0.3 ft/sec backwards, 10 ft/sec forwards']\",\"question\":\"A rifle weighing 7 pounds shoots a bullet weighing 1 ounce, giving the bullet a speed of 1120 feet per second. (a) If the rifle is free to move, what is its recoil speed? (b) If the rifle is held tight against the shoulder of a man weighing 133 pounds and if he were free to move, what would be the recoil speed of the rifle and man? (c) If the bullet imbeds itself in a block of wood weighing 3 pounds and 7 ounces and if the block were free to move, what would be the speed of the block plus bullet?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}