{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1e70c8b-99f7-57b3-abaf-bf3c72eabd3c","task_key":"default--test--9885","task_revision_id":"1","upstream_id":"9885","short_description":"The earth acts onany bodywith a gravitational force inversely proportional to…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['11.2 × 10^3 m/s, 15 minutes', '11.0 × 10^3 m/s, 11.0 minutes', '11.2 × 10^3 m/s^2, 11.61 minutes', '11.2 x 10^3 m/s^2, 10.61 minutes', '12.2 x 10^3 m/s^2, 12.61 minutes', '12.2 × 10^3 m/s, 8.2 minutes', '10 x 10^3 m/s^2, 10 minutes', '8.9 × 10^3 m/s, 9.42 minutes', '9.2 × 10^3 m/s, 8.5 minutes', '10.5 × 10^3 m/s, 12.34 minutes']\",\"question\":\"The earth acts onany bodywith a gravitational force inversely proportional to the square of the distance of the body from the center of the earth. Calculate the escape velocity from the earth, i.e., the speed with which a vertically moving body must leave the earth's surface in order to coast along without being pulled back to the earth. Also find the time it takes for a rocket projected upward with this escape velocity to attain a height above the earth's surface equal to its radius. In both cases ignore the effect of any other heavenly bodies and take the earth's radius as 6.38 × 10^6 m.\",\"src\":\"stemez-Mechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}