{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a9cf030-345d-5024-81cb-5688692b99d4","task_key":"default--test--9604","task_revision_id":"1","upstream_id":"9604","short_description":"A rocket has a length L = 600 m measured at rest on the earth. It moves directly…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['R = 3.2 × 10^10 m, v = 2.40 × 10^8 m/sec', 'R = 2 × 10^10 m, v = 1.63 × 10^8 m/sec', 'R = 3.5 × 10^10 m, v = 2.50 × 10^8 m/sec', 'R = 4.5 × 10^10 m, v = 3.00 × 10^8 m/sec', 'R = 2.5 × 10^10 m, v = 2.00 × 10^8 m/sec', 'R = 1.5 × 10^10 m, v = 1.50 × 10^8 m/sec', 'R = 4 × 10^10 m, v = 2.63 × 10^8 m/sec', 'R = 1 × 10^10 m, v = 1.13 × 10^8 m/sec', 'R = 3 × 10^10 m, v = 2.13 × 10^8 m/sec', 'R = 2.8 × 10^10 m, v = 1.90 × 10^8 m/sec']\",\"question\":\"A rocket has a length L = 600 m measured at rest on the earth. It moves directly away from the earth at constant velocity, and a pulse of radar is sent from earth and reflected back by devices at the nose and tail of the rocket. The reflected signal from the tail is detected on earth 200 sec after emission and the signal from the nose 17.4 × 10^-6 sec later. Calculate the distance of the rocket from the earth and the velocity of the rocket with respect to the earth.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}