{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44d3fc9d-b022-54ee-84aa-db357c12ba9d","task_key":"default--test--10198","task_revision_id":"1","upstream_id":"10198","short_description":"In aFizeautoothed-wheel experiment for obtaining the velocity of light, an…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['2.988 × 10^7 m/s and 3500 rpm', '1.488 × 10^8 m/s and 6500 rpm', '3.988 × 10^7 m/s and 2500 rpm', '2.488 × 10^8 m/s and 3000 rpm', '1.988 × 10^8 m/s and 4000 rpm', '3.488 × 10^8 m/s and 5000 rpm', '2.988 × 10^8 m/s and 4500 rpm', '3.988 × 10^8 m/s and 6000 rpm', '2.988 × 10^8 m/s and 7500 rpm', '1.988 × 10^8 m/s and 5500 rpm']\",\"question\":\"In aFizeautoothed-wheel experiment for obtaining the velocity of light, an eclipse of the source is first observed when the speed of the disk is 1500 rpm. (a) If the distance of the toothed wheel, which has 600 teeth, to the reflecting mirror is 4980 meters, find the velocity of light. (b) At what speed must the disk be moving for a second eclipse to be observed?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}