{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ce8836a-0749-59f6-b879-f86667e98757","task_key":"default--test--10177","task_revision_id":"1","upstream_id":"10177","short_description":"Two bicycle tires are set rolling with the same initial speed of 3.5 m/s on a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['[0.0459, 0.00305]', '[0.0309, 0.00705]', '[0.0109, 0.01005]', '[0.0259, 0.00505]', '[0.0509, 0.00105]', '[0.0359, 0.00405]', '[0.0409, 0.00905]', '[0.0209, 0.00805]', '[0.0559, 0.00205]', '[0.0159, 0.00605]']\",\"question\":\"Two bicycle tires are set rolling with the same initial speed of 3.5 m/s on a long, straight road, and the distance each travels before its speed is reduced by half is measured. One tire is inflated to a pressure of 40 psi and goes 18.1 m; the other is at 105 psi and goes 92.9 m. What is the coefficient of rolling friction for each? Assume that the net horizontal force is due to rolling friction only.\",\"src\":\"theoremQA-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}