{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"12bbf185-d631-52d0-baa3-145b49f74e86","task_key":"default--test--10051","task_revision_id":"1","upstream_id":"10051","short_description":"A car moving with speed v reaches the foot of an incline of angle θ. The car…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['ax > g; ay = g', 'ax = 0; ay < g', 'ax < g; ay < g', 'ax = g; ay < g', 'ax = 0; ay = g', 'ax = g; ay = 0', 'ax < g; ay > g', 'ax = g; ay = g', 'ax < g; ay = g', 'ax > g; ay < g']\",\"question\":\"A car moving with speed v reaches the foot of an incline of angle θ. The car coasts up the incline without using the engine. Neglecting friction and air resistance, which of the following is correct about the magnitude of the car’s horizontal acceleration ax and vertical acceleration ay?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}