{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8eab16e7-3a8f-5773-ad1c-6b8ddb49f35f","task_key":"default--test--10204","task_revision_id":"1","upstream_id":"10204","short_description":"Suppose that a two-stage rocket starts from rest with a mass m_1. At burn-out of…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['v = v_0 ln [(m_1 - m_2) / (m_A * m_B)]', 'v = v_0 In [(m_1 * m_2)(m_A*m_B)]', 'v = v_0 ln [(m_1^2 / m_2) * (m_A / m_B)]', 'v = v_0 ln [(m_1 * m_2) / (m_A + m_B)]', 'v = v_0 ln [(m_1 / m_2) + (m_A/m_B)]', 'v = v_0 In [(m_1 / m_2)(m_A+m_B)]', 'v = v_0 ln [(m_1 + m_2) * (m_A - m_B)]', 'v = v_0 ln [m_1 / (m_2 + m_A + m_B)]', 'v = v_0 In [(m_1 / m_2)(m_A/m_B)]', 'v = v_0 ln [(m_1 + m_2) / (m_A * m_B)]']\",\"question\":\"Suppose that a two-stage rocket starts from rest with a mass m_1. At burn-out of the first stage engine, the mass is m_2. If the exhaust velocity is v_0, the rocket velocity after the first stage engines quit is v = v_0ln(m_1 / m_2). Before the second stage engines are ignited, part of the mass m_2 is discarded - the mass of the first stage engines. The mass of the second stage ism_Awhen the en-gines start andm_Bwhen the engines shut down. What is the terminal velocity of the second stage?\",\"src\":\"stemez-Mechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}