{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac4c7dcb-0b62-59c7-9262-9f85dbdc8099","task_key":"default--test--11782","task_revision_id":"1","upstream_id":"11782","short_description":"A particle moves according to the equations x= sin 2t y=cos2t(1) z= e^-t wheret…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Velocity is (0, 2, -1), acceleration is (-4, -4, 0), velocity magnitude is √5, acceleration magnitude is √32', 'Velocity is (2, 0, -1), acceleration is (0, -4, 1), velocity magnitude is √5, acceleration magnitude is √17', 'Velocity is (1, 1, -1), acceleration is (0, -2, 1), velocity magnitude is √3, acceleration magnitude is √6', 'Velocity is (2, 2, -2), acceleration is (0, -4, 2), velocity magnitude is √12, acceleration magnitude is √20', 'Velocity is (2, 0, -1), acceleration is (0, -4, 1), velocity magnitude is √4, acceleration magnitude is √16', 'Velocity is (1, 0, -2), acceleration is (0, -3, 1), velocity magnitude is √5, acceleration magnitude is √17', 'Velocity is (2, -2, -1), acceleration is (4, 0, 1), velocity magnitude is √9, acceleration magnitude is √18', 'Velocity is (1, 2, -1), acceleration is (0, -3, 2), velocity magnitude is √4, acceleration magnitude is √16', 'Velocity is (2, -1, -2), acceleration is (4, 4, 1), velocity magnitude is √9, acceleration magnitude is √33', 'Velocity is (1, -2, 0), acceleration is (2, 3, -1), velocity magnitude is √6, acceleration magnitude is √14']\",\"question\":\"A particle moves according to the equations x= sin 2t y=cos2t(1) z= e^-t wheret is the time. 1) Determine the velocity of the particle. 2) Determine the acceleration of the particle. 3) Find the magnitudes of the velocity and acceleration att = 0.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}