{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14f8267b-feab-5fbb-bc64-ac4f32185a2a","task_key":"default--test--11531","task_revision_id":"1","upstream_id":"11531","short_description":"Using the definition of the partial derivative of the vector, find:…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(2uv, 1, 1), (u^2,e^v, 2v), (2u, 1, 0)', '(2u, e^v, 2v), (2uv, 0, 1), (0, 1, 2v)', '(2uv, 1, 1), (u^2,e^v, 2u), (2u, 0, 0)', '(uv, 1, 2u), (2uv, 0, e^v), (2, e^v, 0)', '(2u, 1, 2v), (uv, e^v, 1), (0, 0, 2)', '(2uv, 1, 0), (u^2,e^v, 2v), (2u, 0, 0)', '(u^2, 0, 1), (2uv, 1, e^v), (0, 2u, 0)', '(2uv, 1, 1), (u^2,e^v, 2v), (2u, 0, 0)', '(0, 1, 2v), (u^2, 1, 1), (2uv, e^v, 0)', '(2uv, 0, 1), (u^2, 1, 2u), (2, 0, e^v)']\",\"question\":\"Using the definition of the partial derivative of the vector, find: 1)(\\\\partiala/ \\\\partialu) 2)(\\\\partiala/ \\\\partialv) 3)[(\\\\partial^2a) / (\\\\partialu\\\\partialv) where a= (u^2v, u +e^v, u + v^2)(1)\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}