{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dbbb7544-b401-59b7-93eb-169e9a93a81e","task_key":"default--test--11529","task_revision_id":"1","upstream_id":"11529","short_description":"The ѵ -irelation of a nonlinear resistor is given by ѵ (t) = (1/2)i^2 (t) Is…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['The resistor is controlled by the square root of the current', 'The resistor is current controlled', 'The resistor is both voltage and current controlled', 'The resistor control depends on the frequency of the input signal', 'The resistor is controlled by the cube of the current', 'The resistor is voltage controlled', 'The resistor control mechanism changes with temperature', 'The resistor is controlled by the inverse of the current', 'The resistor is controlled by the square of the voltage', 'The resistor is not controlled']\",\"question\":\"The ѵ -irelation of a nonlinear resistor is given by ѵ (t) = (1/2)i^2 (t) Is this resistor voltage-controlled? Current-controlled?\",\"src\":\"stemez-ElectricCircuits\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}