{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f2e717f-9f82-590c-9303-f896d41fe633","task_key":"default--test--9306","task_revision_id":"1","upstream_id":"9306","short_description":"Data is collected in an experiment preformed on an ideal gas. In the experiment,…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The slope will be linearly proportional to the pressure of the gas and the intercept will be 0 m^3.', 'The slope will be inversely proportional to the volume of the gas and the intercept will be 0 m^3.', 'The slope will be inversely proportional to the pressure of the gas and the intercept will not be 0 m^3.', 'The slope will be linearly proportional to the volume of the gas and the intercept will be 0 m^3.', 'The slope will be linearly proportional to the pressure of the gas and the intercept will not be 0 m^3.', 'The slope will be inversely proportional to the pressure of the gas and the intercept will be 0 m^3.', 'The slope will be inversely proportional to the volume of the gas and the intercept will not be 0 m^3.', 'The slope will be zero and the intercept will be equal to the pressure of the gas.', 'The slope will be equal to the pressure of the gas and the intercept will be equal to the volume of the gas.', 'The slope will be linearly proportional to the volume of the gas and the intercept will not be 0 m^3.']\",\"question\":\"Data is collected in an experiment preformed on an ideal gas. In the experiment, temperature (in K) is the independent variable and volume (in m^3) is the dependent variable. If a plot is produced where the dependent variable is on the vertical axis, which of the following is true about the slope and y-intercept of the graph?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}