{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d5f8e39f-4665-5123-88ca-5ceb3044be6c","task_key":"default--test--3680","task_revision_id":"1","upstream_id":"3680","short_description":"The van der Waal equation is a modification of the ideal gas equation. It reads…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['more ideal, less ideal, more ideal', 'less ideal, more ideal, less ideal', 'more ideal, less ideal, less ideal', 'closer to being ideal, more ideal, less ideal', 'less ideal, more ideal, more ideal', 'less ideal, less ideal, less ideal', 'more ideal, more ideal, less ideal', 'less ideal, less ideal, closer to being ideal', 'more ideal, less ideal, closer to being ideal', 'closer to being ideal, less ideal, more ideal']\",\"question\":\"The van der Waal equation is a modification of the ideal gas equation. It reads [P + (an^2 / V^2)] (V - nb) = nRT where P = pressure, V = volume, n = number of moles, R = gas constant, T = absolute temperature, and (a) and (b) are constants for a particular gas. The term an^2 /V^2 corrects the pressure for intermolecular attraction and the term - nb corrects the volume for molecular volume. Using this equation, determine whether a gas becomes more or less ideal when: (a.) the gas is compressed at constant temperature; (b.) more gas is added at constant volume and temperature; and (c.) The temperature of the gas is raised at constant volume.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}