{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ba405ac-061f-5d97-b7f6-5c1d94e2736c","task_key":"default--test--4603","task_revision_id":"1","upstream_id":"4603","short_description":"A 2.0 L flask holds 0.40 g of helium gas. If the helium is evacuated into a…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['It will increase as the gas molecules will be more dispersed in the larger flask.', 'It will remain constant as the helium is simply transferred to a larger container.', 'It will remain constant because the volume of the flask does not affect entropy.', 'It will remain constant as the number of helium molecules does not change.', 'It will increase as the temperature is held constant.', 'It will decrease as the pressure of the gas will decrease in the larger flask.', 'It will decrease as there will be fewer collisions between the helium molecules in the larger flask.', 'It will decrease as the gas will be more ordered in the larger flask.', 'It will decrease because the molecules will collide with the sides of the larger flask less often than they did in the smaller flask.', 'It will increase because the molecules will collide with the sides of the larger flask more often than they did in the smaller flask.']\",\"question\":\"A 2.0 L flask holds 0.40 g of helium gas. If the helium is evacuated into a larger container while the temperature is held constant, what will the effect on the entropy of the helium be?\",\"src\":\"ori_mmlu-high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}