{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f87dca7f-5f9e-51a4-af77-50be438840fa","task_key":"default--test--3381","task_revision_id":"1","upstream_id":"3381","short_description":"An eager AP Biology student interested in studying osmosis and the movement of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The bag will expand and eventually burst due to the pressure of water flow.', 'The solute will flow into the dialysis bag from the beaker.', 'The bag will remain the exact same size because no water will move at all.', 'The bag will shrink in size and the beaker will overflow due to the movement of water.', 'The solute will flow out of the dialysis bag into the beaker.', 'The water will evaporate from the bag, leaving only the solute.', 'There will be a net flow of water into the bag, causing it to swell in size.', 'There will be a net flow of water out of the beaker, causing it to decrease in size.', 'The water in the bag will freeze due to the change in environment.', 'There will be a net flow of water out of the bag, causing it to decrease in size.']\",\"question\":\"An eager AP Biology student interested in studying osmosis and the movement of water in solutions took a dialysis bag containing a 0.5 M solution and placed it into a beaker containing a 0.6 M solution. If this bag were instead placed into a beaker of distilled water, what would be the expected result?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}