{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"197c3e67-8c48-58af-9af0-c04c87c397da","task_key":"all--test--197c3e67-8c48-58af-9af0-c04c87c397da","task_revision_id":"1","upstream_id":"","short_description":"An eager AP Biology student interested in studying osmosis and the movement of…","config":"all","split":"test","body":"{\"choices\":\"['There will be a net flow of water out of the bag, causing it to decrease in size.', 'There will be a net flow of water into the bag, causing it to swell in size.', 'The bag will remain the exact same size because no water will move at all.', 'The solute will flow out of the dialysis bag into the beaker.']\",\"question\":\"An eager AP Biology student interested in studying osmosis and the movement of water in solutions took a dialysis bag containing a 0.5 M solution and placed it into a beaker containing a 0.6 M solution. If this bag were instead placed into a beaker of distilled water, what would be the expected result?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}