{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c61dcc60-95a0-52f6-baf2-5a36451b4a56","task_key":"default--test--2916","task_revision_id":"1","upstream_id":"2916","short_description":"Which of the following statements about lipids is correct?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Lipids are the primary source of energy for cellular processes.', 'Lipids are soluble in water but insoluble in organic solvents.', 'Phospholipids are water soluble.', 'Steroids are lipids that consist of glycerol and fatty acids.', 'Lipids make up most cell surface receptors.', 'Lipids are primarily composed of proteins and carbohydrates.', 'All lipids have a similar structure and function in the body.', 'Lipids are incapable of crossing cell membranes.', 'All lipids are solid at room temperature.', 'Unsaturated fatty acids are linked to heart disease.']\",\"question\":\"Which of the following statements about lipids is correct?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}