{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55f95c68-e196-5659-a7a3-7e88a6e43312","task_key":"default--test--2934","task_revision_id":"1","upstream_id":"2934","short_description":"A stem-boring beetle has laid its eggs in the center of a 5-year-old wood twig,…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Pith; primary xylem; secondary xylem; vascular cambium; primary phloem; secondary phloem; cortex', 'Pith; primary xylem; vascular cambium; secondary xylem; primary phloem; secondary phloem; cortex', 'Pith; secondary xylem; primary xylem; vascular cambium; primary phloem; secondary phloem; cortex', 'Pith; vascular cambium; primary xylem; secondary xylem; primary phloem; secondary phloem; cortex', 'Pith; primary xylem; secondary xylem; vascular cambium; primary phloem; cortex; secondary phloem', 'Pith; primary xylem; secondary xylem; vascular cambium; secondary phloem; primary phloem; cortex', 'Pith; secondary xylem; primary xylem; vascular cambium; secondary phloem; primary phloem; cortex', 'Pith; secondary xylem; vascular cambium; primary xylem; secondary phloem; primary phloem; cortex', 'Vascular cambium; primary xylem; secondary xylem; pith; secondary phloem; primary phloem; cortex', 'Pith; primary xylem; vascular cambium; secondary xylem; secondary phloem; primary phloem; cortex']\",\"question\":\"A stem-boring beetle has laid its eggs in the center of a 5-year-old wood twig, and the eggs have matured into larvae. In proper order (inside to outside), what tissues and tissue regions would the larvae encounter as they eat their way toward the outside of the twig? (For simplicity, assume that the epidermis has already fallen off completely.)\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}