{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b2eb4a7a-64e0-52fc-9da0-c93b50cf08d5","task_key":"all--test--b2eb4a7a-64e0-52fc-9da0-c93b50cf08d5","task_revision_id":"1","upstream_id":"","short_description":"A stem-boring beetle has laid its eggs in the center of a 5-year-old wood twig,…","config":"all","split":"test","body":"{\"choices\":\"['Pith; primary xylem; secondary xylem; vascular cambium; primary phloem; secondary phloem; cortex', 'Pith; secondary xylem; primary xylem; vascular cambium; secondary phloem; primary phloem; cortex', 'Pith; secondary xylem; primary xylem; vascular cambium; primary phloem; secondary phloem; cortex', 'Pith; primary xylem; secondary xylem; vascular cambium; secondary phloem; primary phloem; cortex']\",\"question\":\"A stem-boring beetle has laid its eggs in the center of a 5-year-old wood twig, and the eggs have matured into larvae. In proper order (inside to outside), what tissues and tissue regions would the larvae encounter as they eat their way toward the outside of the twig? (For simplicity, assume that the epidermis has already fallen off completely.)\",\"subject\":\"college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}