{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c08293e8-b11d-5bda-b67f-8c6136f156a1","task_key":"all--test--c08293e8-b11d-5bda-b67f-8c6136f156a1","task_revision_id":"1","upstream_id":"","short_description":"Vygotsky’s sociocultural development theory attempts to describe the interaction…","config":"all","split":"test","body":"{\"choices\":\"['A baseball player hits baseballs from a tee in order to build muscle memory.', 'A concert flute player falls short of finishing a piece that has a very complex ending without mistakes', 'A high school English student submits a paper for review by his professor.', 'A high diver takes instruction from her coach to improve her form on a specific move.']\",\"question\":\"Vygotsky’s sociocultural development theory attempts to describe the interaction between the mental function children are born with and how they develop those into what they possess as adults. One of the important components of this is the zone of proximal development. Which of the following statements accurately describes an individual in the zone of proximal development?\",\"subject\":\"college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}