{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6f60688-16ca-557d-ad2c-89d7906e57a4","task_key":"default--test--2676","task_revision_id":"1","upstream_id":"2676","short_description":"What are factors which affect concept attainment and how does each affect the…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The factors are the socioeconomic status of the student, the educational policies in place, and the consistency of teaching styles.', 'The factors include the pacing of the curriculum, the extracurricular activities of the student, and peer influence.', 'The factors which affect concept attainment are the dominance of cues in the stimuli, feedback and reinforcement after performance, and the selection and organization of information.', \\\"The factors are the student's genetic predispositions, the color of the classroom walls, and the seating arrangements.\\\"]\",\"question\":\"What are factors which affect concept attainment and how does each affect the learning of concepts?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}