{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d64afa9-1877-5474-bcce-082e5286c404","task_key":"default--test--2548","task_revision_id":"1","upstream_id":"2548","short_description":"What makes a piece of material to be learnedmeaningful, andhow does its…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Meaningfulness is determined solely by the difficulty of the material, not by associations', 'The rate of learning is unaffected by the meaningfulness of the material', 'Learning is easier when the material is unfamiliar', 'Learning is facilitated when the material is abstract and theoretical with no practical applications', 'The more sensory modalities involved in presenting the material, the less meaningful it becomes', \\\"Learning is more effective when the material has no relevance to the learner's prior knowledge or experiences\\\", 'The more meaningful something is, the easier it is to learn and retain it. Meaningfulness is measured by the number of associations they evoked.', 'Learning is faster when there are fewer associations', 'The more complex the material, the easier it is to learn', 'Material is considered meaningful if it is presented in a larger volume, regardless of associations']\",\"question\":\"What makes a piece of material to be learnedmeaningful, andhow does its meaningfulness affect the rate of learning?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}