{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afa2183e-589b-5a57-aa67-a52ab8dde8d2","task_key":"default--test--3403","task_revision_id":"1","upstream_id":"3403","short_description":"The muscle fibers innervated by a motor unit will contract if a stimulus of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Muscle force is graded by the frequency of nerve impulses alone.', 'Muscle force is graded by the weight of the object being lifted.', 'Muscle force is graded by the amount of energy consumed.', 'Muscle force is graded by altering the amount of blood flow to the muscle.', 'Muscle force is graded by the duration of muscle fiber contraction.', 'Muscle force is graded by the size of the muscle.', 'Muscle force is graded by the type of muscle fiber being activated.', 'Muscle force is graded by the number of motor units activated simultaneously.', 'Muscle force can be graded through the process of recruitment and by varying the tension produced by individual fibers.', 'Muscle force is graded by the length of the muscle at the start of contraction.']\",\"question\":\"The muscle fibers innervated by a motor unit will contract if a stimulus of sufficient magnitude is propagated or it will not contract at all. This is known as the all-or- none law. If this is true, how can muscle force be graded? For example, we use the same muscles to lift a one ounce object that we use to lift a 20 lb. object.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}