{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e96e052-c644-5337-9bcf-5f73a6f15c04","task_key":"default--test--2304","task_revision_id":"1","upstream_id":"2304","short_description":"Performance = Expectation × Value is the symbolic representation of which…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Jean Piaget and Cognitive Development Theory', 'Abraham Maslow and Hierarchy of Needs', 'Edward Tolman and Expectancy-Value Theory', 'Ivan Pavlov and Classical Conditioning', 'Carl Rogers and Humanistic Theory', 'Clark Hull and Reinforcement Theory', 'Albert Bandura and Social Learning Theory', 'John Watson and Behaviorism', 'B.F. Skinner and Operant Conditioning', 'Sigmund Freud and Psychoanalytic Theory']\",\"question\":\"Performance = Expectation × Value is the symbolic representation of which theorist and what school of thought ? Discuss.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}