{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72f39207-6883-52b2-bc84-99716792d344","task_key":"default--test--2185","task_revision_id":"1","upstream_id":"2185","short_description":"List and describe the stages of problem solving as proposed by Johnson.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Johnson proposed the stages of conceptualization, experimentation, and reflection for problem solving.', 'Johnson suggested that the stages of problem solving are analysis, implementation, and feedback.', 'The stages of problem solving are production, judgment, and incubation.', 'The three stages of problem solving according to Donald M. Johnson are preparation, production, and judgment.', \\\"Johnson's stages of problem solving include orientation, negotiation, and verification.\\\", 'The stages of problem solving by Johnson are defined as comprehension, application, and consolidation.', \\\"Johnson's model includes the stages of recognition, strategy formulation, and monitoring.\\\", 'According to Johnson, the stages of problem solving are preparation, execution, and evaluation.', 'The problem-solving stages outlined by Johnson are identification, exploration, and resolution.', 'According to Johnson, the stages are framing the problem, finding solutions, and assessing outcomes.']\",\"question\":\"List and describe the stages of problem solving as proposed by Johnson.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}