{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a601c1a-c09f-5f22-80e5-0e27ab095d4c","task_key":"default--test--2365","task_revision_id":"1","upstream_id":"2365","short_description":"What part do \"heuristics\" play in the processing of sensory information?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Heuristics are tools for enhancing sensory acuity', 'Heuristics are memory storage systems', 'Heuristics are neurological pathways for sensory processing', 'Heuristics are sensory output systems for motor responses', 'Heuristics are the primary means of sensory data storage', 'Heuristics are methods for sensory data encryption', 'Heuristics are cognitive biases', 'Heuristics are algorithms for sensory signal amplification', 'Heuristics are sensory receptors', 'Heuristics are ways of making complex judgments of situations through the use of reality-simplifying devices.']\",\"question\":\"What part do \\\"heuristics\\\" play in the processing of sensory information?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}