{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09ee40e4-c724-5ef3-bdfc-7426c6d850f2","task_key":"default--test--2680","task_revision_id":"1","upstream_id":"2680","short_description":"Discuss echoic memory. How does its nature differ from that of a tape recorder?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Echoic memory is a long-term storage system that archives auditory information in the same format as it was received.', 'Echoic memory works just like a tape recorder.', 'Echoic memory is a form of memory that captures tactile sensations and stores them for a brief period.', 'Echoic memory can store unlimited amounts of auditory information indefinitely, similar to a tape recorder.', 'Echoic memory is the medium for the temporary storage of auditory information, with its duration ranging from one to ten seconds. It differs from a tape recorder in that the information stored has been transformed by the mechanisms of the cochlea and perhaps by other processes by the time the storage stage is reached.', 'Echoic memory stores visual information.', 'Echoic memory compresses auditory information, storing it more efficiently than a tape recorder but for a limited duration.', 'Echoic memory retains information for exactly 30 seconds, which is longer than a tape recorder.', 'Echoic memory has a fixed duration of 5 seconds.', \\\"Echoic memory has a variable duration that depends on the listener's attention span, unlike a tape recorder's consistent playback length.\\\"]\",\"question\":\"Discuss echoic memory. How does its nature differ from that of a tape recorder?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}