{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d3c0ded-aa59-5bcf-9f6d-e5c2f10fd247","task_key":"default--test--2184","task_revision_id":"1","upstream_id":"2184","short_description":"Describe daydreams. How do they differ fromdreams ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Dreams are involuntary visual experiences that happen while sleeping, and daydreams are involuntary as well but occur during wakefulness.', 'Dreams are manifestations of subconscious desires, while daydreams are simply a means of entertainment with no deeper meaning.', 'Daydreams can be remembered in detail, while dreams are quickly forgotten upon waking.', 'Daydreams occur exclusively at night, while dreams can happen at any time.', 'Daydreams are fantasies created during a waking state which are controlled and closely related to reality, while dreams are not under control and the individual does not realize that he is dreaming.', \\\"Dreams are controlled by one's waking consciousness.\\\", 'Daydreams are dreams that occur during sleep.', 'Daydreams and dreams share the same basic characteristics.', 'Daydreams are a type of dream that people have while they are awake and usually involve wish fulfillment.', 'Dreams typically involve realistic scenarios, whereas daydreams are often fantastical and impossible.']\",\"question\":\"Describe daydreams. How do they differ fromdreams ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}