{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c72c04e-9663-502b-8bea-3ca20a7c0e64","task_key":"default--test--2495","task_revision_id":"1","upstream_id":"2495","short_description":"Discuss the segmentation problem in speech recognition as itcontributes to the…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The segmentation problem arises when the speech recognition system cannot cope with homophones, words that sound the same but have different meanings.', 'The segmentation problem is the result of a lack of sufficient training data for the speech recognition system to learn from.', 'The segmentation problem is due to the speed of speech.', 'The segmentation problem in speech recognition is that there is no apparent break in the spoken waveform at the beginnings and endings of words, the distinction we hear is a result of neural analysis done by a pattern recognition system.', \\\"The segmentation problem occurs because the speech recognition system cannot handle the variations in pitch and tone of the speaker's voice.\\\", \\\"The segmentation problem is the result of the speaker's accent.\\\", 'The segmentation problem is the inability of the speech recognition system to differentiate between different languages.', 'The segmentation problem is caused by the volume of speech.', \\\"The segmentation problem is attributed to the speech recognition system's inability to process multiple speakers simultaneously.\\\", \\\"The segmentation problem is due to background noise interfering with the speech recognition system's ability to accurately process spoken words.\\\"]\",\"question\":\"Discuss the segmentation problem in speech recognition as itcontributes to the pattern recognition theory of human perception.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}