{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"053aeec9-d099-5729-9a1e-ab1ccb193dd7","task_key":"default--test--3481","task_revision_id":"1","upstream_id":"3481","short_description":"Using conditioning, how can one determine the sensitivity of a dog's hearing to…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"By checking the dog's ear structure\\\", \\\"By observing the dog's natural behavior\\\", \\\"By using operant conditioning and observing the dog's response to different sound frequencies\\\", 'By training the dog to bark at certain frequencies', \\\"By analyzing the dog's brain waves while exposed to different frequencies\\\", 'By using a series of whistles with varying frequencies and observing the point of inaudibility', \\\"By measuring the dog's heart rate response to different sound frequencies\\\", 'By using classical conditioning and pairing sounds with a visual stimulus', 'By using a hearing test device']\",\"question\":\"Using conditioning, how can one determine the sensitivity of a dog's hearing to sounds of different frequencies?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}