{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"366911c3-e6e7-5fc8-84e1-b6ec5c60c77a","task_key":"default--test--3424","task_revision_id":"1","upstream_id":"3424","short_description":"Using conditioning, how can one determine the sensitivity of a dog's hearing to…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['By using a controlled group of dogs not exposed to the sounds', 'By using sensory deprivation to heighten hearing sensitivity', \\\"By observing the dog's natural behavior in different sound environments\\\", 'By using negative reinforcement only', 'By using operant conditioning', \\\"By measuring the dog's heart rate response to sounds\\\", \\\"By using a placebo sound and measuring the dog's reaction\\\", 'By using classical conditioning', 'By using aversive conditioning techniques', 'By using positive reinforcement only']\",\"question\":\"Using conditioning, how can one determine the sensitivity of a dog's hearing to sounds of different frequencies?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}