{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27c75429-039f-5823-a2b5-063ae7ac5839","task_key":"default--test--2749","task_revision_id":"1","upstream_id":"2749","short_description":"What does research suggest is the major result of breastfeeding an infant?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Stronger infant immunity solely based on the duration of breastfeeding', 'specific method used in feeding', 'the attitude the parents have towards the child during feeding time', 'Predictable sleep patterns established immediately through breastfeeding', 'Enhanced cognitive development exclusively due to nutrient composition', 'oral stimulation and eating', 'Long-term taste preferences determined by breast milk flavor variety', 'Development of a more diverse palate by the age of one', 'intimate contact with the mother', 'Increased physical growth rate compared to formula-fed infants']\",\"question\":\"What does research suggest is the major result of breastfeeding an infant?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}