{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b7618bd-8f45-5d87-8552-eba78dd5e7b7","task_key":"default--test--6261","task_revision_id":"1","upstream_id":"6261","short_description":"Which of the following statements is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Mycotoxins contaminate foods containing bacteria formed during storage under moist conditions', 'Mycotoxins are formed by plants as a defense mechanism during storage under high-light conditions', 'Mycotoxins contaminate foods containing algae formed during storage under wet conditions', 'Mycotoxins contaminate foods containing fungi formed during storage under moist conditions', 'Mycotoxins are beneficial nutrients that enhance food quality during storage', 'Mycotoxins contaminate foods containing viruses formed during storage at freezing temperatures', 'Mycotoxins are created by chemical reactions in foods stored under high-pressure conditions', 'Mycotoxins contaminate foods containing bacteria formed during storage under dry conditions', 'Mycotoxins contaminate foods containing yeasts formed during storage in airtight conditions', 'Mycotoxins contaminate foods containing fungi formed during storage under dry conditions']\",\"question\":\"Which of the following statements is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}