{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2145e280-e4f9-52ff-af1a-781442149189","task_key":"default--test--3394","task_revision_id":"1","upstream_id":"3394","short_description":"Why do cells containlysosomes?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Lysosomes act as storage units for excess nutrients', 'Lysosomes are used for energy production', 'Lysosomes function in intra cellular digestion', 'Lysosomes synthesize proteins for the cell', 'Lysosomes regulate cell division', \\\"Lysosomes maintain the cell's shape and structure\\\", 'Lysosomes function in inter cellular digestion', 'Lysosomes function in cell-cell communication', 'Lysosomes store genetic information', 'Lysosomes are the site of lipid synthesis']\",\"question\":\"Why do cells containlysosomes?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}