{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3b9cf3b-b731-5698-bc72-994a5a023e0b","task_key":"default--test--3072","task_revision_id":"1","upstream_id":"3072","short_description":"How can crosses involving strains of highly inbred mice be used to determine a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Transplant rejection is determined by the size difference between donor and recipient.', 'Transplant acceptance is solely based on the health of the recipient.', 'Transplant rejection (or acceptance) has a genetic basis.', 'Transplant success is solely determined by environmental factors.', 'Transplant outcomes can be predicted by the coat color of the mice.', 'Transplant compatibility is dependent on the age of the mice.', \\\"Transplant incompatibility is determined by the donor's blood type.\\\", 'Transplant incompatibility is due to behavioral traits of the recipient.', 'Transplant acceptance is related to the duration of the daylight exposure of the mice.', 'Transplant rejection is not related to genetics.']\",\"question\":\"How can crosses involving strains of highly inbred mice be used to determine a genetic basis for transplant incompatibility?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}