{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"730ed1be-d750-510a-bda1-0e6b4a7580c9","task_key":"default--test--3197","task_revision_id":"1","upstream_id":"3197","short_description":"What roles does glucose play in cellmetabolism ?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Glucose is the primary source of energy for all cells, can be converted to glycogen and stored, and can be converted into fat for storage.', 'Glucose can only be converted into fat', 'Glucose is exclusively used in the synthesis of amino acids', 'Glucose can be stored only in the form of starch in human cells', 'Glucose is only used for energy production', 'Glucose can be directly converted into protein', 'Glucose cannot be stored in any form', 'Glucose is used to produce nucleic acids exclusively', 'Glucose is only used as a structural component in cells', 'Glucose is not involved in cell metabolism but is only a dietary fiber']\",\"question\":\"What roles does glucose play in cellmetabolism ?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}