{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7cfeea0-83a9-5007-b9a0-020d465a8cda","task_key":"default--test--3317","task_revision_id":"1","upstream_id":"3317","short_description":"What roles does glucose play in cellmetabolism ?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Glucose is only used for energy production in cells', 'Glucose is used in cells primarily to form cell wall components', 'Glucose is not used by cells but is instead excreted as waste', 'Glucose is the primary source of energy for all cells, can be converted to glycogen for storage, and can be converted into fat for storage.', 'Glucose is utilized exclusively for the synthesis of amino acids in cells', 'Glucose can only be stored as fat', 'Glucose serves only as a signaling molecule to regulate cellular functions', 'Glucose is only stored as glycogen in cells', 'Glucose is only used to produce nucleic acids in cells', 'Glucose is converted to protein directly within cells']\",\"question\":\"What roles does glucose play in cellmetabolism ?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}