{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de37153b-f4cc-53f1-a44a-1137ac100cfd","task_key":"default--test--3303","task_revision_id":"1","upstream_id":"3303","short_description":"What is dormancy? What factors play a role in the termi-nation of dormancy and…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Dormancy is a process that seeds undergo to enhance their flavor for consumption', 'Germination occurs spontaneously, regardless of dormancy or environmental factors', 'Dormancy is a state of active growth', 'Dormancy can only be terminated by prolonged exposure to light; temperature and moisture have no effect', 'Seeds remain dormant until they are submerged in water, which is the only requirement for terminating dormancy and initiating germination', 'The termination of dormancy is solely dependent on the seed reaching a certain age, irrespective of environmental conditions', 'Dormancy is terminated exclusively by mechanical scarification, without the influence of any environmental cues', 'Dormancy is terminated by the onset of colder temperatures', 'The germination of a seed is a simple process triggered by a single environmental cue', 'Dormancy is a special condition of rest which enables an embryo to survive long periods of un-favorable environmental conditions. The termination of dormancy and the germination of a seed require very precise combinations of environmental cues.']\",\"question\":\"What is dormancy? What factors play a role in the termi-nation of dormancy and the germination of a seed?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}