{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63a95ca2-8da9-5194-8f57-58988dcc5b62","task_key":"default--test--3135","task_revision_id":"1","upstream_id":"3135","short_description":"In what way does Lamarck's theory of acquired characteristicsnot agree with…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Acquired characteristics are inherited through a blending of parental traits', 'Acquired characteristics are inherited but do not influence evolution', 'Acquired characteristics are inherited randomly, regardless of their use', 'Acquired characteristics cannot be inherited', 'Acquired characteristics are inherited based on use and disuse', 'Acquired characteristics are only inherited if they occur in the germ cells', 'Acquired characteristics are passed on to the next generation through environmental influence', 'Acquired characteristics are always inherited', 'Acquired characteristics do not exist', 'Acquired characteristics can be inherited']\",\"question\":\"In what way does Lamarck's theory of acquired characteristicsnot agree with present evidence?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}