{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9624da39-9524-58c4-a6ae-a0721ad32018","task_key":"default--test--5675","task_revision_id":"1","upstream_id":"5675","short_description":"Hormones are secreted:","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['into the tissues surrounding the glands where they were manufactured', 'into the stomach and then are digested and travel throughout the body', 'into the brain for processing before being distributed', 'into the ovaries and testes', 'into the hair follicles and travel along the hair shafts', 'into the skin and absorbed through the pores', 'into the air and inhaled by the individual', 'directly into the bloodstream', 'into the saliva and are swallowed and digested', 'into the lymphatic system']\",\"question\":\"Hormones are secreted:\",\"src\":\"ori_mmlu-human_sexuality\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}