{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8eb01123-aa2f-5734-8ab1-456d0cd32fd5","task_key":"default--test--3510","task_revision_id":"1","upstream_id":"3510","short_description":"Why is the drop in blood pressure important in retaining fluid within the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The drop in blood pressure causes blood clotting', 'The drop in blood pressure causes an increase in plasma protein concentration', 'The drop in blood pressure stimulates the excretion of fluids by the kidneys', 'The drop in blood pressure causes dehydration', 'The drop in blood pressure triggers the release of antidiuretic hormone', 'The drop in blood pressure decreases the permeability of capillary walls', 'The drop in blood pressure allows reabsorption of the lost fluid', 'The drop in blood pressure increases the heart rate', 'The drop in blood pressure leads to a constriction of the capillaries', 'The drop in blood pressure activates the sympathetic nervous system']\",\"question\":\"Why is the drop in blood pressure important in retaining fluid within the capillaries?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}