{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"438e5084-aec7-5264-b8bb-40926ca1eaa2","task_key":"default--test--2112","task_revision_id":"1","upstream_id":"2112","short_description":"Describe some methods of arousal measurement.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Arousal can be measured using thermal imaging', 'Arousal can be measured using a vision acuity test', 'Arousal can be measured using saliva acidity', 'Arousal can be measured using a taste test', 'Arousal can be measured using an electroencephalogram (EEG), heart rate, breathing rate, blood pressure, skin conductance, and pupil size.', 'Arousal can be measured using an MRI', 'Arousal can be measured using a blood sugar test', 'Arousal can be measured using a muscle strength test', 'Arousal can be measured using a stethoscope', 'Arousal can be measured using hair analysis']\",\"question\":\"Describe some methods of arousal measurement.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}