{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb90c4c7-0dd2-52da-bfc4-0e572c9503ca","task_key":"default--test--2329","task_revision_id":"1","upstream_id":"2329","short_description":"Trend analysis is a type of analysis of variance that is used when:","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['a sequential research design has been used.', 'a factorial research design has been used.', 'a study’s independent variable is quantitative.', 'a cross-sectional research design has been used.', 'a longitudinal research design has been used.', 'a mixed methods research design has been used.', 'a study’s dependent variable is quantitative.', 'a study’s dependent variable is qualitative.', 'a correlational research design has been used.', 'a study’s independent variable is qualitative.']\",\"question\":\"Trend analysis is a type of analysis of variance that is used when:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}