{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d58da2e8-1f39-51f0-a633-b1c7ccb1783c","task_key":"default--test--2607","task_revision_id":"1","upstream_id":"2607","short_description":"Describe the three basic methods of measuring and analyzing thresholds.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Method of Levels, Method of Average Error, Method of Standard Deviation', 'Method of Constant Stimuli, Method of Right and Wrong Cases, Variability method', 'Method of Approximation, Method of Differential Error, Method of Least Squares', 'Method of Limits, Method of Comparative Error, Method of Estimation', 'Method of Limits, Method of Median Error, Frequency method', 'Method of Limits, Method of Constant Errors, Sequential method', 'Method of Adjustments, Method of Minimum Error, Probability method', 'Method of Approximation, Method of Comparison, Frequency method', 'Method of Limits, Method of Average Error, Frequency method', 'Method of Limits, Method of Average Error, Method of Maximum Likelihood']\",\"question\":\"Describe the three basic methods of measuring and analyzing thresholds.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}