{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ece4037-1fa2-5f2e-aa49-31b88eac0219","task_key":"all--test--4ece4037-1fa2-5f2e-aa49-31b88eac0219","task_revision_id":"1","upstream_id":"","short_description":"The STATISTICS are a method of measuring variables and organizing and analyzing…","config":"all","split":"test","body":"{\"choices\":\"['Ratio Data is scaled and at equal distances but no absolute zero', 'Ratio Data orders the amount of variable, but no info about how much', 'Ratio Data is an interval data with an absolute zero', 'Ratio Data divides variables into unordered categories']\",\"question\":\"The STATISTICS are a method of measuring variables and organizing and analyzing data statistical method can be descriptive or inferential and have a scale of measurement. From your knowledge about statistics measurement, what is the RATIO DATA?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}