{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2cc675a-5bc6-56ae-ab2f-78be013aadcc","task_key":"all--test--d2cc675a-5bc6-56ae-ab2f-78be013aadcc","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is not true with regard to contingency tables for…","config":"all","split":"test","body":"{\"choices\":\"['The categories are not numerical for either variable.', 'Observed frequencies should be whole numbers.', 'Expected frequencies should be whole numbers.', 'Expected frequencies in each cell should be at least 5, and to achieve this, one sometimes combines categories for one or the other or both of the variables.']\",\"question\":\"Which of the following is not true with regard to contingency tables for chi-square tests for independence?\",\"subject\":\"high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}