{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54e0db84-1e5f-5938-ac7c-618edd1e82f1","task_key":"all--test--54e0db84-1e5f-5938-ac7c-618edd1e82f1","task_revision_id":"1","upstream_id":"","short_description":"A company with offices in five different countries is interested in estimating…","config":"all","split":"test","body":"{\"choices\":\"['Stratified sample, because the population is divided into five strata—namely, five offices in five different countries', 'Cluster sample, because the population is divided into five clusters—namely, five offices in five different countries', 'Simple random sample, because this is the simplest sampling method', 'Simple random sample, because this is the only method that gives unbiased results']\",\"question\":\"A company with offices in five different countries is interested in estimating the proportion of its employees in favor of banning smoking on the office premises. It is known that the views of people from different countries on issues like smoking tend to vary due to the influence of different local social structures. Which of the following is an appropriate sampling technique to use in this situation, and why?\",\"subject\":\"high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}