{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"405fd0cb-47f1-5cc1-bded-ca7415bc94f5","task_key":"all--test--405fd0cb-47f1-5cc1-bded-ca7415bc94f5","task_revision_id":"1","upstream_id":"","short_description":"If an estimator is said to be consistent, it is implied that","config":"all","split":"test","body":"{\"choices\":\"['On average, the estimated coefficient values will equal the true values', 'The OLS estimator is unbiased and no other unbiased estimator has a smaller variance', 'The estimates will converge upon the true values as the sample size increases', 'The coefficient estimates will be as close to their true values as possible for small and large samples.']\",\"question\":\"If an estimator is said to be consistent, it is implied that\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}