{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f1e6601-6f3e-5380-9e1a-87dd12041025","task_key":"all--test--2f1e6601-6f3e-5380-9e1a-87dd12041025","task_revision_id":"1","upstream_id":"","short_description":"Which one of the following is a disadvantage of the general to specific or \"LSE\"…","config":"all","split":"test","body":"{\"choices\":\"['Some variables may be excluded at the first stage leading to coefficient biases', 'The final model may lack theoretical interpretation', 'The final model may be statistically inadequate', 'If the initial model is mis-specified, all subsequent steps will be invalid.']\",\"question\":\"Which one of the following is a disadvantage of the general to specific or \\\"LSE\\\" (\\\"Hendry\\\") approach to building econometric models, relative to the specific to general approach?\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}