{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa10a6f1-aad5-58ff-a2d7-72929534cdb6","task_key":"all--test--aa10a6f1-aad5-58ff-a2d7-72929534cdb6","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is correct concerning logit and probit models?","config":"all","split":"test","body":"{\"choices\":\"['They use a different method of transforming the model so that the probabilities lie between zero and one', 'The logit model can result in too many observations falling at exactly zero or exactly one', 'For the logit model, the marginal effect of a change in one of the explanatory variables is simply the estimate of the parameter attached to that variable, whereas this is not the case for the probit model', 'The probit model is based on a cumulative logistic function']\",\"question\":\"Which of the following is correct concerning logit and probit models?\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}