{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb64f3a5-849d-5632-b748-86e7a2742fa4","task_key":"all--test--cb64f3a5-849d-5632-b748-86e7a2742fa4","task_revision_id":"1","upstream_id":"","short_description":"Which of the following are frequently cited criticisms of HM?","config":"all","split":"test","body":"{\"choices\":\"['HM pays insufficient attention to the role of the labourer, instead focusing on the capitalist as the source of power and most important actor. HM can also allude to capitalist power structures, to the detriment of supporting the human security of workers.', 'HM too often accuses capitalism of acting solely in self-serving ways, and explains everything in terms of class struggle, to the detriment of wider analysis. Some versions of HM claim to have uncovered objective laws of history which are widely disputed in their accuracy.', 'HM is inevitably reductionist and oversimplifies the complexities of capitalism, recognising only its negative aspects and harmful effects.', 'All of these options.']\",\"question\":\"Which of the following are frequently cited criticisms of HM?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}