{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7cc6005a-0058-591e-9e96-e3e665bd1403","task_key":"all--test--7cc6005a-0058-591e-9e96-e3e665bd1403","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['Seizing all peasants busy cultivating their fields', 'With orders to attack places without defenses', 'Four hundred slaves, of whom three hundred were women', 'All of you [soldiers], are summoned . . . to hunt the idolatrous Koholanes']\",\"question\":\"This question refers to the following information.\\nQuestions to the passage below, an account given to a French officer in Algeria in the 1830s by a member of an Arab slave trade caravan.\\nThe Slave Trade\\nAll of you [soldiers], are summoned . . . to hunt the idolatrous Koholanes [a pejorative word for \\\"black Africans\\\"]. . . . The soldiery divided themselves into two companies . . . with orders to attack places without defenses and to carry off the inhabitants as well as seizing all peasants busy cultivating their fields. . . . Whilst waiting for the return of the companies despatched to hunt Negroes, we went every day to the slave market where we bought at the following prices:\\nA Negro with beard………………10 or 15,000 cowries.\\nThey are not considered as merchandise since one has little chance of preventing them from escaping.\\nAn adult Negress………………..10 or 15,000 cowries for the same reasons\\nAn adolescent Negro………………….30,000 cowries\\nA young Negress ……………………50–60,000 cowries\\nThe price varies according to whether she is more or less beautiful.\\nA male Negro child……………………..45,000 cowries\\nA female Negro child ……………………….35–40,000 cowries\\nFinally, our caravan which had set out from Algeria with sixty-four camels and only sixteen persons, was now augmented by four hundred slaves, of whom three hundred were women. . . . It was at this point that suddenly a confused noise of cries and sobs passed from one group of slaves to another and reached our own. . . . Some rolled on the ground, clung to bushes and absolutely refused to walk. . . . They could only be got up with mighty lashes of the whip and by rendering them completely bloody.\\nWhich statement best supports the argument that religion played a role in the Arab slave trade?\",\"subject\":\"high_school_world_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}