{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb3e0818-c83c-5ad1-8d01-d8844bf67b3d","task_key":"all--test--cb3e0818-c83c-5ad1-8d01-d8844bf67b3d","task_revision_id":"1","upstream_id":"","short_description":"Two women decided to steal some clothing from their favorite store. One of the…","config":"all","split":"test","body":"{\"choices\":\"['They committed a larceny by placing the three dresses in the shopping bag.', 'The jurisdiction requires the killing to be independent of the felony.', 'The jurisdiction follows the agency theory of felony murder.', 'The killing, was accidental and unintended.']\",\"question\":\"Two women decided to steal some clothing from their favorite store. One of the women carried a large shopping bag containing a gun into the store. The other woman did not know that her partner had a gun in the shopping bag. After the women placed three dresses into the shopping bag, a clerk became suspicious and approached the women. The women tried to leave the store and, as they did, the clerk grabbed the bag, which fell to the floor. When the bag hit the floor, the gun discharged, killing the clerk. Which of the following would be the women's best defense to the charge of felony murder?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}