{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"029560f5-dbbe-5c21-bb3e-059c7e4263c3","task_key":"all--test--029560f5-dbbe-5c21-bb3e-059c7e4263c3","task_revision_id":"1","upstream_id":"","short_description":"A husband and wife owned and operated a grocery store. The grocery store was…","config":"all","split":"test","body":"{\"choices\":\"['Larceny.', 'Burglary.', 'Larceny and attempted burglary.', 'Larceny and burglary.']\",\"question\":\"A husband and wife owned and operated a grocery store. The grocery store was situated in the first floor of the building in which the husband and wife occupied a second-floor apartment. Late one evening, the defendant was walking past the grocery store when he decided to steal the money he heard had been stashed in a cigar box inside the store. The defendant furtively walked to the rear of the building. He then proceeded to open the gate to the fenced-in back yard. Once inside the back yard, the defendant attempted to pry open the back window of the grocery store. Awakened by the barking of his watchdog, the husband went out onto his second- floor back porch and saw the defendant below. The husband yelled at the defendant. Startled, the defendant turned to run when he noticed a large package lying outside the rear door to the store. The defendant picked up the package, which contained baked bread that had been delivered earlier in the evening, and the defendant then ran off. Which of the following crimes will the defendant most likely be convicted of?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}