{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9e31e486-d86b-5a05-ace8-abe9fbbdb564","task_key":"all--test--9e31e486-d86b-5a05-ace8-abe9fbbdb564","task_revision_id":"1","upstream_id":"","short_description":"An owner of a storage facility stores flammable gases under high pressure in…","config":"all","split":"test","body":"{\"choices\":\"['The photographer was not shown to be an expert or professional photographer.', 'There was an unaccountable break in the chain of custody from the time when the photographs were taken to the period when the negatives were processed.', 'There was no testimony that the photographs accurately portrayed the ruptured tank.', 'The photographs are not the best evidence to prove how the tank ruptured.']\",\"question\":\"An owner of a storage facility stores flammable gases under high pressure in large spherical tanks. The facility was constructed for the owner by a company that specializes in the construction of such facilities. After the facility had been in use for three months, one of the tanks ruptured, causing a spillage and loss of the chemicals. The owner sued the company for strict liability, claiming that the storage tank had been defectively manufactured. At trial, the owner called a photographer who testified she was hired by the owner to photograph the ruptured tank after the accident. She further testified that the roll of film was sent to a commercial film lab where the photographs were developed. Thereupon, the owner's attorney showed the photographer the photographs, which she identified as the ones she had taken and given to the Owner. The owner's attorney offers 10 photographs into evidence. Upon objection by the company's counsel, which of the following, if true, is the best reason to exclude the photographs from evidence?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}