{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1942856b-b2a8-556c-9457-036da2bc8806","task_key":"all--test--1942856b-b2a8-556c-9457-036da2bc8806","task_revision_id":"1","upstream_id":"","short_description":"A 10-year-old girl is brought to the office by her mother because her school…","config":"all","split":"test","body":"{\"choices\":\"['It is a disease-causing mutation in the patient and her mother', 'It is a polymorphism', 'It is a sequence variant of unknown significance', 'It will change the folding of the protein']\",\"question\":\"A 10-year-old girl is brought to the office by her mother because her school nurse thinks that she may have Marfan syndrome. She is at the 95th percentile for height and 25th percentile for weight. Physical examination shows a narrow palate with dental crowding, long slender extremities, and joint laxity. Molecular testing for FBN1 shows a single nucleotide difference that does not change the amino acid at that locus. Her mother is 163 cm (5 ft 4 in) tall. There is no clinical evidence of Marfan syndrome in the mother, but she has the same single nucleotide change as the patient. The same nucleotide change is found in 15 of 200 individuals without Marfan syndrome. Which of the following best describes the single nucleotide change in the patient and her mother?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}