{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69acfff1-df4e-5ed1-9641-b0bc6065f888","task_key":"all--test--69acfff1-df4e-5ed1-9641-b0bc6065f888","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements about amino acid scoring for predicting…","config":"all","split":"test","body":"{\"choices\":\"['The amino acid score is calculated by comparing the amino acid pattern of the protein to that of egg protein.', 'The amino acid score is calculated by comparing the amino acid pattern of the protein to that of milk protein.', 'A single reference pattern is used to calculate the amino acid score for all ages', 'Different amino acid scoring patterns are used for different age groups.']\",\"question\":\"Which of the following statements about amino acid scoring for predicting protein quality in human nutrition is correct?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}