{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"519f34be-325b-5a91-9141-bc02e2cf92b7","task_key":"all--test--519f34be-325b-5a91-9141-bc02e2cf92b7","task_revision_id":"1","upstream_id":"","short_description":"Nitrogen's electronegativity value is between those of phosphorus and oxygen.…","config":"all","split":"test","body":"{\"choices\":\"['The value for nitrogen is less than that of phosphorus because nitrogen is larger, but greater than that of oxygen because nitrogen has a greater effective nuclear charge.', 'The value for nitrogen is less than that of phosphorus because nitrogen has fewer protons but greater than that of oxygen because nitrogen has less valence electrons.', 'The value for nitrogen is greater than that of phosphorus because nitrogen has less electrons, but less than that of oxygen because nitrogen is smaller.', 'The value for nitrogen is greater than that of phosphorus because nitrogen is smaller, but less than that of oxygen because nitrogen has a smaller effective nuclear charge.']\",\"question\":\"Nitrogen's electronegativity value is between those of phosphorus and oxygen. Which of the following correctly describes the relationship between the three values?\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}