{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47a00066-f48a-5017-a9b9-7d6f64e9b418","task_key":"all--test--47a00066-f48a-5017-a9b9-7d6f64e9b418","task_revision_id":"1","upstream_id":"","short_description":"The algorithm below is used to simulate the results of flipping a coin 4 times.…","config":"all","split":"test","body":"{\"choices\":\"['coin_f1ip = 1', 'flip_counter = 1', 'flip_counter = 2', 'heads_counter = 2']\",\"question\":\"The algorithm below is used to simulate the results of flipping a coin 4 times. Consider the goal of determining Whether the simulation resulted in an equal number of heads and tails.\\n\\n   Step l : Initialize the variables heads_counter and f1ip_counter to 0.\\n   Step 2 : A variable coin_f1ip is randomly assigned a value of either 0 or l.\\n   If coin_f1ip has the value 0, the coin flip result is heads, so\\n  heads_counter is incremented by 1.\\n   Step 3 : Increment the value of f1ip_counter by l.\\n   Step 4 : Repeat steps 2 and 3 until f1ip_counter equals 4.\\n\\n Following execution of the algorithm, which of the following expressions indicates that the simulation resulted in an equal number of heads and tails?\",\"subject\":\"high_school_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}