{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"513e1131-beaa-5e71-9ca3-43bb9112839a","task_key":"ARC~2dEasy--test--MCAS~5f2015~5f8~5f20","task_revision_id":"1","upstream_id":"MCAS_2015_8_20","short_description":"The temperature in a classroom is 15°C (59°F). The teacher turns the thermostat…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['Cold air molecules collide to generate heat energy.', 'Cold energy in the room transforms into heat energy.', 'The room becomes warmer as heat energy is added to the room.', 'The room becomes warmer as cold energy is pushed out of the room.']\",\"question\":\"The temperature in a classroom is 15°C (59°F). The teacher turns the thermostat to 20°C (68°F) and keeps the door closed. Which of the following statements best describes the change that occurs as the temperature in the room increases to 20°C?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}