{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"76382b5a-8c17-5cdb-969a-1181d2d1f893","task_key":"ARC~2dEasy--test--NCEOGA~5f2013~5f5~5f27","task_revision_id":"1","upstream_id":"NCEOGA_2013_5_27","short_description":"People sitting around a campfire are able to feel the heat from the fire. How…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The heat from the fire travels through the ground and heats the ground around the people.', 'The heat from the fire is conducted through air molecules to the people.', 'The heat from the fire rises in the air and then settles around the people.', 'The heat from the fire radiates from the fire to the people.']\",\"question\":\"People sitting around a campfire are able to feel the heat from the fire. How are the people able to feel the heat from the fire without touching the fire?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}