{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"117fd111-d592-5851-a5aa-f328853d4300","task_key":"ARC~2dEasy--test--Mercury~5f7141733","task_revision_id":"1","upstream_id":"Mercury_7141733","short_description":"A carpenter rubs sandpaper on a wooden bench to make the bench smoother. The…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['chemical energy that is stored by the sandpaper.', 'radiant energy that is transferred to the bench.', 'potential energy that is stored by the wood.', 'heat energy that is transferred to the air.']\",\"question\":\"A carpenter rubs sandpaper on a wooden bench to make the bench smoother. The sandpaper will get warm as it is rubbed on the bench. As a result of the friction between the sandpaper and the bench, thermal energy is converted to\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}