{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2040be64-1436-5201-9870-3221995ccb43","task_key":"ARC~2dEasy--test--Mercury~5fSC~5f400702","task_revision_id":"1","upstream_id":"Mercury_SC_400702","short_description":"When a spoon hits a table, it makes a loud sound. When the spoon hits a soft…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The table is more reactive than the cushion.', 'The table vibrates more than the cushion.', 'The table is more insulated than the cushion.', 'The table has more potential energy than the cushion.']\",\"question\":\"When a spoon hits a table, it makes a loud sound. When the spoon hits a soft cushion, it does not make a sound. What is the difference between the table and the cushion that accounts for the sound?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}