{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1bedf53-a0e8-5789-be06-02923dba6ce1","task_key":"ARC~2dEasy--test--AIMS~5f2008~5f8~5f12","task_revision_id":"1","upstream_id":"AIMS_2008_8_12","short_description":"James placed a breath mint and a lump of toothpaste in a cup of water and let it…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The breath mint was less soluble than the toothpaste.', 'The breath mint was more soluble than the toothpaste.', 'The breath mint had a lower density than the toothpaste.', 'The breath mint had a greater density than the toothpaste.']\",\"question\":\"James placed a breath mint and a lump of toothpaste in a cup of water and let it sit overnight. Which statement best explains why the breath mint was gone the following morning, but the toothpaste was still at the bottom of the cup?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}