{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b92fbd65-a5bc-55d9-af46-cf038041efde","task_key":"ARC~2dEasy--test--Mercury~5f7161403","task_revision_id":"1","upstream_id":"Mercury_7161403","short_description":"Aerogels are compounds formed by the drying of certain gels. Although the…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['very low density', 'high electrical conductivity', 'very low melting point', 'very flexible']\",\"question\":\"Aerogels are compounds formed by the drying of certain gels. Although the aerogel hardens into a solid material, the particles in the gel are much farther apart than those of most solids and particles are held together by strong bridges of covalently bonded atoms. Which of the following is a likely property of aerogels?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}