{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f01111f6-94dd-5dba-82a4-77b326996d22","task_key":"ARC~2dEasy--test--MCAS~5f2004~5f8~5f20","task_revision_id":"1","upstream_id":"MCAS_2004_8_20","short_description":"A class conducts an experiment to determine the best color to paint a solar…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['black', 'green', 'red', 'white']\",\"question\":\"A class conducts an experiment to determine the best color to paint a solar water heater that they plan to build. For their experimental test, the students have four identical cans. They paint one black, one green, one red, and one white. Each can is filled with 500 mL of 22°C water, and is allowed to sit in the sun for two hours. Which color can will have the greatest increase in water temperature?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}