{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"34124bc2-d8e6-555a-9d71-d46b3fb17a1c","task_key":"ARC~2dEasy--test--MCAS~5f1998~5f8~5f11","task_revision_id":"1","upstream_id":"MCAS_1998_8_11","short_description":"To study the effect of heat on plant growth, Andy divided ten identical…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The temperature difference between the two groups was not great enough.', 'The amount of light was different for the two groups.', 'One group of seedlings got less water than the other.', 'Nothing is wrong with the experiment.']\",\"question\":\"To study the effect of heat on plant growth, Andy divided ten identical seedlings into groups. She placed one group on a windowsill in the sun and the other group in a dark closet on the cool (north) side of the house. Think about the characteristics of a properly designed scientific experiment. What is wrong with the above experiment?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}