{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"241df8d1-8ee8-55f0-9967-93ffa796aed2","task_key":"ARC~2dEasy--test--AIMS~5f2009~5f8~5f26","task_revision_id":"1","upstream_id":"AIMS_2009_8_26","short_description":"Read the information about Alice's science project then answer the question.…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['Earthworms like the taste of dirt better than sand.', 'Earthworms are happier in black dirt than red dirt.', 'Earthworms exist to decompose decaying materials.', 'Earthworms will move away from direct light sources.']\",\"question\":\"Read the information about Alice's science project then answer the question. Alice needed to design a science project. She decided that she wanted to focus her project on how an earthworm's behavior helps it survive. Alice wrote down four ideas about earthworm behavior that she wanted to test. Which idea can be tested experimentally?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}