{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0858493b-9a4d-53f2-8ede-7c543ceedf89","task_key":"ARC~2dEasy--test--LEAP~5f2006~5f8~5f10411","task_revision_id":"1","upstream_id":"LEAP_2006_8_10411","short_description":"Raquel fed a litter of five kittens an all-meat diet for two weeks and found…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['tested five kittens on a non-meat diet also', 'weighed the kittens in grams', 'used only one kitten', 'tested dogs as well as cats']\",\"question\":\"Raquel fed a litter of five kittens an all-meat diet for two weeks and found that they gained an average of 15 ounces. She concluded that eating meat is the best way to help kittens grow. What should Raquel have done to make this a better experiment?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}