{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3af4f142-291c-5417-a467-81f2216432ac","task_key":"ARC~2dEasy--test--Mercury~5f7112805","task_revision_id":"1","upstream_id":"Mercury_7112805","short_description":"The ichthyornis was a type of bird that lived over 65 million years ago. It…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['changes in the environment', 'diseases causing illness', 'changes in the weather', 'predator animals']\",\"question\":\"The ichthyornis was a type of bird that lived over 65 million years ago. It lived near the sea and hunted for fish over the water. Fossils have been found in Kansas, many miles from the present-day ocean. Which cause of extinction is most likely to be found in the fossil record along with ichthyornis fossils?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}