{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42c1c190-1ad2-51d8-9eda-f68cf4350468","task_key":"ARC~2dEasy--test--NCEOGA~5f2013~5f5~5f39","task_revision_id":"1","upstream_id":"NCEOGA_2013_5_39","short_description":"A litter of kittens have traits that are similar to both the mother cat and the…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The kittens are provided the same kind of milk from their mother as they grow.', 'The kittens inherit some of their traits from their mother and some from their father.', 'The kittens are kept at the same temperatures by their mother when they are first born.', 'The kittens are taught by their parents to have similar traits.']\",\"question\":\"A litter of kittens have traits that are similar to both the mother cat and the father cat. Which best explains this situation?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}