{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1b55ed1b-97a4-5e43-99d6-104582a70949","task_key":"ARC~2dEasy--test--Mercury~5f7166145","task_revision_id":"1","upstream_id":"Mercury_7166145","short_description":"The circulatory system and the endocrine system work together in the human body.…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['taking in oxygen and transporting it to cells of the body', 'releasing hormones and transporting them to cells of the body', 'absorbing nutrients from food and transporting them to cells in the body', 'collecting waste products from the cells and transporting it out of the body']\",\"question\":\"The circulatory system and the endocrine system work together in the human body. Which describes one way in which these systems interact?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}