{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04486719-d26c-5e99-93eb-f12f0f3204ab","task_key":"ARC~2dEasy--test--Mercury~5f7284095","task_revision_id":"1","upstream_id":"Mercury_7284095","short_description":"Sofia put a bat house in a tree in her yard. The bats ate mosquitos in Sofia's…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The relationship is competitive.', 'The relationship is cooperative.', 'The relationship is parasitic.', 'The relationship is predatory.']\",\"question\":\"Sofia put a bat house in a tree in her yard. The bats ate mosquitos in Sofia's yard at night and roosted in the house during the day. Droppings from the bat house nourished the tree. What kind of relationship exists between Sofia, the bats, and the tree?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}