{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6204ed29-6920-5592-aaea-618e6fbaada4","task_key":"ARC~2dEasy--test--Mercury~5f7198188","task_revision_id":"1","upstream_id":"Mercury_7198188","short_description":"As global temperatures increase, certain organisms will be more affected than…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['birds that eat fish from shallow waters', 'fish that live in coral reefs in shallow waters', 'mammals that swim in cold, deep ocean waters', 'crustaceans at the bottom of deep sea ocean waters']\",\"question\":\"As global temperatures increase, certain organisms will be more affected than others. The changes associated with global warming may result in an increase in sea level. Which organisms will be affected most as a result of the change in sea level?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}