{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"755a6b0b-dc6c-5fdd-87b7-73942da4c1dc","task_key":"ARC~2dEasy--test--Mercury~5f7236618","task_revision_id":"1","upstream_id":"Mercury_7236618","short_description":"A scientist wants to track contaminant movement in the Gulf Stream. The Gulf…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['linear movement due west', 'linear movement due south', 'clockwise movement', 'counterclockwise movement']\",\"question\":\"A scientist wants to track contaminant movement in the Gulf Stream. The Gulf Stream is a warm water current in the North Atlantic Ocean and is part of the North Atlantic gyre. The gyre is influenced by the Coriolis effect. To follow the contaminant after it exits the Gulf Stream, the scientist needs to know characteristics of the North Atlantic gyre. Which of these best describes a movement of the North Atlantic gyre the scientist needs to know?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}