{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7771915-169f-5dc6-a1a3-cbc31a3f15da","task_key":"ARC~2dEasy--test--Mercury~5f7263655","task_revision_id":"1","upstream_id":"Mercury_7263655","short_description":"Scientists studying migrating birds and homing pigeons have discovered that they…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['iron', 'gold', 'mercury', 'aluminum']\",\"question\":\"Scientists studying migrating birds and homing pigeons have discovered that they navigate by monitoring differences in the intensity and inclination of Earth's magnetic field. Special cells in bird beaks can detect these changes as the birds fly over Earth's surface. Which metal did the scientists find in the cells that birds use as a magnetometer?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}