{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"26e77952-23bd-5dca-8213-3bb42265a42f","task_key":"ARC~2dChallenge--test--Mercury~5f409647","task_revision_id":"2","upstream_id":"Mercury_409647","short_description":"Nutrient-laden waters from heavy rains flow into the Gulf of Mexico. This…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Nitrogen will replace oxygen in the water.', 'The temperature of the water will increase.', 'Wave action will carry away the dead algae.', 'Bottom dwellers will die and fish will swim away.']\",\"question\":\"Nutrient-laden waters from heavy rains flow into the Gulf of Mexico. This produces an algae bloom in the ocean environment. As the algae decays, it uses up large amounts of oxygen along the coastline. Which will most likely happen to the area as a result?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}