{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"264d0121-5871-5e9d-87a4-a3ac20ee9c4a","task_key":"ARC~2dChallenge--test--Mercury~5f7140333","task_revision_id":"1","upstream_id":"Mercury_7140333","short_description":"Around areas of increased fertilizer runoff, all of the heterotrophs within a…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['More predators were introduced into the lake.', 'Water was depleted of nutrients such as nitrogen.', 'Breeding season for the organisms came to an end.', 'Decomposing algae lowered the amount of dissolved oxygen.']\",\"question\":\"Around areas of increased fertilizer runoff, all of the heterotrophs within a lake food chain may show an increase in numbers. After the initial increase, the populations begin to decline. Which event most likely caused the populations to decline?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}