{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"e632e8ac-0880-5692-bdc2-9786243b3500","task_key":"ARC~2dChallenge--test--LEAP~5f2007~5f8~5f10417","task_revision_id":"2","upstream_id":"LEAP_2007_8_10417","short_description":"In pea plants, the trait for round seeds is dominant over the trait for wrinkled…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['They will always produce round seeds.', 'They will only produce wrinkled seeds.', 'Each offspring plant will have some round and some wrinkled seeds.', 'Unless the plant with wrinkled seeds was pure recessive, no prediction can be made.']\",\"question\":\"In pea plants, the trait for round seeds is dominant over the trait for wrinkled seeds. If a pure dominant plant with round seeds is crossed with a plant with wrinkled seeds, what can be predicted about the offspring plants?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}