{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b7f3223-a8ec-57a7-b31f-fe96367e1b0e","task_key":"ARC~2dChallenge--test--LEAP~5f2001~5f8~5f10379","task_revision_id":"1","upstream_id":"LEAP_2001_8_10379","short_description":"Jo Anne took a large beaker of clean water and carefully added one drop of blue…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Water molecules hitting the food coloring molecules caused the mixing.', 'Light shining on the surface of the water caused the mixing.', 'A chemical reaction between the water and the food coloring formed a new, light blue compound.', 'The water interacted with the food coloring, causing the blue color to fade.']\",\"question\":\"Jo Anne took a large beaker of clean water and carefully added one drop of blue food coloring to the edge of the water's surface. She did not touch or move the beaker. At first, she saw blue streaks as the food coloring sank into the water, but gradually the color of the entire beaker of water became evenly blue. What caused the blue food coloring to be mixed throughout the water?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}