{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd328bb5-40bb-519d-bcb1-45f1c5626883","task_key":"ARC~2dEasy--test--MCAS~5f2014~5f8~5f11","task_revision_id":"1","upstream_id":"MCAS_2014_8_11","short_description":"At one station in a production line, a worker must drill a hole in each end of…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['placing the parts on a conveyor belt to keep them moving quickly', 'using a fixture to hold the boards in place as the holes are drilled', 'inspecting the boards after they are attached to each other', 'installing equipment to protect workers from debris']\",\"question\":\"At one station in a production line, a worker must drill a hole in each end of wooden boards. At the next station, another worker attaches two of the boards together using metal fasteners that fit in the holes. Which of the following processes will ensure that the wooden boards fit together with the fewest errors?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}