{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"710e5757-9f71-5e44-b5bc-2c0bb7b55e9a","task_key":"ARC~2dEasy--test--Mercury~5f7108238","task_revision_id":"1","upstream_id":"Mercury_7108238","short_description":"In the 18th century, smallpox was a common and deadly disease. A country doctor,…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['vaccination', 'gene therapy', 'chemotherapy', 'genetic engineering']\",\"question\":\"In the 18th century, smallpox was a common and deadly disease. A country doctor, Edward Jenner, observed that patients working with cattle who contracted a mild disease called cowpox, never came down with the more serious smallpox. When Jenner obtained liquid from cowpox sores and injected it into healthy patients, they became immune to smallpox. What term best describes Jenner's treatment for smallpox?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}