Discussion
0 posts
No posts in this thread yet.
benchmarks.wiki / Public workspace
ARC-Easy
Reasoning / Science
ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.
arc-easy
Full text: eligible public problems include text, images and discussion.
At a glance
What a problem looks like
A science question with three to five options, from the subset the simple baselines answered correctly. The options are imported as a list; the answer key is not.
How it is scored
The source ships an answer key with every problem; this catalogue keeps it in restricted storage and never renders it.
Why it is hard
Being the complement of the Challenge set means the questions reward direct knowledge recall; a model that still misses them has a gap in basic science facts rather than in multi-step reasoning.
Reference links
Cite
@article{clark2018arcchallenge,
title={Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge},
author={Peter Clark and Isaac Cowhey and Oren Etzioni and Tushar Khot and Ashish Sabharwal and Carissa Schoenick and Oyvind Tafjord},
journal={arXiv preprint arXiv:1803.05457},
year={2018}
}Discussion
1 thread and 0 posts on this page. Anyone may reply; no account is required.
Contribute
Share a reproduction, report an evaluation issue, or suggest a correction to this benchmark overview.
Tasks
Whole public benchmark.
- Public problems
- 2,376
- Formats
- text (2,376)
- Problems with images
- 0
- Answer availability
- Answer published by the source (2,376)
- Configs
- ARC-Easy (2,376)
- Splits
- test (2,376)
- Awaiting a first discussion
- 2,376
- Problems with a discussion
- 0
- Public contributions
- 0
Provenance and terms
Pinned source revisions, newest first:
210d026faf9955653af8916fad021475a3f00453· acquired 2026-09-23 · releasee20f8b35e6fd
- If a species of bird stopped reproducing, which of these would happen?
Answer published by the source
- In which situation would osmosis most likely occur in cells?
Answer published by the source
- An animal that has thick fur, webbed feet, and blubber would probably live in…
Answer published by the source
- On a day in early spring, the number of hours of daylight and of night are about…
Answer published by the source
- Clouds are formed from tiny drops of water that are light enough to float in the…
Answer published by the source
- Carbon dioxide produced by cells is removed from the body primarily by which…
Answer published by the source
- During which time of day are the highest temperatures most often recorded?
Answer published by the source
- The first person to introduce the idea of the continents moving around the…
Answer published by the source
- The smallest particle of matter that can be identified as an element is called
Answer published by the source
- In a classroom demonstration, a teacher pours sulfuric acid on some granulated…
Answer published by the source
- A student finds a bottle that is labeled with a long chemical name. What is the…
Answer published by the source
- In the Four Corners area in the US Southwest, there are large rocky outcroppings…
Answer published by the source
- All of the following are renewable resources except
Answer published by the source
- A 20-N force acts on a 5-kg object at rest. How fast will the object accelerate…
Answer published by the source
- A bird eats a brightly-colored insect that tastes bad. The bird avoids preying…
Answer published by the source
- A dog rolls over and receives a treat. The dog rolls over again. This is an…
Answer published by the source
- From simplest to most complicated, how are multicellular organisms organized?
Answer published by the source
- In which organism can cell walls be found?
Answer published by the source
- Which surgery is most like the way a transgenic organism is made?
Answer published by the source
- Scientists think that the rise in global temperature during the last one hundred…
Answer published by the source
- Scientists have shown that clearing the forest in the Amazon for farming is…
Answer published by the source
- Which is the Sun most likely to become toward the end of its lifetime?
Answer published by the source
- Which property of a mineral is most likely being tested when it is scratched…
Answer published by the source
- Which section of Earth is composed primarily of liquid metal?
Answer published by the source
- Which concept was most likely modified due to the invention of the microscope?
Answer published by the source
- Which process causes water to move from the ocean to the atmosphere during the…
Answer published by the source
- After a volcanic eruption, it takes a long time for large ecosystems to fully…
Answer published by the source
- A change in the position of an object as time changes best describes
Answer published by the source
- Daphnee is going to build a model of the solar system for her science project.…
Answer published by the source
- The house cat was believed to be tamed in ancient Egypt. In 2004, the remains of…
Answer published by the source
- The climate of an area would be expected to have the least fluctuations in…
Answer published by the source
- Which of the following is an abiotic factor in a river ecosystem?
Answer published by the source
- Which information will best help scientists determine if an object is a comet,…
Answer published by the source
- Sofia put a bat house in a tree in her yard. The bats ate mosquitos in Sofia's…
Answer published by the source
- A geologist found several types of seashell fossils in a rock layer. Which is…
Answer published by the source
- Which trait gives owls an advantage when hunting at night?
Answer published by the source
- A model of the Moon would be different from a model of Earth in that the Moon…
Answer published by the source
- The egg stage in the life cycle of a bird is most like which phase in the life…
Answer published by the source
- The formation of the Grand Canyon has most likely taken how long?
Answer published by the source
- Which safety measure should a student take when handling a microscope?
Answer published by the source
- Which is a characteristic Earth and the Moon have in common?
Answer published by the source
- Which statement describes the formation of a delta?
Answer published by the source
- Jesus learned that a space probe named Voyager 1 was launched from Earth in…
Answer published by the source
- Ernie made a diagram to model Earth's orbit. What shape is most like what Ernie…
Answer published by the source
- How do plants get water and minerals?
Answer published by the source
- Which of the following is an inherited human trait?
Answer published by the source
- Trees start as seeds and grow into mature trees that produce more seeds. This…
Answer published by the source
- In living organisms, the level of organization from least complex to most…
Answer published by the source
- Twins are born. One is a boy and one is a girl. Which statement is correct about…
Answer published by the source
- In winter, the arctic fox has white fur. In summer, its fur changes color to…
Answer published by the source