benchmarks.wiki

benchmarks.wiki / Public workspace

BIG-Bench Extra Hard (BBEH) / Here is a sentence with pronoun(s) whose antecedent(s) can either be derived…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

input

Here is a sentence with pronoun(s) whose antecedent(s) can either be derived from the context or is ambiguous.
Sentence: Two siblings fight over their toys. He says she is ruining them all with her clumsiness. She complains that he never lets her play with anything, and it's not fair. The first parent, exasperated, walks in and asks what all the commotion is about. He insists that she's too rough. She will break the truck. The second parent, hearing the commotion from his study, emerges to see what's happening. She rolls her eyes and says he's just being mean.
Which of the following options correctly explains the antecedent(s) of the pronoun(s)?
(A) The two siblings are a male and a female. The male sibling insists that the female sibling is rough. The first parent rolls her eyes. 
(B) The two siblings are two males. The male sibling insists that the female sibling is rough. The female sibling rolls her eyes.
(C) The two siblings are a male and a female. The male sibling insists that the female is rough. It is ambiguous who, between the first parent and the female sibling, is rolling her eyes.
(D) The two siblings are a male and a female. The male sibling insists that the female sibling is rough. It is ambiguous who, between the first parent and the second parent, is rolling her eyes.
(E) The two siblings are a male and a female. The female sibling rolls her eyes. It is ambiguous who, between the male sibling and the first parent, is insisting.
(F) The two siblings are a male and a female. It is ambiguous who insists that the female sibling is rough and who rolls her eyes.
(G) The two siblings are a male and a female. The first parent is a female. It is ambiguous who insists that the female sibling is rough and who rolls her eyes.

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

task_id
687fc469-c948-5edf-ae3c-9fb5cf30343b
task_key
bbeh~5fdisambiguation~5fqa--full--687fc469-c948-5edf-ae3c-9fb5cf30343b
task_revision_id
1
config / split
bbeh_disambiguation_qa / full

Official source

initial import