benchmarks.wiki / Public workspace

BIG-Bench Extra Hard (BBEH) / Here are three (post, reply) pairs from Reddit. Your task is to decide whether…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

input

Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0").

POST 1: Russian President Dmitry Medvedev says he decided not to run for a second term because Vladimir Putin is both more popular and more authoritative.
REPLY 1: As a citizen of Russia i have too much to say, but all the people in the comment section below seem to know what living in my country is better than i do.

POST 2: Because the state of New York is going to forget everything they know about Trump and suddenly like him.
REPLY 2: As defined by Josh Marshall, Trump's Razor: "ascertain the stupidest possible scenario that can be reconciled with the available facts".

POST 3: Mother Teresa's Charity shuts down its orphanages in India after new guidelines notified by the Ministry of Women & Child Development (WCD) allow single, separated or divorced individuals to adopt children
REPLY 3: Once again, Church doctrine is being being given more weight than the well-being of children who are dependent on orphanages or would accept being adopted into a single parent household over that.

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

Official source

initial import