benchmarks.wiki / Public workspace

BIG-Bench Extra Hard (BBEH) / Here are three (post, reply) pairs from Reddit. Your task is to decide whether…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

input

Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0").

POST 1: Props to Nine News for picturing the schoolboy at the target of Latham's comments, I'm sure that this is in the public interest and the media is fulfilling all of their responsibilities to those who the story covers and certainly won't be used for anything negative
REPLY 1: This is a man who was brought up badly, who displays none of the characteristics which made the older generation admirable.

POST 2: oh no.... what a nightmare... The horror of letting the era of Cruz and Mitch McConnell controlling the senate go to Bernie Sanders.
REPLY 2: Master mind of the New Left, Bernie Sanders reveals himself to be his own political splinter group and the reincarnation of Noam Chomsky.

POST 3: Think of all the glitter bombs they use during their parades and the connection is all the more apparent!
REPLY 3: Looking forward to laughing at Kenya, Uganda and Russia in 50 years when they're better educated and begging for forgiveness

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

Official source

initial import