benchmarks.wiki / Public workspace

BIG-Bench Extra Hard (BBEH) / Here are three (post, reply) pairs from Reddit. Your task is to decide whether…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

input

Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0").

POST 1: The robust and revered PvP community would literally flood this sub literally everyday with literally 100 threads if they literally decreased the cost and literally destroyed the LLD PvP item economy.
REPLY 1: Because PVP is shit upon all the time, I don't even think they initially wanted to implement it and the support is still very low (not that it should take priority from the base game) I guess there's always high level pvp as an option but low level seems to be more challenging you work to min max your gear; you don't have a ton of passives to influence said build it was just very interesting as a mode when it initially dropped.

POST 2: If by "too hard" you mean "completely disregarded my feelings on the issue in order to fulfill some fantasy" then yes, yes you did.
REPLY 2: I'm thinking to set himself apart he should make a dick pic collage set to music and just send the link out.

POST 3: I love it when gamergaters try to disguise their origins as anything but a smear campaign started by a bitter ex boyfriend posting on 4chan.
REPLY 3: Yeah, it's not as if the _first ever use of the hashtag_ was someone retweeting an attack video about Zoe Quinn (and in the process ruining my ability to watch Firefly ever again) or anything.

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

Official source

initial import