benchmarks.wiki / Public workspace

BIG-Bench Extra Hard (BBEH) / Here are three (post, reply) pairs from Reddit. Your task is to decide whether…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

input

Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0").

POST 1: But Bernie said he's going to stop rich people from moving their money to Cayman Island, so he's going to make it impossible!
REPLY 1: Offshore tax consultants are drooling over the prospect of a Bernie Sanders presidency, they'll have no trouble marketing their services now.

POST 2: Landlord who banned 'coloured' people 'because of curry smell' insists he's not racist and is happy to rent to 'negroes'
REPLY 2: I don't understand why this is any different to the 10 local tenancy agencies in my area not letting a house to me because I'm white.

POST 3: Hey, as long as you salt the password in one function, MD5 it, pepper it in a different function and SHA1 it, MD5 the whole thing three times in a function called "cleanup()", and then MD5 it just before you store it in the database, it will be perfectly secure.
REPLY 3: This entire article is based on the assumption that PHP 5.5 is an option that everyone has access to.

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

Official source

initial import