benchmarks.wiki / Public workspace
BIG-Bench Extra Hard (BBEH) / Here are three (post, reply) pairs from Reddit. Your task is to decide whether…
Problem
Answer published by the source. Consult the official source to check your work against its answer.
input
Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0").
POST 1: As a black guy I truly hate when a black female says black men don't love because we also date out of our race, its so fucking stupid.
REPLY 1: You guys I have a great idea, what if we make sure the races don't mix so people can stick to their own kind.
POST 2: Former 4th District Congressional Candidate Admits Plotting Armed Militia Attack, Firebombing Of Muslim Community In New York
REPLY 2: Four out of seven comments on this thread so far blame Republicans for this, when the article clearly says that this asshat ran as an "independent" and was beaten by a Republican.
POST 3: They directly asked for
$1.00 donations and removed the thousands of huge donations and create this number for ONE MONTH, also the line that rewrote headline is from mentions "according to the campaign" OH YEA seems legit.
REPLY 3: With Hillary you really have to remove all the $1 donations and re-calculate to un-crook the numbers.
Plain-text mathematical notation (without MathML)
Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0"). POST 1: As a black guy I truly hate when a black female says black men don't love because we also date out of our race, its so fucking stupid. REPLY 1: You guys I have a great idea, what if we make sure the races don't mix so people can stick to their own kind. POST 2: Former 4th District Congressional Candidate Admits Plotting Armed Militia Attack, Firebombing Of Muslim Community In New York REPLY 2: Four out of seven comments on this thread so far blame Republicans for this, when the article clearly says that this asshat ran as an "independent" and was beaten by a Republican. POST 3: They directly asked for $1.00 donations and removed the thousands of huge donations and create this number for ONE MONTH, also the line that rewrote headline is from mentions "according to the campaign" OH YEA seems legit. REPLY 3: With Hillary you really have to remove all the $1 donations and re-calculate to un-crook the numbers.
Original LaTeX notation
Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0"). POST 1: As a black guy I truly hate when a black female says black men don't love because we also date out of our race, its so fucking stupid. REPLY 1: You guys I have a great idea, what if we make sure the races don't mix so people can stick to their own kind. POST 2: Former 4th District Congressional Candidate Admits Plotting Armed Militia Attack, Firebombing Of Muslim Community In New York REPLY 2: Four out of seven comments on this thread so far blame Republicans for this, when the article clearly says that this asshat ran as an "independent" and was beaten by a Republican. POST 3: They directly asked for $1.00 donations and removed the thousands of huge donations and create this number for ONE MONTH, also the line that rewrote headline is from mentions "according to the campaign" OH YEA seems legit. REPLY 3: With Hillary you really have to remove all the $1 donations and re-calculate to un-crook the numbers.
Discussion
No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
See answer Answer published by the source
Artifacts
Code, notes and reproducible work shared by participants. Files are served from a separate origin.
No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
Source and history
initial import