benchmarks.wiki / Public workspace
BIG-Bench Extra Hard (BBEH) / Here are three (post, reply) pairs from Reddit. Your task is to decide whether…
Problem
Answer published by the source. Consult the official source to check your work against its answer.
input
Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0").
POST 1: The Australian Vaccination Network is finally being forced to change its name to something that reflects its anti-vaccination position.
REPLY 1: While they're at it they should probably change the name of family planning clinics to baby murder centres.
POST 2: you can get this shit for 50 on ebay but they all charge at 0.5A or something stupidly slow youre better off buying a xiaomi MI charger 10400mAH that costs 20 bucks and charges your phone 4 times over
REPLY 2: You mean that app on my phone called solar charger doesn't actually work and I need to get a real one?
POST 3: Because there are some days when I need to bake brownies for church group, the minivan won't start, Lakynn and McKaidy and Phawcett won't eat their veggies, and I have to sit back, practice my mindfulness, ask myself what Jesus would do, and remind myself to live, laugh, and love.
REPLY 3: It prevents me from smashing my head into a wall until it bleeds while screaming at god for birthing me into this never ending void of unrelenting agony and existential dread.
Plain-text mathematical notation (without MathML)
Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0"). POST 1: The Australian Vaccination Network is finally being forced to change its name to something that reflects its anti-vaccination position. REPLY 1: While they're at it they should probably change the name of family planning clinics to baby murder centres. POST 2: you can get this shit for 10−50 on ebay but they all charge at 0.5A or something stupidly slow youre better off buying a xiaomi MI charger 10400mAH that costs 20 bucks and charges your phone 4 times over REPLY 2: You mean that app on my phone called solar charger doesn't actually work and I need to get a real one? POST 3: Because there are some days when I need to bake brownies for church group, the minivan won't start, Lakynn and McKaidy and Phawcett won't eat their veggies, and I have to sit back, practice my mindfulness, ask myself what Jesus would do, and remind myself to live, laugh, and love. REPLY 3: It prevents me from smashing my head into a wall until it bleeds while screaming at god for birthing me into this never ending void of unrelenting agony and existential dread.
Original LaTeX notation
Here are three (post, reply) pairs from Reddit. Your task is to decide whether each reply is sarcastic. Specifically, label each pair with a "0" or "1", wherea "1" indicates that the reply is sarcastic, and a "0" indicates that the reply does not contain sarcasm, and provide your final answer as a comma-separated set of labels (e.g., "1,0,0" or "0,0,0"). POST 1: The Australian Vaccination Network is finally being forced to change its name to something that reflects its anti-vaccination position. REPLY 1: While they're at it they should probably change the name of family planning clinics to baby murder centres. POST 2: you can get this shit for $10-$50 on ebay but they all charge at 0.5A or something stupidly slow youre better off buying a xiaomi MI charger 10400mAH that costs 20 bucks and charges your phone 4 times over REPLY 2: You mean that app on my phone called solar charger doesn't actually work and I need to get a real one? POST 3: Because there are some days when I need to bake brownies for church group, the minivan won't start, Lakynn and McKaidy and Phawcett won't eat their veggies, and I have to sit back, practice my mindfulness, ask myself what Jesus would do, and remind myself to live, laugh, and love. REPLY 3: It prevents me from smashing my head into a wall until it bleeds while screaming at god for birthing me into this never ending void of unrelenting agony and existential dread.
Discussion
No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
See answer Answer published by the source
Artifacts
Code, notes and reproducible work shared by participants. Files are served from a separate origin.
No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
Source and history
initial import