{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7801c50-bcc3-55cd-9a2f-4f5b7b946346","task_key":"default--validation--23968","task_revision_id":"1","upstream_id":"23968","short_description":"HellaSwag validation 23968","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to find out if your friend's crush is crushing back [title] Be up front. [step] The easiest and most effective way is to just ask your friend's crush about their feelings. If you're having trouble working up the courage to ask such a personal question, there's a few ways to make the process easier.\",\"endings\":\"[\\\"[substeps] Check if your friend's crush already told them that they want to get back together. If they haven't told you yet, call them and let them know it's time to talk and be upfront about your feelings.\\\", \\\"[substeps] Consider the time and place you're going to have the conversation. Make sure the crush is in a comfortable area, probably out of earshot from anyone who could listen in.\\\", 'Most people love sharing their feelings with someone who cares about them. If your friend has been hanging out with that same guy with their crush, they probably have feelings for someone too.', '[substeps] Once you\\\\'ve reached this point, you can use this information to give your best advice. For example, you might say, \\\" hey, i hear you guys are crushing back and forth now.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}