{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa8f5381-3156-587f-bf56-7b68bf22ab82","task_key":"default--validation--13469","task_revision_id":"1","upstream_id":"13469","short_description":"HellaSwag validation 13469","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to talk to a girl at school (boys ) [title] Stay calm. [step] Try not to overthink the situation. Though you want to talk to this girl very much, remember that she is not perfect and may be as nervous as you.\",\"endings\":\"[\\\"This really is not a good thing, so just relax and let her do all of the talking. Don't try to interrupt her while she is talking.\\\", 'Girls have emotions and feelings just like you do and may be wondering the right way to approach you as well. Or she may be waiting on you to make the first move! .', \\\"But try to become as calm and collected as possible when you talk to this girl. [substeps] Give her your undivided attention instead of worrying about how to react or what you should say next-that way you won't get ruined.\\\", 'She may come around with small talk at first, but always be prepared. [substeps] For example, if you have nothing to talk about, just talk about something else, like your school, the weather, and your friends.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}