{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"973ebef8-4a64-5f75-85cf-ad3e52343d1d","task_key":"default--validation--15166","task_revision_id":"1","upstream_id":"15166","short_description":"HellaSwag validation 15166","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to say no politely to a man who asks you out [title] Listen to what he has to say. [step] Especially if the man who is asking you out is an acquaintance or a friend, you don't want to interrupt him while he's speaking to you. [substeps] Even if you know that he's going to ask you out, and you want to say no, you don't want to cut him off.\",\"endings\":\"[\\\"That can make him think that you're not interested. Try to keep things as short as possible.\\\", 'Instead, make eye contact when listening to him, nod, and state your thoughts without moving your lips. Avoid making him uncomfortable or alarmed by what he has to say.', \\\"Cutting him off while he's talking makes you appear overly eager to reject him and rude. Keep a respectful distance from him, and smile slightly.\\\", \\\"Instead, focus on listening to his side of the conversation so you feel you're being heard. If he asks for your number, don't take his word for it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}