{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a95058fc-73dd-5dc2-9b92-5483f03c277c","task_key":"default--validation--31283","task_revision_id":"1","upstream_id":"31283","short_description":"HellaSwag validation 31283","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to improve your webcam's output quality [title] Have a lamp or some other sight source pointing at you (optimally, your face). [step] Do not use your laptop as the primary light source. When the rest of the room is dark and you are sitting in front of your webcam, that is what you are doing.\",\"endings\":\"[\\\"[substeps] Unless you want the particular effect (as in creating a silhouette), don't sit in front of a window. Even if the blinds are closed, your webcam will pick it up.\\\", \\\"[title] For laptops, if you don't have a lamp, use another light source such as a backlight. [step] But make sure it is convenient to work into the dark and won't make it too dark.\\\", '[title] Keep your cellphone and television set unplugged to avoid the temptation to keep searching for your webcam. [title] If you have access to the internet, make sure you have actual real time screenshots of your webcam in your phone.', '[title] On your lens frame use eyedrops. [step] It will make your video stream work better if the eyedrops are spaced far apart.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}