{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"763a62dd-6e26-53f1-b8f0-9a3f2bbcf47e","task_key":"default--validation--2777","task_revision_id":"1","upstream_id":"2777","short_description":"HellaSwag validation 2777","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to get your friend's parents to like you [title] Dress nicely. [step] Do not wear anything too revealing, wear clothes that look decent. Make a good impression by meeting them well dressed from the start; this shows respect for your friend's parents and for yourself.\",\"endings\":\"[\\\"[title] Avoid wearing baggy or sloppy clothing, as it makes you look like a slob. [step] If you want to be comfortable, try clothing that fits close to the body so you're not completely baggy.\\\", \\\"Also, make sure that you are meeting the person's parents--when they are not there they will ask questions and play the roles of authority figure. [title] Stay away from fashion : [step] Do not wear the same clothes from the previous chapter all the time.\\\", \\\"It will also show your friends your confidence and respect their time and opinion. If you ask your friend's parents if they like you, they are saying no no: if they don't like you then why bother.\\\", \\\"[substeps] Don't wear anything too revealing, dress modestly and make sure you don't pop pimples or a bad smell when you first get the parents' attention. Make a good impression by wearing clean underwear and not taking it off.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}