{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4dbf945b-860e-5f78-a42d-94b31a263723","task_key":"default--validation--10187","task_revision_id":"1","upstream_id":"10187","short_description":"HellaSwag validation 10187","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress well as an overweight man [title] Wear clothes that fit your body now. [step] You may have been lighter several months or years ago, or maybe you are about to start a new diet. However, if it doesn't fit you now, don't wear it.\",\"endings\":\"['Even if it is a light colored sweater or light green pants, just go with what you feel, as this is the way to go. Here are some things you should look for in shoes that fit you at the time : [substeps] Heels: this is important, since they help you reach your target height rather than dropping you.', 'You want to fit when you feel confident, not rushed or fiddling around. The way you look now is more important.', \\\"This might mean that you have to invest in some new clothes that fit you. Too-tight clothing just draws attention to the fact that you're overweight, emphasizing curves you may not want emphasized.\\\", 'Put on one of the clothes that you normally wear, and grab another piece of clothing that fits well, such as a jumper and sweater. [substeps] If you have thin legs, tighten those curves.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}