{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7488a82d-a369-50b8-97dd-32c008b12b89","task_key":"default--validation--36320","task_revision_id":"1","upstream_id":"36320","short_description":"HellaSwag validation 36320","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a maxi dress [title] Recognize your body shape. [step] Every woman's body is different and the fit of clothing can enhance your shape. Knowing parts of your body you'd like to highlight can help you find the most flattering maxi dress for your shape.\",\"endings\":\"['[substeps] For example, if you are a 6-foot-4 petite figure, you might want a maxi dress that slihugs your body but pushes more stretch and fat while retaining greater volume. Or, if you are petite and tall, you might want a structured maxi dress that sags a little less behind your hips.', '[substeps] Figure out your body shape, and allow your body and its structure to be reflected in a dress. You can look in magazines to find pages focusing on your body type or try online resources like this: http: // www.tamenta.com/looking _ curvy.', 'Keep in mind you may be petite if you are under 5\\\\'4 \\\" or plus size if you wear larger than a size 16. Research different styles to decide on what you like and might look great on you.', \\\"The key is looking into the photographer's face when you choose your dress. Knowing your body shape can help you accentuate the correct parts of your body to balance out your look.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}