{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fe9db56-dd46-5835-bd3b-756f587c9448","task_key":"default--validation--35848","task_revision_id":"1","upstream_id":"35848","short_description":"HellaSwag validation 35848","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a chain belt [title] Wear a chain belt with jeans. [step] Jeans look great with almost any kind of belt, including chain belts. Try pairing your favorite jeans with a chain belt threaded through the loops or hanging around your hips to emphasize your curves.\",\"endings\":\"['A belt made of cargo or hemp often accentuates the narrowest parts of the body. [substeps] Choosing a belt with the wrong loops or braiding it to emphasize your hourglass body is a recipe for disaster.', \\\"[title] Cut your chain belt's ruffles. [step] If your chain belt strips are loose, you can simply cut them.\\\", 'Wear a denim chain belt with your favorite jeans to keep your look casual and modern, both of which means leggings and cool tops should be worn at all times when wearing a chain belt. [substeps] Wear a denim chain belt with long-sleeved shirts or informal half-sleeve tops and leggings for a nice look.', '[substeps] Consider the cut of the jeans when deciding how to wear the chain belt with them. For example, if they are high rise jeans, then you would probably want to position the chain belt around your natural waist.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}