{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2140d21f-f1ff-5177-acb3-d02ddb10bbbb","task_key":"default--validation--17168","task_revision_id":"1","upstream_id":"17168","short_description":"HellaSwag validation 17168","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear distressed jeans [title] Wear lightly distressed jeans. [step] Jeans don't have to have large rips or sections of bleach to be considered distressed. The jeans only need to have a few small rips or areas of discoloration to be considered distressed.\",\"endings\":\"['Plus, you can use distressed jeans in a variety of ways : [substeps] Try distressed jeans that have clean, stain-free seams. Try doc martens or anything other distressed with distressed seams.', 'Do not combine rips or discoloration if you want your jeans to be only slightly distressed-you should only choose one. [substeps] Lightly distressed jeans work well if you are wearing them to school, work, or a casual event-like a party.', \\\"When you go out shopping for distressed jeans, make sure that you select quality jeans. For instance, don't be afraid to go to a vintage laundromat or an iron-dry laundromat, even if they aren't necessarily distressed jeans.\\\", 'Distressed jeans are often worn as tourist wear. [substeps] Distressed denim reminds a lot of the skinny-leg jeans from the days when comfort was the main concern.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}