{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b07a8a09-2491-57cb-908a-89ca44ecf2ee","task_key":"default--validation--40028","task_revision_id":"1","upstream_id":"40028","short_description":"HellaSwag validation 40028","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a crochet top [title] Wear a nude tank top underneath. [step] It can be daunting to pick out a crochet top simply because they can appear very exposing. Popping a nude camisole on underneath your crochet top is the perfect solution.\",\"endings\":\"['This will show off your armor and make it more visible. [substeps] Let the fabric of the tank and corset show through in the front.', \\\"By choosing a nude color, it will not blend in or distract from the crochet pattern, which is the star of your outfit. You're also fully covered, so there is no need to worry about exposing too much or looking inappropriate.\\\", \\\"You don't need to go out and bother trying to expose your entire body, just a bit of flesh will do just fine. On top of that, look for a thin, strapless top that has v-neck hanging down the front, and below that is a v-neck bra containing darts or barbell rigs.\\\", \\\"It works best with their any color tank top and can be ironed on if it's a darker shade. [title] Try a long-sleeved top.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}