{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eab8d389-c87d-5040-bd0c-85a17a9adcdf","task_key":"default--validation--20870--variant-152c0ba76f6b","task_revision_id":"1","upstream_id":"20870--variant-152c0ba76f6b","short_description":"HellaSwag validation 20870","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to accessorize outfits with scarves [title] Wear a bulkier scarf during cooler months. [step] Longer, thicker scarves are easier to pull off, and far more comfortable, during the fall and winter months. This makes a rectangle scarf in fleece, wool, or cashmere a perfect choice for your fall outfit.\",\"endings\":\"['[substeps] Focus on going for fashionable scarves that have bows and wrapping tape to keep the scarf in place. Studies have shown that wearing scarves that are longer will make them more fashionable.', \\\"[substeps] Finally, a long, dangling, or floppy scarf is perfect if you're going to the beach. [title] Keep your scarves on in case they get wet.\\\", '[title] Wear a cardigan over a bulky scarf to wrap your blouse in. [step] It makes it far easier to layer into layers on colder days.', '[substeps] Wear warm toned scarves such as red, orange, brown, and beige in the fall. Try pairing a long, plaid rectangle scarf with fringe with a monochromatic dress or outfit, and then belt it with a skinny belt.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}