{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d2b626b-d06e-551f-82dd-f27ba531dddc","task_key":"default--validation--39961","task_revision_id":"1","upstream_id":"39961","short_description":"HellaSwag validation 39961","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to transition your wardrobe to fall [title] Layer appropriately. [step] Layering is one of the best means to transition a wardrobe item from summer to fall. If you don't want to put away your favorite band t-shirt or summer dress, some layering allows you to wear the item into the fall months.\",\"endings\":\"[\\\"You don't need to pair gym clothes with a ratty t-shirt and a pair of flip flops. That just has to wear out the rest of your wardrobe.\\\", 'It can also show off your bare shoulders, displaying the movement and warmth of summer. [substeps] Sweaters can be paired with sweaters or wrap-ins like backless jackets or bomber jackets, which can result in paired outfits throughout the summer.', 'This can help you focus your wardrobe on a color theme. [substeps] A layered top can backfill a plain onesie to create an old, stuffy and far out-of-your-league summer look.', '[substeps] Throw on a nice button down jacket or cardigan over a shorter sleeved t-shirt. This will make the item warm enough for fall.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}