{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05ad617e-785b-5510-bc59-446822209f47","task_key":"default--validation--50476","task_revision_id":"1","upstream_id":"50476","short_description":"HellaSwag validation 50476","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make bronze color eyeshadow [title] If you don't want the hassle, and don't want to try your own, you could always just search for your perfect colour. [title] Go to the stores. [step] They are often cheaper in stores that online, and most of them are plenty good quality.\",\"endings\":\"[\\\"[title] Choose the most interesting colour you can find. [step] The words' bronze' should be on the front, but when you have your permission, you can have some it plain gloss.\\\", \\\"[title] If you search through the stores, bring make up wipes. [step] Don't test shades on your hand, test them on your eyes, because the' perfect' shade may suit your skin, but not your eyes.\\\", \\\"Always check them out as they may only have the basics, but you won't need the extra colour later. Don't worry, with anything do you like? You'll find more colour there.\\\", 'Other places you could go to are the vpn shop, microsoft excel, and google sheetspace. These shops sell another, much better brand of colour.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}