{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d57dcb47-5683-5eb0-ba2d-12bf9d4bde83","task_key":"default--validation--9157","task_revision_id":"1","upstream_id":"9157","short_description":"HellaSwag validation 9157","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look good at 40 [title] Change your face make-up to fit your age. [step] Our skin naturally changes over time. Imagine if you were using the make-up you used to cover those pimples in grade school! And even though you may not have noticed much, your skin changes from 25 to 30, from 30 to 35, and 35 to 40.\",\"endings\":\"[\\\"It's high time to update your make-up-you want very thin coverage that makes you glow. It's your natural beauty that's ready to be center stage.\\\", \\\"How young do you look now? And what would you like someone to see? Wash, apply an eyeshadow, and shave. Keep the hairdo simple and don't wear very much.\\\", \\\"Every time you do this now it's to bring out your natural beautiful smile. [title] Wear style! [step] This essential for looking smart and sophisticated and basically any boy wants to be smart.\\\", \\\"According to pinterest, those with age 50's don't wear much makeup or anything at all. These are easily lost in reality, there are so many products online.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}