{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"360a3398-72c3-5e71-a33d-ee02e1a05335","task_key":"default--validation--8836","task_revision_id":"1","upstream_id":"8836","short_description":"HellaSwag validation 8836","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to do cute middle school hairstyles [title] Rock a ponytail. [step] Though it's a classic style, there are plenty of ways to freshen up a ponytail and make it look older for middle school. [substeps] Wear a high ponytail.\",\"endings\":\"['Throw your hair up into a high ponytail to hide it from view. Lay a cute towel around your pillow to catch the bobby pins and paste.', 'Wrap a ribbon around your shoulder and tie with a scarf. This way your ponytail will also be able to be braided.', 'This looks especially great if you have medium-length hair. After you put your ponytail in place and secure it with elastic, pull on the top and bottom of the ponytail right beside the band.', 'Ponytails are cute, but they will put a lot of tension on the bottom part of your hair. [title] Dress up the style with updos and conditioners.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}