{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8662032-3a1b-5dc2-9d4d-e8da2a8c4541","task_key":"default--validation--19199","task_revision_id":"1","upstream_id":"19199","short_description":"HellaSwag validation 19199","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take hair extensions out [title] Gather all of your hair into a ponytail. [step] Take all of your natural hair as well as any extensions and pull them together into one or two hair ties or big hair clips at the top of your head. If you can, try to group your natural hair and your extensions in separate clips.\",\"endings\":\"['Secure the top with hair tape, clamp the clips onto the end with plenty of hair screws, and tie your hair back into a secure hair tie. [title] Make sure to use your hair on the top-the middle portion of your hair is best.', '[substeps] Tie back hair that is longer or shorter than your natural hair about one or two inches above your left ponytail (this still works, but it will add volume to your hairstyle) to give your natural hair a temporary styling boost. [title] Separate your hair into sections on your head.', '[title] Separate a section of your hair from the ponytail. [step] It will be too overwhelming to try and rip out all of your extensions at once, so you want to pull out separate rows of hair at a time.', 'You can put your hair into a basic, up-do style. [substeps] If it is a hot day, you may not need any clips.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}