{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"319a08dd-5893-5d54-83ab-6c968a2750bf","task_key":"default--validation--49028","task_revision_id":"1","upstream_id":"49028","short_description":"HellaSwag validation 49028","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style thick hair for men [title] Get a textured hairstyle if you have short thick hair. [step] Short, thick hair that is choppy and textured on top will look more styled than if it were all one length. When you're ready to style it, you can spike it up or brush it off to one side.\",\"endings\":\"['[title] Go with an undercut if you have medium-length thick hair. [step] Undercuts are long on top and short on the sides and nape of the head, so you can still have length without your hair being unruly or in your face all the time.', \\\"[substeps] Try side-swept styles because they'll give your hair more volume and will leave you with short layers on top. If you can pull a side side-swept look off with your bangs, try wearing them straight down.\\\", \\\"[substeps] Get enough frizz and length so that your part isn't too short. [title] Use wax, hairspray, or mousse if you like.\\\", \\\"You can easily do this with a hairspray if you're holding a lot of hair in one hand and let your arm roll. [substeps] If your thick hair falls below your forehead on the sides, you may also need to use a diffuser to ease that back.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}