{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"893dda2e-46a0-59dd-a3f0-f5e21cdb269f","task_key":"default--validation--36902","task_revision_id":"1","upstream_id":"36902","short_description":"HellaSwag validation 36902","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do 70s hair [title] Brush your hair into a side part. [step] To make a pageboy cut, you will do a lot of molding and styling. It's important to start out with smooth, flat hair.\",\"endings\":\"['If your hair is brittle, it will likely be matted to your head, which can make it difficult to move your hair out of the way. Start out by making a side part for hair that is slightly longer and straighter.', '[substeps] If you have curly hair, you may want to consider a side parting to create a natural look. If you have thick hair, use a hair product that is synthetic.', 'The hair of anyone with straight hair will be too straight. Be sure to dry your head completely in the shower before cutting.', \\\"To start, take a brush and run it through your hair. Brush your hair so it's neat and tangle free to start.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}