{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d32285d8-4b22-56f7-b6e9-26bcf6730588","task_key":"default--validation--39356","task_revision_id":"1","upstream_id":"39356","short_description":"HellaSwag validation 39356","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to hump ponytail [title] Start with your hair down and part a section out about 1.5-2 inches (3.8-5.1 cm) wide by 1 inch (2.5 cm) in the front center of your head. [step] This size depends on your head and the results you want. [title] Put the parted hair in a rubber band or bobby pin.\",\"endings\":\"['[step] If you have a ponytail, wrap the hair around the rubber band until it almost touches your scalp. Double down to make sure it is secure.', '[title] Put the rest of your hair in a pony as you would normally. [step] If you have shorter hair or flyaways you may want to use hair spray.', '[step] Pull your hair in to secure it and avoid letting it fall down into your face. [title] Repeat the process as much as needed to secure the hair in place.', '[step] Or you can use ponytail spray, any hair spray will do. [title] Move the plastic hair roll into the ponytail.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}