{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9da4e03-1a98-5d56-a9f9-6958340971db","task_key":"default--validation--29767","task_revision_id":"1","upstream_id":"29767","short_description":"HellaSwag validation 29767","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create pin curls [title] Wash your hair. [step] To create pin curls, you must start with evenly damp hair. Although you can just spray your hair to wet it, washing it will give you a clean slate and your curls will last for longer.\",\"endings\":\"['Avoid using overly dry, unconditioned hair. It should be dark brown in color, and when you pull your hair back, it will look wavy.', 'Use a detangling product to wipe your hair of any moisture. [substeps] The first time you use an all-purpose paddle comb, make sure it is properly coated with the product.', 'If you need to dry your hair overnight, do so the night before and then again the next morning. [title] Pull your hair up into a bun.', '[substeps] Towel dry hair after your wash to remove excess water. If you have very thick hair, give a little time for your hair to air-dry before creating the curls.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}