{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f110c02-0606-584d-ba21-e8a2679c612f","task_key":"default--validation--31789","task_revision_id":"1","upstream_id":"31789","short_description":"HellaSwag validation 31789","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style curly hair in 20 minutes or less [title] Do a ponytail for a classic look. [step] A pony tail is a simple, classic hairstyle that works on nearly all hair types, curly hair included. To do a classic ponytail, gather your hair in back.\",\"endings\":\"['Keep your hair tightly wrapped in a loose bun as you run your fingers through your hair. [substeps] This works best if your hair is very curly and requires bit of traction.', 'Choose a curly ponytail in this order : [substeps] Start with one messy strand. Let this part go down to the longer strand.', 'You can gather all your hair, or just clip back part of it. A pony tail can fall high or low, depending on your preference.', 'Loop the ponytail in one of your fingers, use your other hand to secure your hair with bobby pins. After your hair is secure, use a fork or your fingers to gather the rest of your hair into a ponytail in front of you with your back facing forward.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}