{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0bd7390c-6830-5562-8a4b-ac7ad0bf9a9f","task_key":"default--validation--15546","task_revision_id":"1","upstream_id":"15546","short_description":"HellaSwag validation 15546","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get spiral curls [title] Wash and condition your hair. [step] If you have naturally curly or wavy hair, apply a leave-in conditioner. If you have straight hair, skip the conditioner and use a detangling spray.\",\"endings\":\"[\\\"Getting your roots wet will help manage frizz. [substeps] If you're having flyaways or waves, you want to apply the right amount of conditioner.\\\", \\\"Part your hair on the side that isn't straight (the part in the arch). Squeeze the conditioner from your hair, then use a styling cream to hold your hair in place.\\\", '[title] Comb out your hair and apply a product. [step] If your hair is naturally curly, use a curl-defining gel.', '[substeps] Leave-in conditioners are gentler than air dry. Most hair products prehydrate and hydrate your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}