{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"546c5634-31c3-5e5a-9d6e-14842757d876","task_key":"default--validation--4073","task_revision_id":"1","upstream_id":"4073","short_description":"HellaSwag validation 4073","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hair healthy, smooth and shiny [title] Comb or brush your hair carefully. [step] If you have knots in your hair use hair de-tangler only on that knot. [title] Use hair serum from any product brands.\",\"endings\":\"[\\\"[step] You also need to use thermal protection serum if you're going to use heat styling products on your hair. If you have frizzy hair then you should use anti frizz thermal protection.\\\", \\\"[step] It's easier to create a hairstyle for something short whereas this works best for very curly or straight hair. Apply hair serum with your fingers and run a hand through your hair from root to tip.\\\", '[step] If your hair is wavy or frizzy use hair de-tadepositing (hair volume) serum from any shampoo or make up brand. [title] Spritz your hair with a thin layer of conditioner.', \\\"[step] Not compulsory, for instance chromecast is a company that sells certain products for the minimum payment. Figure out what your hair needs by reading online or by looking at serums or advice for products you don't want.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}