{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bafa4d89-1c44-53a7-88ec-bf52b7ef8a29","task_key":"default--validation--23803","task_revision_id":"1","upstream_id":"23803","short_description":"HellaSwag validation 23803","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hair grow longer [title] Use gentle shampoo and conditioner. [step] Long hair starts with good hair care, and good hair care starts with using the right shampoo and conditioner. It's important to use products that increase the strength of your hair rather than causing damage.\",\"endings\":\"['Ask your stylist to recommend professional products formulated for your hair type. [substeps] There is an increasingly popular movement to use no shampoo at all, as your body naturally regulates hair oils.', \\\"[title] Talk to your doctor about treatment options. [step] Heat therapy may be beneficial to your hair, but don't overdo it when trying to increase the volume of your hair.\\\", '[substeps] Shampoo your hair once or twice a week to pull it up and ensure it is not tangled. Use shampoo and conditioner that is lighter than your hair color.', \\\"[substeps] Deep conditioner will be the best conditioner for long-haired hair if you have lots of hair, especially if it's straight. [title] Use a conditioner after washing your hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}