{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f14f7ac2-7b7d-5cda-bcae-7e4bc2f0fb1e","task_key":"default--validation--1938","task_revision_id":"1","upstream_id":"1938","short_description":"HellaSwag validation 1938","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hairline grow back [title] Use the right shampoo. [step] There are plenty of shampoos that claim to regrow hair, but some work better than others. Know what to look for before you invest any money in this type of specialty hair product.\",\"endings\":\"['[substeps] Look for a gentle shampoo that clears your pores without the use of harsh chemicals. Herbal shampoos can be especially beneficial.', \\\"Most regular shampoos will effectively regrow the hair long enough so that it doesn't lose any shine. If you've tried them all, you should be able to determine whether they are right for you.\\\", '[substeps] Look for products labeled as \\\" keratin. \\\" making this a part of hair naturally makes the hair grow.', 'To effectively grow hair using this product, keep a shampoo in your shower area and try not to use it more than one time. [substeps] Use a shampoo that is at least 30% conditioner.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}