{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dfe14c5e-52f6-5bf7-9b6d-ba604ac25f7f","task_key":"default--validation--14965","task_revision_id":"1","upstream_id":"14965","short_description":"HellaSwag validation 14965","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get silky hair if you are a guy [title] Choose a gentle shampoo. [step] To keep your hair silky, you need to keep it clean, but not too clean. The natural oils in your hair are what helps to keep it strong and healthy, but those oils can also trap dirt and become greasy, making you hair dirty.\",\"endings\":\"[\\\"Also, don't use sulfates on your hair either-they are too harsh, which can damage your hair more than it already is. [title] Pick an anti-frizz shampoo that has anti-frizz ingredients.\\\", 'You need to strike a balance between too much cleaning and not enough to have silky hair, meaning that a gentle shampoo is an essential part of your cleaning routine. [substeps] Try to use shampoo made with natural ingredients, and avoid shampoo with strong artificial fragrances.', '[substeps] Be sure to use only a mild shampoo if your hair is very thick or coarse, and never use product stronger than a light shampoo. If your hair is very thick, opt for a more moisturizing conditioner.', \\\"[title] Use warm or cool water in your shower. [step] Although not a necessary step, it's a good idea to use warm water to prevent your hair from becoming dry or greasy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}