{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50744781-13a1-55c0-beec-86e23e5e1809","task_key":"default--validation--17546","task_revision_id":"1","upstream_id":"17546","short_description":"HellaSwag validation 17546","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to revive dead hair [title] Shampoo your hair less frequently. [step] If your hair is dry and damaged, limit your use of shampoo. Shampoo can remove oils your hair needs to repair damage, so it's a good idea to cut back on how often you're shampooing your hair.\",\"endings\":\"['[title] Dry your hair with a flat iron. [step] Dry hair is notoriously prone to splitting and tangling.', 'This will ensure that your hair is fresh and healthy. [substeps] When you wash your hair, you cut back on how much shampoo you use.', \\\"[substeps] For example, if you usually shampoo your hair every day, try shampooing it every other day or twice a week instead. If you've done something that has caused damage to your hair, such as coloring it, it's important to avoid shampoo for 48 hours afterward.\\\", 'Shampoo too often can strip it of oils and dry hair, which can lead to damaged ends and hair overall loss. More regular shampooing can also help repair damaged hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}