{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b8bb0af-004c-595f-9b1f-cec819ab6c4d","task_key":"default--validation--7718","task_revision_id":"1","upstream_id":"7718","short_description":"HellaSwag validation 7718","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to condition your hair [title] Condition after every shampoo. [step] Shampoo is designed to cleanse the hair of dirt and oils. Washing away the natural oils your scalp produces is necessary for your hair to look clean, but it can dry out your hair.\",\"endings\":\"['Always shampoo when your hair is soaking wet, or when you sweat excessively and your scalp is dry. Make sure that your hair is still wet before beginning at-home treatment.', 'If your hair is oily, a shower may help, too. [substeps] Use a deep conditioner, allowing your hair to retain moisture.', 'Change your shampoo at least once a week to set your quality of condition. [substeps] If you suffer from dry, greasy hair, try a lightweight, coconut oil based shampoo.', \\\"That's where conditioner comes in. Each time you shampoo, follow up by using conditioner that's right for your hair type.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}