{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8a9072a-08ea-5f32-a457-6de47d609517","task_key":"default--validation--10673--variant-0d2d251daa1f","task_revision_id":"1","upstream_id":"10673--variant-0d2d251daa1f","short_description":"HellaSwag validation 10673","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat damaged hair [title] Switch up your shampoo. [step] Look for a moisturizing shampoo, or one for damaged hair. Keep an eye out for shampoos with natural ingredients like jojoba oil.\",\"endings\":\"[\\\"Look for shampoos made with argan oil, which helps prevent hair from drying out and discoloring. [substeps] Moisturizing is also great for fine dry hair, coarse hair, or hair that hasn't reached your desired length.\\\", 'Look for products made for your hair type. [substeps] For example, cream shampoo gives your hair volume and can help smooth curly hair.', '[substeps] Natural ingredients that moisturize will work best to treat your hair. Some chemicals can make your hair feel smoother, but will really cause further damage to the follicle.', 'Read the label of your shampoo to confirm your brand. Some popular moisturizing shampoos are kale, argan, lemon, and avocado.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}